China, day one

In China now, after a 12+ hour flight from San Francisco.  Got in about 4-5 hours ago (I’m all screwed up on time right now).

It’s overcast and muggy and reminds me of Chicago summers.  Amazingly like Chicago actually except that I smell exhaust fumes (like Tijuana).  And people smoke (a lot more than I’ve become accustomed to).  I’ve been concerned about how I’d do with the air quality but if it keeps raining a bit, it shouldn’t be too bad for me.

I’m staying here, which isn’t a bad place.  Walking distance to Tsingua Science Park (I can see Google’s building from here) and to Mozilla’s China office.  When we got here, our rooms weren’t yet ready so they put us in temporary rooms until ~7pm.  I’m now sitting in my new room that was just cleaned except that the lady cleaning the bathroom somehow got herself locked in the bathroom.  So for the past 20 minutes a crew of people have been trying to unlock the door.  The last guy literally looked like he was picking the lock.  Oddly no one seems to be notice me.

Unfortunately there are only three TV stations in English - CNN, HBO and National Geographic.  Fortunately, I can VPN through San Jose to stream Netflix movies which might keep me entertained until bed time.  It’s a shame I don’t have Slingbox.

ipv6… is this thing on?

During the past two Firefox releases (2.0.0.5 and 2.0.0.6) I’ve been running an dual-stake ipv4/ipv6 accessible download server. This box was serving Firefox updates and was part of releases.mozilla.org. I thought I could use traffic numbers to help justify a native ipv6 Internet connection.

Here’s what ipv4 traffic looked like during a one week period covering a release:

IPv4 traffic

And ipv6…

IPv6 traffic

Er, where is everyone?

Justin, you win.

“There’s the iPhone and then there’s everything else.” - Sean Alamares

After weeks of trying to find an acceptable replacement to my Verizon Treo 700w, I’m throwing in the towel.

iPhone, you win.

Continued reading >

IPSEC VPN between Cisco IOS & Netscreen - solved !

This isn’t necessarily Mozilla related but after spending a month on and off trying to get an IPSEC VPN up between a Cisco IOS router and a Juniper Netscreen SSG5 and finding very little help online, I figured I might as well document it here for others to find (myself, for instance, or, hey Google - index this).

For those interested, read on.

Continued reading >

Comcast, Boo!!

I just switched from Vonage to Comcast Digital Voice and noticed the following under Status on digitalvoice.comcast.net portal:

Firefox is currently not playing back voice mail messages correctly. Please consider an alternate browser such as Internet Explorer or Safari while we address the issue.

Seriously?

Secret ipv6 sites…

If you’re ipv6 enabled, stuff the following into your hosts file and let me know how it goes.

2620:0:330:5::10    www.mozilla.com
2620:0:330:5::11    www.mozilla.org
2620:0:330:5::31    addons.mozilla.org

It might even be faster (since you’re probably the only one using those machines)!

Driving barefoot.

This is a rare non-Mozilla posting but worthy enough to share (IMO anyways).

I’m a Mac toting, blue leaning, carpool-loving Prius driver and tend to average about 47.1 mpg on my commute from “outer” East Bay (Pleasanton/Dublin). However, the past week’s weather has been much warmer and I’ve been driving mostly barefoot.

I was surprised to see that after a week of driving with bare feet, my mpg had jumped to 48.5!

To make sure this wasn’t some fluke, I reset the trip computer this morning and by the time I got into MoCo, I had hit 53.4mpg, an all time new high for me!

I even have proof -

My mpg.

Sweet.  No more shoes for me.

Where in the world is AMO? (Part V: It’s live, again!)

With little fanfare, we flipped the switch last night and started serving addons.mozilla.org out of both Amsterdam and San Jose. Took two tries and a hardware swap, but we got it!

This whole saga’s been detailed elsewhere (and here and here and here).

The Good (and the graphs)
Last time, I rolled back when Europe started waking up (~12:30am PDT). The Netscalers hit close to 900 SSL transactions/second before failing. As you can see, we more than doubled that rate!

AMO SSL Trans/sec

addons.mozilla.org is highly cache-friendly, which makes this whole solution work really well. Don’t believe me? Check out how the slope of cache request/second match nicely with SSL transactions/second:

SSL & Cache Rates

Where is everyone?
And finally, because everyone likes graphs and charts, here’s what AMO traffic looks like out of Amsterdam (and bonus points to anyone who can tell me when we made the DNS change):

AMO Traffic

… and out of San Jose:

AMO (SJC) Traffic

John Lilly blogged about Firefox growth based on language (locale) version, and while the US probably accounts for the majority of the traffic out of San Jose, the US is not, as John points out, the majority. 55% of AMO’s traffic is coming out of Amsterdam vs. 44% out of San Jose.

ps. To give credit where credit’s due, I should thank Citrix for aborting their normal release process to get me new code builds to get around two potential service impacting bugs. Took them a mere few days vs. six weeks, so rock on Citrix.

Where in the world is AMO? (Part IV: Take 2)

Nearly a month after the first attempt to get AMO (addons.mozilla.org) served out of Amterdam as well as San Jose failed, we’re ready to try again!

I finally got the replacement hardware (Netscaler 9000s) in Amsterdam up this morning. During our Tuesday night maintenance window I’ll be switching DNS.

For those late to this saga, take a look at:

  1. How do you get a dynamic website in another country without any servers?
  2. Where in the world is AMO?
  3. Where in the world is AMO? (Part II: It’s live!)
  4. Where in the world is AMO? (Part III: It’s Dead.)

Who needs IPv6 anyways?

The 6bone is dead. Long live IPv6.

(Don’t know what IPv6 is?)

I’m no stranger to v6 - I played with it years ago while at 3Com (hi Cindy!) and actually deployed it natively, along with an automatic 6to4 tunnel relay, at the last ISP I worked at. However, I think I was on the wrong side of the problem. I thought by offering it to customers, I’d have users wanting it. But without content, why would they care?

IPv6 suffers from the “chicken and egg” problem (which is the surprisingly on-topic discussion on NANOG these days). Users don’t clamor for v6 because there isn’t any v6 specific content or content that they can’t already get. Content providers aren’t providing v6 content because users aren’t clamoring for it. But the technology to suppot it has been there for years - governments have mandated it and NASA’s even launched an IPv6 satellite.

But to quote Nathan Ward from NANOG,

“Because for IPv6 to be useful to the masses, content is required.”

And the masses are coming. Like Apple did with making 802.11b accessible in the iBooks and by making the Airport so affordable, Microsoft is doing to v6 in Vista (and to an extent in XP SP2) with Teredo (and don’t forget the mobile users on Verizon Wireless or Sprint PCS).

Three things push technology like nothing else: gaming, military conflict and porn. So while I might not agree with the content, the folks at The Great IPv6 Experiment are probably on the right path to spur consumer demand.

It’s my position that it’s up to providers to start providing and that includes Mozilla.

Over the past week I rolled out v6 connectivity to hosts within Mozilla’s San Jose colo (thanks to Sprint and ISC for ipv6 tunnels) and natively at Moco headquarters. In the near future, I hope to deploy v6 versions of Mozilla web properties. In fact, the Bugzilla folk are already drinking out of the v6 cup with their test server - landfill.bugzilla.org (or landfill.ip6.bugzilla.org if you want to force v6).

This is largely an experiment to try to understand what it means to support v6 users and v6 content in a v4 world. For instance, what happens to a user who has a global unicast v6 address but no global connectivity or user in the US with a v6 tunnel to someone like SixXS who tries to reach Mozilla properties and ends up with poor page load times?

As much as I’d like to, I probably can’t just flip the switch and enable v6 versions.

So my goals around this are:

  1. Deploy an open Teredo and 6to4 tunnel server hosted by Mozilla to give the community a doorway to ipv6. Microsoft maintains the default XP/Vista configured Teredo server but some may not want all of their v6 traffic going through Microsoft.
  2. Deploy v6 versions of Mozilla web properties.
  3. Understand end-user impact of living on a v6 host in a predominately v4 server world.
  4. Understand implications of deploying v6 versions of Mozilla web properties in a predominately v4 client world.
  5. Share results with the community.

Nathan has a good idea that he talks about here to figure out how many eyeballs content provders would lose by adding AAAA records. In the future I want to roll this out on some Mozilla web property. We get an amazing number of unique visitors each day that I’d have a good sample to test against and report on.

Some might see me as a kook but I don’t care . IPv6 is here and actually is the future whether we want to believe it or or not (and subnetting is so much easier). Long live IPv6!

ps. Firefox may not be configured to work with ipv6. In order to make Firefox play nicely with ipv6, you’ll need to make sure the following variable (in about:config) is set to false:

network.dns.disableIPv6