Comments on: How do you get a dynamic website in another country without any servers? http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/ noise from a mozilla network engineer Thu, 08 May 2008 18:35:21 +0000 http://wordpress.org/?v=wordpress-mu-1.2.5 By: mrz’s noise » Blog Archive » I'm a Mac? and why the open Web rocks. http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-122 mrz’s noise » Blog Archive » I'm a Mac? and why the open Web rocks. Tue, 22 May 2007 23:30:11 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-122 [...] to a black MacBook that no one wanted (it seemed the perfect size to take with my on my trip to Amsterdam) and now I’ve replaced my desktop with a Mac [...] […] to a black MacBook that no one wanted (it seemed the perfect size to take with my on my trip to Amsterdam) and now I’ve replaced my desktop with a Mac […]

]]> By: mrz’s noise » Blog Archive » Where in the world is AMO? http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-83 mrz’s noise » Blog Archive » Where in the world is AMO? Mon, 07 May 2007 17:37:52 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-83 [...] flip the switch on getting addons.mozilla.org to be served out of Amsterdam as well as San Jose. I talked about how we’re doing this last week if you’re interested. We’ll make this change [...] […] flip the switch on getting addons.mozilla.org to be served out of Amsterdam as well as San Jose. I talked about how we’re doing this last week if you’re interested. We’ll make this change […]

]]> By: mrz http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-74 mrz Thu, 03 May 2007 16:24:22 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-74 Re: bottleneck - possibly but that's not much different than how it is now (you have to go to San Jose for writes). I over provisioned the bandwidth out of Amsterdam so that shouldn't ever be a bottleneck. I think we're on track to flip this this coming Tuesday though! Re: bottleneck - possibly but that’s not much different than how it is now (you have to go to San Jose for writes). I over provisioned the bandwidth out of Amsterdam so that shouldn’t ever be a bottleneck.

I think we’re on track to flip this this coming Tuesday though!

]]> By: Frédéric Wenzel http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-73 Frédéric Wenzel Thu, 03 May 2007 14:54:59 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-73 I really like to hear this as well. From my first tests I must say the Amsterdam AMO works quite well and I couldn't notice any drawbacks. Though, this only helps with the read-portion of a page, right? Luckily AMO is largely read-only. But in case you end up having a lot of write access to the Amsterdam datacenter wouldn't you end up having a bottleneck between SJC and AMS? I really like to hear this as well. From my first tests I must say the Amsterdam AMO works quite well and I couldn’t notice any drawbacks.

Though, this only helps with the read-portion of a page, right? Luckily AMO is largely read-only. But in case you end up having a lot of write access to the Amsterdam datacenter wouldn’t you end up having a bottleneck between SJC and AMS?

]]> By: shaver http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-72 shaver Thu, 03 May 2007 06:34:10 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-72 This is pretty great to see. I've always been a fan of the explicit invalidation model, and it's excellent to see this first step towards it playing out. Squid would also be a harder thing for us to use here because it doesn't seem to support an HTTP API for invalidation-by-pattern, which is critical to having the update-check responses handled correctly. (I think we could get all the rest of the performance we need with a 4-core Dell machine and an SSL offload card, but I'm not the one who'd get paged when it choked to death on a Firefox update, so I'm not going to push my luck!) Sure would be nice to have Vary:, though! :) This is pretty great to see. I’ve always been a fan of the explicit invalidation model, and it’s excellent to see this first step towards it playing out.

Squid would also be a harder thing for us to use here because it doesn’t seem to support an HTTP API for invalidation-by-pattern, which is critical to having the update-check responses handled correctly. (I think we could get all the rest of the performance we need with a 4-core Dell machine and an SSL offload card, but I’m not the one who’d get paged when it choked to death on a Firefox update, so I’m not going to push my luck!) Sure would be nice to have Vary:, though! :)

]]> By: mrz http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-71 mrz Wed, 02 May 2007 16:24:15 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-71 Not to mislead you but we're using Citrix Netscalers as our load balancer and since they do caching as well, I'm using them for that instead of building Squid boxes. We went non-open source for load balancing mostly for performance and costs (I would have spent nearly as much on a farm of machines doing ssl offload/proxy/whatever else as I did on the Netscalers). That said, I'm really interested in Varnish (http://varnish.projects.linpro.no/) as a high performance open source solution. Not to mislead you but we’re using Citrix Netscalers as our load balancer and since they do caching as well, I’m using them for that instead of building Squid boxes.

We went non-open source for load balancing mostly for performance and costs (I would have spent nearly as much on a farm of machines doing ssl offload/proxy/whatever else as I did on the Netscalers).

That said, I’m really interested in Varnish (http://varnish.projects.linpro.no/) as a high performance open source solution.

]]> By: mrz http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-70 mrz Wed, 02 May 2007 16:20:21 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-70 Based on traffic graphs in San Jose on the master and slave MySQL server I can infer bandwidth. mrdb03 is the AMO master read-write database server - it's pushing ~88Mbps outbound and pulling in ~6Mbps. mrdb04 is mrdb03's slave - it averages about 1.45Mbps in either direction. For whatever reason, from San Jose to Amsterdam, I'm only able to sustain something less than 5Mbps (it took about 1GB/hour for the initial MySQL replica tarball get to from San Jose to Amsterdam). Based on traffic graphs in San Jose on the master and slave MySQL server I can infer bandwidth.

mrdb03 is the AMO master read-write database server - it’s pushing ~88Mbps outbound and pulling in ~6Mbps.

mrdb04 is mrdb03’s slave - it averages about 1.45Mbps in either direction.

For whatever reason, from San Jose to Amsterdam, I’m only able to sustain something less than 5Mbps (it took about 1GB/hour for the initial MySQL replica tarball get to from San Jose to Amsterdam).

]]> By: Neil http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-69 Neil Wed, 02 May 2007 11:56:25 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-69 So if it takes 60Kbps to maintain a partial database sync, how much bandwidth would it take by comparison for the web server to talk to the sjc MySQL server? So if it takes 60Kbps to maintain a partial database sync, how much bandwidth would it take by comparison for the web server to talk to the sjc MySQL server?

]]> By: Adrian Chadd http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-68 Adrian Chadd Wed, 02 May 2007 06:34:20 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-68 I'm glad to hear another open source project has discovered just how flexible and powerful the Squid web cache is. We'd like to build a repository of information showing off just the sorts of things you're doing. It'll come online with the new Squid website I've almost finished (http://new.squid-cache.org/). Let me know if you'd like to share your experiences! I’m glad to hear another open source project has discovered just how flexible and powerful the Squid web cache is.

We’d like to build a repository of information showing off just the sorts of things you’re doing. It’ll come online with the new Squid website I’ve almost finished (http://new.squid-cache.org/).

Let me know if you’d like to share your experiences!

]]> By: Mike Beltzner http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-67 Mike Beltzner Wed, 02 May 2007 00:25:34 +0000 http://blog.mozilla.com/mrz/2007/05/01/how-do-you-get-a-dynamic-website-in-another-country-without-any-servers/#comment-67 This is really fascinating stuff. It would be cool to build up some best practises documentation on MDC to help other website authors grow and scale over time like this. This is really fascinating stuff. It would be cool to build up some best practises documentation on MDC to help other website authors grow and scale over time like this.

]]>