News sites and political blogs are expecting extraordinary traffic tonight as Americans track results of the Presidential election, and are scaling their infrastructure to meet the challenge. The extraordinary interest in the U.S. Presidential election is likely to translate into enormous web traffic tonight, and news sites and political blogs have had months to prepare. Several hosting companies report increased sales of dedicated servers, and election traffic will likely be a boon to content delivery networks (CDNs).
For some sites, preparing their infrastructure has already been a lengthy process. Some sites started their preparation back in January when the primary results were also well followed. Hardware is part of the solution, said Jeremy Bingham, who manages the back end for Daily Kos, the hugely popular political blog. “To handle the traffic better, we moved to a cluster of six quad core Xeons with 8GB RAM for webheads that all boot off a central NFS (Network File System) root, with the capability of adding more webheads as needed,” he said. Daily Kos also added two 16GB eight-core Xeons and a 6×73GB RAID-10 array for database files running a MySQL master/slave setup.
Hosting companies have reported increased demand for new hardware in recent weeks. “A few customers have ordered additional servers in order to support the expected increase in traffic over the last few weeks and for the next couple of days,” said George Karidis, CTO of SoftLayer, who said the hosting company has seen an even larger jump in orders for add-on services to help them scale. “In the past few days we have noticed an up-tick in the number of people buying ‘availability’ services like CDNLayer (a content delivery service) and load balancing. Many of these are related to ’spike’ oriented traffic like the election.”
Election night will provide a test for Twitter, the microblogging service which was once known for its downtime but has vastly improved its reliability in recent months. Twitter recently launched an Election 2008 channel which filters out political tweets and is receiving hundreds of updates each minute.
Several other popular new election sites likely to see unprecedented traffic include Electoral Vote projection services FiveThirtyEight.com and 270toWin.com, which are both hosted on platforms known primarily for their affordability.
Many database-driven sites facing scalability challenges have looked to the distributed caching system, which helps speed dynamic web applications. Bingham says “The backend also places fully rendered pages into memcached, which a hacked up lighttpd running as the front end proxy then serves these pages from memcached directly to anonymous users. This has helped the sites performance immensely, since not only does it spread the work of rendering these pages around to the all of the webheads, but it greatly reduces the amount of work the backend has to do.”
It will be a busy night for content delivery services, which cache customer content around the globe, moving files closer to the user to improve web site performance and reduce network traffic. The official campaign sites are each using CDN services, with BarackObama.com being supported by Panther Express and JohnMcCain.com by Edgecast.
The web’s busiest sites are bracing for enormous traffic. Yahoo had 80 million page views on Election Day in 2004 and 142 million the following day, according to the New York Times when Sen. John Kerry conceded. “We expect to do twice or perhaps three times as much traffic in 2008,” Neeraj Khemlani, the vice president for programming and development at Yahoo, told the Times.
Where can you track Internet traffic levels tonight? The best source may be the Visualizing the Internet application from Akamai (AKAM), which includes real-time graphics depicting traffic to news sites supported by Akamai’s CDN service. The all-time peak is 7.28 million visitors per minute during the 2006 World Cup.
As can be seen, the web and it's related infrastructure has become an important part of dispersing information to the people at all times. However, there will be little to report if you don't go out and EXERCISE YOUR RIGHTS. So, please give these websites some work to do... it's election day... GO VOTE.