Tuesday, June 08, 2010

Post Mortem for Blogger Service Interruption June 7

By Eddie Kessler, Blogger Engineering Manager

As we recently committed to you, when serious service interruptions occur, we will provide you details about what went wrong and what we're doing to help prevent similar problems in the future.

From about 12:30 AM PST on Monday, June 7 until about 12:30 PM, a significant subset of Blogger users, mostly in the US Midwest, were unable to post to their blogs. No data was lost and blogspot was largely unaffected, so your blog’s readers weren’t impacted.

We posted the issue on the Blogger Status blog, and we made a brief status update on our Twitter account as well. Meanwhile, we kept a close eye on the reports coming through our help forum and Twitter stream.

The problem was caused by human error. One of our datacenters inadvertently had the wrong server configuration when we performed our regular service update. Once we figured this out, we corrected the problem quickly.

We are in the process of adding additional monitoring that will prevent this kind of outage from recurring.

We are truly sorry for any inconveniences this might have caused you. In the meantime, we will try harder to make Blogger a more reliable service.