Saturday, March 15, 2003

Blogger/Blog*Spot is now recovering from hardware failure on a critical switch. This is not the problem seen earlier this week with a database server, but instead was a problem with network connectivity between the various application/database servers.

The switch experienced total failure, which is especially surprising given that it was a brand new HP ProCurve device. Luckily there was a backup device which Cable&Wireless was able to move the network cables to (BTW: thanks, Marc Rose, you're the man). It took about thirty minutes for me to get to a computer to be able to troubleshoot and report the problem, and another thirty minutes or so to recover.