We just ate a bit of downtime. Given what all died I'm happy with how it all turned out. The story goes like this. We had a planned migration to our new database server tommorow night, as our existing database was pounding on one poor hard drive (a temporary measure). That drive was rumored to die some time in the next 2-6 months by manufacturer specs. It died yesterday morning. :-\ I had to do a little dancing to recover the data, move it to a new server, and configure the new database server. Thankfully about half my configuration work was done in advance so the downtime took about as expected.
I'm going to keep my eyes out for new bugs, but I think this was a fairly solid transition (and I even finished early this time
Now unfortunatly, I still have to eat some downtime either tommorow night or wednesday night. We need to move over to our new load balancer, and when that happens there will be much rejoicing.