Hooray for the IT guys!
Mark Guertin and Vincent Roman, our IT team, both worked for 24 hours straight to get the server back up and running properly. They deserve more than praise.
The folks at the server farm, The Planet
, not so much.
In our eleven years online this is the worst outage that we've had. Previously it was never for more than a hour or two.
This failure was a combination of hardware and software, but fortunately our database was well backed up (all 25GB of it).
Time to start planning our new recovery strategy for the next time. With computers, there's always a next time