It’s a good goddamned thing I don’t have AADD, or some shit. Today was all about being sharp and getting shit done, and that was nearly impossible. Pass me the bong.
The day ended with a motorcycle accident that happened right in front of the building where I work. Apparently, Evel Knievel revved the engine just before he lost control and planted his ass on the asphalt. We all heard the bike scraping along the road before it stopped at the curb. Everyone at the office stampeded to the window to see what happened. The rider got up and was trying to get the bike off out of the road, but it fell on it’s other side, and he had to lay down on the sidewalk. In typical fashion, the city sent a fleet of emergency vehicles; an ambulance, fire department paramedics, a fire engine, the fire chief, three police cars, and a police motorcycle. You’d have thought there was some nut job holed up with automatic weaponry aimed at hostages, or some such nonsense. It’s a ridiculous waste of resources. Our tax dollars at work! Hell, at least they were preoccupied. Their normal day is probably spent writing tickets for drivers doing 4½ millimeters an hour over the speed limit. A co-worker snapped these photos: this one, this one, this one, and this one. Careful, though. These images exceed 2 MB each.
Before the excitement of emergency vehicles, we spent a busy day on the phones. On Friday, a RAID array on one of our shared hosting servers shit the bed. Two drives out of four failed. On a RAID10 this isn’t supposed to happen. As long as there’s one drive in each set of the array, the RAID should be okay. Even engineers at Seagate were stumped. Basically, the server was down, and down hard. It only took a couple hours to realize that the server would have to be rebuilt and data restored from backup. To make matters worse, the sysadmins told us that the backups on the RAID were also lost. This means that an 8-month old off-site backup would have to be restored. Any web site changes and mail accounts that customers created within the past 8 months would have to be re-created. (All the backup scare got me to set up rsnapshot to backup this domain and the others I own. Thanks Dustin!)
I feel for the sysadmins. Their whole weekend was shot working on building a new server, installing software, and restoring things as best they could. I got a call yesterday afternoon to come in and do some tier two support and help out with getting the domains current. I spent five hours at the office before heading home. Overtime, baby! I went in an hour early today to take care of the Hosting ticket queue before the fun started. By the time 8:00am rolled around, the phones just lit up. Holy fuck, the phones didn’t stop ringing for hours! I was in the support phone queue for two and a half hours before I was told to stay off the phones and help the techs with issues they bring me. I handled issues as they came, and dealt with my hosting tickets the rest of the day. I was never so happy to see 5:00pm. I had enough excitement for one day. I’ll probably be asleep before midnight. Let’s hope tomorrow is quieter.