Log in

No account? Create an account
brad's life [entries|archive|friends|userinfo]
Brad Fitzpatrick

[ website | bradfitz.com ]
[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

LJ move, construction, ... [Nov. 19th, 2005|02:00 pm]
Brad Fitzpatrick
Came to the office to work with lisa and xb95 on the rest of the datacenter move clean-up tasks. Unfortunately the construction noises I thought I was leaving at my house didn't go away.... people are doing construction here at the office, doing what I don't know. Climbing around the rafters cutting things and drilling and banging on shit.

So as for the move:

It went damn near flawless, short of one minor but annoying oversight/accident/fuck-up, depending on how you want to label it. More could've been automated/prepared in the process to, so the whole thing involved less typing/checking, but it was overall really nice. I just wish it could've been perfect. More later. Outside our control, too, half of the new network wasn't quite up to snuff, so a lot of waiting for that to come up nicely was involved. And in the end we're now hearing it was duplex issues? How many times have I seen that problem, and people/machines just can't figure it out? Embarassing. In any case, they routed around the broken half to fix that.

Now a couple of hours of misc tasks I'm sure.....

[User Picture]From: substitute
2005-11-19 10:31 pm (UTC)

Moving the building three inches to the left

I've done datacenter moves of big sites and even with the best planning and the best people, usually at least one horrible, horrible thing happens. You guys had a really smooth one at least from the user perspective. I salute you. I also want your luck, damnit. :)
(Reply) (Thread)
[User Picture]From: krellis
2005-11-20 12:49 am (UTC)

Re: Moving the building three inches to the left

A big fat "hell yeah" on that - last time we had a major move (and we're on a much smaller scale than LJ), we had power supplies dying, drives failing left and right, and at least an hour more user-facing downtime than we had planned, with many more hours of instability after it. It doesn't seem like there's been nearly that much problem with this move, though I'm sure it always seems different from inside the trenches.
(Reply) (Parent) (Thread)
[User Picture]From: bsdguru
2005-11-20 07:34 am (UTC)

Re: Moving the building three inches to the left

I think only my move from CyberSmart to UUnet's Data Centre worked like clockwork and that had about three months of preparation work into it from writing scripts to having a box configured a week prior to the move in the cabinet with an instance of the nameserver cluster running on it, exim for accepting and queueing mail, etc. to having another box hosted offsite from UUnet hosting mail and websites during the migration and backup nameservices.
(Reply) (Parent) (Thread)
[User Picture]From: dorkmatt
2005-11-19 10:54 pm (UTC)


Not a duplex issue, a switch being cranky @ L3, not L1/L2.
(Reply) (Thread)
[User Picture]From: brad
2005-11-19 11:21 pm (UTC)

Re: network

define cranky
(Reply) (Parent) (Thread)
[User Picture]From: bsdguru
2005-11-20 07:15 am (UTC)

Re: network

Reminds me of UUnet South Africa's one switch in their co-location. Getting it to auto-detect if you want 10/100 half/full duplex was not working correctly (i.e. their switch port which your ethernet cable runs to your firewall does not come up automatically, unless they hardcode the speed and the duplex on their switch configuration, and you just force it on yourside) things then only seem to work.
(Reply) (Parent) (Thread)
[User Picture]From: scosol
2005-11-20 01:47 am (UTC)
i'm perpetually amazed how nic duplex/speed autosensing seems to be a non-standard-
every once in a while i get some nic/switch conbination that just gets confused.
(Reply) (Thread)
From: jamesd
2005-11-20 02:14 am (UTC)
Nicely done.
(Reply) (Thread)
[User Picture]From: dormando
2005-11-20 07:29 am (UTC)
Congrats! Very smoothly done.

Wanna help out with my huge datacenter move in three weeks? ;)
(Reply) (Thread)