you need to modofy the lj client progs and turn them all in to p2p-style distributed storage nodes- then you can push all the storage back where it belongs ;P

And if reliability and latency were problems now, that's a whole new world of problem.

hahah but of course :P
heh- in all seriousness, latency is a problem but (properly designed) reliability isn't
what a coup that would be hahahah

:-(

We are considering this, though, whenever we make new tables. We plan to redo all tables at some point so there's a global "revision number" for an account and given your rev number (not a date), you can replay all changes. That's a ways off, though.

How's that FB client? :-)

Sounds like your Thanksgiving weekend is more eventful than mine.

In any case, I'm exciting to see you and Whitaker making so much progress on the client.

Heh.

Neato.

Have you thought of looking at some sort of time based phased managed storage so only the most recent data is on the quick and expensive storage and the rarely accessed stuff migrates onto slower but much cheaper storage.

I've been starting to look into something like that for my employers for our Oracle databases (individually in the tens to hundreds of Gb range but collectively many Tb and growing). We're looking at the recent or frequently accessed data being on fast direct attached disk, older and less frequently accessed on NAS, older and rarely accessed on Bladestore and archival on WORM. For legislative reasons we have to keep data accessible online for upto 12 years on some systems.

I suspect that you're a ways off our volumes of data (and budget, our annual, non-staff, IT budget is about $70million) but if you can migrate the older data onto cheaper mass storage that should help some (aside from memory linked posts how often do you look back to entries over a few weeks old?).

Actually we do move inactive accounts to cheaper storage.

I bring this directly to your personal journal because I haven't found another forum that answers my question.

How might I directly invest in LJ?

Well, given that we're a private company and not taking funding, there's not really a way. *shrug*