brad's life [entries|archive|friends|userinfo]
Brad Fitzpatrick

[ website | bradfitz.com ]
[ userinfo | livejournal userinfo ]
[ archive | journal archive ]

Hacking Update [Aug. 2nd, 2007|03:04 pm]
[Tags|, , ]

MogileFS, Brackup, DJabberd, and Gearman have all been getting more popular lately. And memcached, of course, but I'm used to that.

memcached: hackathon at Facebook yielded great spec for new binary protocol. everybody's wanted it forever, but getting all the right players in the same room got things decided on quite nicely.

Brackup: great contributions from Alessandro Ranellucci recently (chunk garbage collection, age-based pruning, etc...) couple new releases in recent days. new mailing list.

DJabberd: bunch of people have realized that DJabberd was designed to be extensible and are now writing plugins. yay!

Gearman: Ruby and Python support, and updated website. and now DBD::Gofer has a Gearman transport. very cool!

TheSchwartz: working on a standalone server (with RPC being the Gearman protocol), so it can be used by Python and Ruby folk with a minimal TheSchwartz wrapper in Python/Ruby around the Python/Ruby gearman libraries.

And a bunch more work (code, presentations, meetings) about work on portable social networks. Looks like it's coming together, from a lot of different angles/parties. Should be an interesting upcoming year.
Link9 comments|Leave a comment

New Software Releases [Apr. 16th, 2007|03:39 pm]
[Tags|, , ]

New software released today, courtesy of ShipIt...

Net-OpenID-Server
http://danga.com/dist/openid/Net-OpenID-Server-0.11.tar.gz
Net-OpenID-Consumer
http://danga.com/dist/openid/Net-OpenID-Consumer-0.13.tar.gz
Danga-Socket
http://danga.com/dist/Danga-Socket/Danga-Socket-1.57.tar.gz
gearmand
http://search.cpan.org/CPAN/authors/id/B/BR/BRADFITZ/gearmand-1.05.tar.gz
Gearman client
http://search.cpan.org/CPAN/authors/id/B/BR/BRADFITZ/Gearman-1.04.tar.gz
Gearman::Client::Async
http://search.cpan.org/CPAN/authors/id/B/BR/BRADFITZ/Gearman-Client-Async-0.92.tar.gz
Perlbal
http://danga.com/dist/Perlbal/Perlbal-1.56.tar.gz

All had new stuff in subversion but were unreleased, due to my laziness.

And of course, new ShipIt itself... ShipIt 0.44 (no URL yet, not showing on CPAN). But it has AutoConf support and can now release memcached (but waiting for some stuff before I do).
LinkLeave a comment

Hacking Update [Sep. 10th, 2006|06:14 pm]
[Tags|, ]

Another hacking status update, following the one I did in June. Feel free to comment here with anything you'd like to see me fix/add in any of these (or other) projects.

mogilefs [svn]
Hacking level: Med Needs release: Med
Major refactoring and surge of new development in Jun 2006 for speed/robustness/readability. No protocol level changes. Works with any DAV server for storage nodes now too.

Todo:

  • make mogstored have a apache/lighttpd assist mode, where they do HTTP, but mogstored still does per-node monitoring and usage file writing.
memcached [svn]
Hacking level: Low Needs release: No
Two major releases happened on 2006-09-09. See this post.

Todo:

  • vbuckets
  • win32 merge (easy)
  • merge 3 authors/contributors files
perlbal [svn]
Hacking level: Low Needs release: No
Nothing major to do. Pretty much just works. Only adding new features/optimizations/tricks as needed.

Todo:

  • add splice syscall support
  • low-priority queue & async plugin support
  • ongoing performance work
  • use new Danga::Socket::SSL to give it non-blocking SSL support
  • gzip content support (parallel .gz files). partially done.
djabberd [svn]
Hacking level: None Needs release: High
Pretty much just works, so development has stopped. Needs a release and publicity, opening the floodgates to plugin hacking.

Todo:

  • write an example clustering plugin (Spread?)
  • rearrange repo to separate core vs. modules. complicated by dependencies with test suite. null (memory-storage-only) plugins in core for testing?
brackup [svn]
Hacking level: None Needs release: Low
Never started using it myself. It has a great test suite that includes backing up and restoring, both encrypted and not, but I never implemented the hooks for restoring in the Amazon plugin. I feel guilty about not using it, finishing any usage quirks I find, and releasing it. I'd love somebody to take this over for me if you're excited about it.

Todo:

  • start using
  • amazon s3 restore support
gearman [svn]
Hacking level: None Needs release: No
Using it in production, but lacks a website/docs/etc.

Todo:

  • website/docs
openid [svn]
Hacking level: None Needs release: No
David Recordon at Versign, the JanRain crew, and other members of the identity community are largely steering this boat now.

Todo:

  • catch up on latest changes
  • write a credential/token passing extension ("Authorize $FOO to post to your LJ as you?")
Link17 comments|Leave a comment

hacking status [Jun. 24th, 2006|02:59 pm]
[Tags|, ]

I wrote a script to autogenerate this post, which I now plan to post somewhat regularly. It mostly helps me sort out my thoughts/priorities, but I'm sure providing more visibility into my status publicly can't hurt either. Consider any of these posts open invitations to bug me about the status of any project, listed or not, and I'll reply and update my notes.

Big post below... )

Link9 comments|Leave a comment

navigation
[ viewing | most recent entries ]