Comments on ionous: Memcached Lockless Queue

i should say that instead of a straight queue, we ...

2009-12-15T15:01:12.551-08:00

i should say that instead of a straight queue, we used a circular buffer to ensure things were kept in check. IOW, we use

addmsg( queueName, newmsg ):
msgtowrite= incr("queuehead" + queueName ) % BUFFER_SLOTS;
add( msgtowrite, newmsg );

wow. read my mind. i'm building a scalable cha...

2009-12-15T14:57:10.717-08:00

wow. read my mind. i'm building a scalable chat server exactly on this technique.
to control memory consumption, i bunch related messages (e.g. a login event can generate user-entered, user-details, and user-status messages) and compress using compact binary compression. There's a sweeper process that periodically does a db write-behind for chatrooms that need journals, but this is

Twitter recently ported Starling to java/scala, th...

2009-03-20T01:30:00.000-07:00

Twitter recently ported Starling to java/scala, this project is called kestrel and they have it in production already.

http://robey.lag.net/2008/11/27/scarling-to-kestrel.html

http://github.com/robey/kestrel/tree/master

Regards,
Leen Toelen

will do; thanks for the tip!

2009-03-01T10:34:00.000-08:00

will do; thanks for the tip!

Check out Starling - lightweight, ruby-based, tran...

2009-01-22T12:47:00.000-08:00

Check out Starling - lightweight, ruby-based, transactional, and uses the memcached API to get/put messages.

cleaned up some spelling errors this morning; also...

2009-01-05T10:43:00.000-08:00

cleaned up some spelling errors this morning; also noticed ollie points out in response to a lockless comment, that -- as with everything -- mileage may vary based on your specific needs.