Twitter loves open source.
Twitter is built on open-source software—here are the projects we have released or contribute to. Also see our engineering blog for more details.
Want to work on stuff like this? Check out our jobs.
Ruby
A client for the Cassandra distributed database.
An interface to the Zookeeper distributed lock server.
Text processing routines for Tweets.
An interface to the libmemcached C client.
A Thrift client wrapper that encapsulates some common failover behavior.
A write-through and read-through caching library for ActiveRecord.
A client for the Kestrel message queue.
Simple, scalable UUID generation.
A client for the Scribe distributed log server.
An object mapper for Cassandra.
Scala
A reliable, uncoordinated, loosely ordered message queue.
JSON toolkit based on Martin Odersky's Programming Scala book.
An HTTP reverse caching proxy similar to Varnish.
A trie data structure implementation.
An agreeable way to talk to a JDBC database.
Ant and Ivy scripts to automate building Scala projects.
Java
A highly scalable second-generation distributed database.
Codazzo's MultiRowInputFormat, adapted for integer lists.
Text processing routines for Tweets.
contributions to hadoop
A platform for analyzing large data sets.
Splittable LZO compression for Hadoop.
contributions to pig
A platform for analyzing large data sets.
C/C++
contributions to scribe
A scalable log aggregation server.
contributions to ree
A server-oriented branch of Ruby.
An Apache module for applying IP blocklists stored in memcached.
Tools
Scalable code deployment with Bittorrent.
Textmate syntax highlighting for Pig.
A script to parse and graph the JVM's GC
trace output.
