a family of libraries and daemons for building scalable web infrastructure
C Python Shell Lua
Switch branches/tags
Nothing to show
Latest commit 980ab98 Aug 23, 2013 @jehiah jehiah Merge pull request #84 from jsocol/filtered-heartbeats_84
pubsub_filtered: pass through heartbeats
Permalink
Failed to load latest commit information.
buffered_socket
domain_socket
host_pool change (char *) to (const char *) where possible May 17, 2012
jujufly astyle Dec 6, 2011
profiler_stats cstyle repo Apr 5, 2012
ps_to_file Mac compatability in Makefiles Sep 11, 2012
ps_to_http Mac compatability in Makefiles Sep 11, 2012
pubsub
pubsub_filtered Replace commented debug statements with #ifdef Aug 23, 2013
pubsubclient cstyle repo Apr 5, 2012
pysimplehttp Compatability with recent tornado versions Sep 12, 2012
qrencode astyle Dec 6, 2011
queuereader remove broken/unused method May 17, 2012
shared_tests test_shunt: properly generate path of valgrind output May 17, 2012
simpleattributes astyle Dec 6, 2011
simplegeo
simplehttp
simpleleveldb simpleleveldb: add HUP handler to roll leveldb Aug 16, 2012
simplememdb
simplequeue simpleleveldb: new list and set endpoints, cleaned up most other endp… May 8, 2012
simpletokyo
sortdb Add memory lock flag to readme Aug 20, 2012
.gitignore Updated pysimplehttp and added BaseReader+deps Sep 10, 2012
LICENSE doc updates Jan 31, 2011
README.md update README Feb 9, 2012
conftest.py simpleleveldb: new list and set endpoints, cleaned up most other endp… May 8, 2012
setup.py Compatability with recent tornado versions Sep 12, 2012

README.md

simplehttp

simplehttp is a family of libraries and daemons built upon libevent that make high performance HTTP servers simple and straightforward to write.

The following libraries and daemons are included:

  • buffered_socket - a simple abstraction on bufferevent for arbitrary TCP sockets
  • domain_socket - an async C library for creating, listening, and communicating over unix domain sockets
  • host_pool - a library for dealing with endpoint selection, pooling, failure, recovery, and backoff
  • profiler_stats - a library to track arbitrary profiler timings for average, 95%, 99%, 100% time
  • ps_to_http - a daemon built on top of pubsubclient to write messages from a source pubsub to destination simplequeue or pubsub server
  • ps_to_file - a daemon built on top of pubsubclient to write messages from a source pubsub to time rolled output files
  • pubsub - a daemon that receives data via HTTP POST events and writes to all subscribed long-lived HTTP connections
  • pubsub_filtered - a pubsub daemon with the ability to filter/obfuscate fields of a JSON message
  • pubsubclient - a library for writing clients that read from a pubsub
  • pysimplehttp - a python library for working with pubsub and simplequeue
  • qrencode
  • queuereader - a library for writing clients that read from a simplequeue and do work
  • simpleattributes
  • simplegeo
  • simplehttp
  • simpleleveldb - a HTTP CRUD interface to leveldb
  • simplememdb - an in-memory version of simpletokyo
  • simplequeue - an in memory queue with HTTP /put and /get endpoints to push and pop data
  • simpletokyo - a HTTP CRUD interface to front tokyo cabinet's ttserver
  • sortdb - sorted database server

simplehttp Install Instructions

to install any of the simplehttp components you will need to install libevent 1.4.13+ and the 'simplehttp' module first.

build the main library this provides libsimplehttp.a simplehttp/simplehttp.h and simplehttp/queue.h

cd simplehttp
make && make install

now install whichever module you would like this will compile 'simplequeue' and place it in /usr/local/bin

cd simplequeue
make && make install

Some modules have additional dependencies:

pysimplehttp Install Instructions

pip install pysimplehttp

provides file_to_sq.py and ps_to_sq.py. It will use ujson if available.