/api/queues/
Returns a list of queues.
/api/queue/bbc.co.uk
Return an individual queue.
/api/sites
Returns a list of sites.
/api/crawl?url=http%3A%2F%2Fbbc.co.uk%2F
Crawls a given URL, will then recursively crawl each found link until the queue list is exhausted.
/api/search?q=news
Searches the datastore for any pages with an index matching the keywords.