Crawler : search API

You can crawl multiple social networks stream for a specific keyword.

/api/search/:query?params

query :

Your query can be a word or a group of words

example :

example : /api/search/sharism?sns=tw,fb&out=json&depth=2&entities=

parameters :

• "sns" : select web services you want to crawl using :

  • tw = twitter
  • fb = facebook
  • wb = weibo (not implemented yet)
  • wp = wordpress
  • yt = youtube

• "out" : json, xml... (not implemented yet)

• depth : depth of the crawler (not implemented yet)

  • 0 = should not follow
  • 1 = should follow all links, index, then stop
  • 2 = should follow all links, scan target, then follow all links on target, then stop

• entities : entities that should be stored by crawler

  • links
  • hashtags
  • users
  • pictures
  • videos
  • location

output :