RobinBot robinbot : state machine based micro web crawling engine with nodejs environment install the required modules with npm. $ npm install runs sample $ node main.js