Web Crawler Using NodeJS

By sending HTTP request to a particular URL and then by extracting HTML of that web page for getting useful information is known as crawling or web scraping.

Installation

npm init

npm install request

npm install cheerio

npm install fs

npm install nodemon

We will hit the URL from where we want to crawl data:

const URL = "https://www.flipkart.com/search?q=mobiles"

data.txt

Run the server

npm start