Welcom to Devoura! 👋

About

Devoura is a web scraper server that allows users to extract data from websites and receive the results in a structured format such as CSV or JSON. Provides a web interface and API for users to easily scrape data from any webpage with a simple HTTP request.Built with Node.js, Express, Cheerio and TypeScript fast and reliable data extraction from mostly food based ecommerce websites.

Demo

Demo Link

Run Locally

Clone the project

  git clone https://github.com/chinmayakain/devoura.git

Go to the project directory

  cd devoura

Install dependencies

  npm install

Start the server

  npm run start

Authors

• @chinmayanaik

API Reference

Health Check

  GET /healthCheck/

List all items

  GET /api/listData/

Scrape pages

  GET /api/scrapeData/

Parameter	Type	Description
url	string	Required url of page to be scraped
baseUrl	string	(optional) base url of page to be scraped

Environment Variables

To run this project, you will need to add the following environment variables to your .env file

PORT

MONGO_DB_URI

Features or Limitations

• Currenlty limited to a certain website for data scraping.

Deployment

Deployed on Railway