Skip to content
No description or website provided.
TypeScript
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
src
.gitignore
LICENSE.md
README.md
package-lock.json
package.json
test.csv
tsconfig.json
tslint.json

README.md

About

This project extracts Fortune - 1000 companies data from a hidden url of the Fortune website.

Usage

import { Crawler } from "companies-list";
async function start() {
    const crawler = new Crawler(2019, "./srinivas.csv");
    await crawler.generateCSVFile();
}
start();

TODO

  1. Implement for any year. Does API support this? And year should be configureable too.
  2. Option to implement proxy server(s)
  3. csv fields generated should be configurable?
  4. Implement persistance to crawl where it left off?
  5. Dockerize this application

License

MIT

You can’t perform that action at this time.