Skip to content

biga816/chainlink-scraping-adapter

Repository files navigation

Chainlink Web Scraping External Adapter

This repository is a Chainlink external adapter to get data by web scraping.

Input Params

Key Description Value Example
id Required jobRunID back to the chainlink node 1
url Required Specific website URL to scrape. http://abehiroshi.la.coocan.jp/movie/eiga.htm
path Required Specific DOM tree to specify data. html.body.center.1.table
index Required Specific index number of scraped data. 0
filter Optional Specific DOM tree to filter data. tr.td.strong.a

Output Format

{
  "jobRunID": "1",
  "data": "HOKUSAI"
}

Installation

$ nvm use
$ npm install

Running the app

# development
$ npm run start

# watch mode
$ npm run start:dev

# production mode
$ npm run start:prod

Test

# unit tests
$ npm run test

# e2e tests
$ npm run test:e2e

# test coverage
$ npm run test:cov

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published