Skip to content

xdk78/grabbi

Repository files navigation

grabbi Build Status

 simple web scraper/crawler

grabbi using JSDOM and axios under hood provide simple but powerful way for scraping websites.

Install grabbi

npm i grabbi

Usage

const grabbi = require('grabbi')

grabbi('https://www.github.com').then(({ doc, res }) => {
  console.log(doc.title)
  console.log(doc.getElementsByClassName('alt-lead mb-4')[0].textContent)
}).catch(err => console.log(err))

Custom config

const grabbi = require('grabbi')

// you can use https://github.com/axios/axios#axios-api as config
const config = {
  method: 'get',
  timeout: 10000,
  headers: { 'X-Custom-Header': 'foobar' }
}

grabbi('https://en.wikipedia.org/wiki/Main_Page', config).then(({ doc, res }) => {
  console.log(doc.title)
  console.log(doc.querySelector('div[id="articlecount"]').textContent)
}).catch(err => console.log(err))

About

grabbi a simple web scraper/crawler

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published