The experimental tool for creating curated lists for domains
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
assets
cli
config
docs
locales
migrations
scripts
sqlite
src
test
views
.gitignore
.sequelizerc
LICENSE
README.md
bower.json
index.js
nodemon.json
package-lock.json
package.json
server.js
worker.js

README.md

Curlist

Experimental tool for creating curated list of domains.

Requirements

  • Node >= 8.x
  • SQLite or PostgreSQL
  • Elasticsearch
  • Redis

Getting started

git clone git@github.com:itemsapi/curlist.git
cd curlist
npm install

# configure your database, elasticsearch and "item_schema"
vim config/domains.yaml

# generate database schema
NODE_ENV=domains node_modules/.bin/sequelize db:migrate

# create index in Elasticsearch
NODE_ENV=domains node scripts/db-to-es.js
NODE_ENV=domains PORT=3000 npm start

# run worker in case you want to process data (in background)
NODE_ENV=domains nodemon worker

Current features

  • exploring data by filters and full text search
  • data history (changelog)
  • integrations with external API's
  • import / export by using CSV
  • processing data efficiently in background (jobs queue)

Integrations

License

This library is created by Mateusz Rzepa and licensed under the AGPL.