Skip to content

v2.0.0

Latest

Choose a tag to compare

@alash3al alash3al released this 12 Oct 22:05
  • uses simple configuration language for humans called hcl.
  • multiple types of queues/workers (lifo, fifo, weight).
  • you can define multiple workers with different type of queues.
  • abbility to override the content of the settings.py of the scrapy project from the same configuration file.
  • a status endpoint helps you to understand what is going on.
  • a enqueue endpoint lets you push a job into the specified queue, as well the abbility to execute the job instantly and returns the extracted items.