Skip to content

Releases: Chisanan232/smoothcrawler

v0.2.0 - 馃帀馃帄馃嵕 Release version 0.2.0 package & documentation

04 Jun 07:22
Compare
Choose a tag to compare

馃帀馃帄馃嵕 New Feature


  1. Release latest version of documentation.
  2. Update README.
  3. Update package to version 0.2.0.

馃敡馃敥鈿欙笍 Refactor


  1. Remove sub-package .persistence.
  2. Add new sub-package .components.persistence.

鈿掆殥馃挘 Bug Fix


  1. Fix the issue about GitHub Action configuration.
  2. Fix the issue about incorrect image path in README.
  3. Fix the issue about incorrect implementations in test and example.

Full Changelog: v0.1.0...v0.2.0

v0.1.0 - First Draft of Crawler Framework for Python

20 Jan 14:52
Compare
Choose a tag to compare

First draft


  1. Components:
    Different components response of different things.
    1-1. HTTP request sender
    1-2. HTTP response parser
    1-3. Data processing handler
    1-4. Persistence layer

  2. Crawler roles:
    Different crawler role works in different way.
    2-1. SimpleCrawler
    2-2. AsyncSimpleCrawler
    2-3. ExecutorCrawler
    2-4. PoolCrawler