Releases: Chisanan232/smoothcrawler
Releases 路 Chisanan232/smoothcrawler
v0.2.0 - 馃帀馃帄馃嵕 Release version 0.2.0 package & documentation
馃帀馃帄馃嵕 New Feature
- Release latest version of documentation.
- Update README.
- Update package to version 0.2.0.
馃敡馃敥鈿欙笍 Refactor
- Remove sub-package .persistence.
- Add new sub-package .components.persistence.
鈿掆殥馃挘 Bug Fix
- Fix the issue about GitHub Action configuration.
- Fix the issue about incorrect image path in README.
- Fix the issue about incorrect implementations in test and example.
Full Changelog: v0.1.0...v0.2.0
v0.1.0 - First Draft of Crawler Framework for Python
First draft
-
Components:
Different components response of different things.
1-1. HTTP request sender
1-2. HTTP response parser
1-3. Data processing handler
1-4. Persistence layer -
Crawler roles:
Different crawler role works in different way.
2-1. SimpleCrawler
2-2. AsyncSimpleCrawler
2-3. ExecutorCrawler
2-4. PoolCrawler