Skip to content

v1.0.2 - Japan Expansion & Country-Wise Restructuring

Latest

Choose a tag to compare

@Optane002 Optane002 released this 21 Dec 08:39
· 9 commits to main since this release

New Features

  • New Country Support: Added support for Japan region.
  • New Scraper: Added TokyoPC.jp scraper with automatic category discovery and pagination handling.
  • New Scraper: Added Unity Systems (Sri Lanka) support.
  • New Scraper: Added Abans IT (Sri Lanka) support with AJAX pagination handling.
  • New Scraper: Added Nanotek (Sri Lanka) support.
  • Auto-Update Checker: The tool now automatically checks for new versions on startup and notifies the user.

Bug Fixes

  • Unity Systems: Fixed a crash caused by column name mismatch ("Product Name" vs "Model").
  • Abans IT: Fixed an issue where brand names were duplicated in product titles (e.g., "HP HP 15...").
  • Pagination: Improved reliability of pagination logic across all scrapers to prevent infinite loops or missed pages.

Technical Improvements

  • Refactored Architecture: Moved scrapers into country-specific sub-packages (srilanka and japan) for better organization.
  • Modular Config: Updated csites.py

` to dynamically load scrapers from the new directory structure.

Dependency Management: Added requirements.txt for easier setup.