Skip to content

Releases: DiverseBloom780/Comic-Scraper-for-GetComics

V3.0

Choose a tag to compare

@DiverseBloom780 DiverseBloom780 released this 13 Mar 06:00
8eab90c

🔧 New Features:
✅ Finds the total number of pages for each category dynamically.
✅ Scrapes DC, Marvel, Indie Week+, and Other Comics.
✅ Avoids duplicates and non-comic links.
✅ Automatically stops scraping when there are no more comics.
✅ Creates separate folders for each category.
Updated the script to include searches for all the specified tags.
Updated the script to dynamically determine the total number of pages for each category and added support for scraping all the specified categories, including Zenescope.

Python Scraper Script V4.0 Overhaul and Rework

Choose a tag to compare

@DiverseBloom780 DiverseBloom780 released this 13 Mar 07:44
8eab90c

✅ Multithreading for faster downloads
✅ Better error handling & logging
✅ Tracking of already downloaded comics
✅ Proxy support to avoid bans
✅ User-agent spoofing & delays
✅ Metadata extraction (title, cover image, description, etc.)
✅ CLI menu for user customization
✅ Download compression & auto-organization
✅ Main categories (DC, Marvel, Indie, Other Comics) are scraped first.
✅ Uses threading to speed up scraping and downloading.
✅ Automatically detects the total number of pages for each category/tag.
✅ Retries failed requests and avoids duplicate downloads.
🔧 What’s Changed?
✅ Ensures pagination is respected for full scraping
✅ Supports .cbz and .cbr downloads.
Ignores files like #comments.cbz that were mistakenly getting picked up.
Improved error handling for failed requests.
Shows download progress in MB.
Ensures files are properly named and saved.
Reduces unnecessary requests.
Uses set() to avoid duplicate links.
Uses chunked downloads to prevent memory overload.
Multi-threaded downloads – It downloads multiple comics at the same time.
Resumes interrupted downloads – Avoids re-downloading existing files.
Automatically finds the number of pages – No need to set num_pages manually.
Progress bar with tqdm – Displays live progress for each download.
Expanded category scraping – Scrapes comics from DC, Marvel, Indie, and Other categories.
Complete Overhaul of script
The script first scrapes the most important categories then tags.
I've implemented all the improvements, including multithreading, error handling, user-agent spoofing, category expansion, and tracking of downloaded comics.

V2.0

Choose a tag to compare

@DiverseBloom780 DiverseBloom780 released this 13 Mar 05:29
dbb878c

I've added a progress indicator that shows the downloaded size in MB and the percentage completed. It also ensures that files containing #comment in their names are skipped

Python Scraper Script v5.0

Choose a tag to compare

@DiverseBloom780 DiverseBloom780 released this 13 Mar 18:33
e5f1af0

Now detects total pages correctly (fixes getting stuck at 1 page).
Downloads comics properly by ensuring direct download links are fetched.
Optimized scanning of already downloaded comics to avoid slowdowns.
Comics are now downloading properly! 🎉
Progress bar shows active downloads with speed and size.
Total pages detection is fixed.
Now scans Books and Downloads folders across all drives for already downloaded comics.
Improved efficiency by only checking relevant folders, reducing unnecessary scans.
Ensures fast and accurate detection before starting downloads.📌 Bug Fixes & Improvements
Fixed Pagination Detection:
Correctly fetches the maximum number of pages for each category and home page instead of stopping early.
🔍 Enhanced Download Link Detection
Expanded Link Search:
If no direct download link is found, the script now searches for:
✅ MegaDrive Links
✅ WeTransfer Links
✅ Mirror Download Links
✅ Main Server Links
🛠 Other Improvements
More Reliable Total Page Detection:
Adjusted the way the script extracts the last page number for better accuracy.
Skips Already Downloaded Comics Efficiently:
Ensures comics already present in Books and Downloads folders (across all drives) are skipped.
Better Error Handling:
Handles timeouts and errors when fetching pages, ensuring the script doesn’t get stuck.
Improved Logging:
Provides clearer console output when processing each comic.
i have created a additional script to remove corrupted comics and it requires no user input

V1.0

Choose a tag to compare

@DiverseBloom780 DiverseBloom780 released this 13 Mar 05:10
03bfdf2

✅ Scrape the comic links.
✅ Download the actual comic files (ZIP, CBZ, etc.).
✅ Save them to your Downloads folder on your desktop.
✅ Scrape comic pages from GetComics.
✅ Find the direct download link (Mediafire, Mega, Zippyshare, etc.).
✅ Download the comic file and save it to your Downloads folder on your Desktop.