Skip to content

Download Tools for ComfyUI v0.8.2 - Initial Public Release

Latest

Choose a tag to compare

@EricRollei EricRollei released this 20 Nov 07:42
· 16 commits to main since this release

Download Tools for ComfyUI v0.8.2 - Initial Public Release

🎉 Welcome to Download Tools!

Download Tools for ComfyUI is a comprehensive media downloading and web scraping solution that brings the power of gallery-dl, yt-dlp, and advanced web scraping directly into your ComfyUI workflows.

Whether you're downloading training datasets, collecting reference images, or building media archives, Download Tools makes it effortless to acquire content from 1000+ websites.


🚀 What's New in v0.8.2

This is our initial public release, featuring three powerful nodes and extensive documentation to get you started.

Core Features

📸 Gallery-dl Downloader Node

Download images and videos from 100+ popular websites with enterprise-grade reliability:

Supported Platforms:

  • Social Media: Instagram, Reddit, Twitter/X, Tumblr, Pinterest
  • Art Platforms: DeviantArt, Pixiv, ArtStation, Behance, 500px
  • Photo Sites: Flickr, Unsplash, Imgur
  • And 90+ more sites - see gallery-dl supported sites

Key Features:

  • ✅ Browser cookie authentication for private content
  • ✅ Automatic file organization by category/user/date
  • ✅ Download archive system prevents duplicates
  • ✅ Metadata extraction (titles, descriptions, tags)
  • ✅ Custom configuration support
  • ✅ Batch processing support

🎬 Yt-dlp Downloader Node

Download videos and audio from 1000+ platforms including all major streaming services:

Supported Platforms:

  • Video: YouTube, TikTok, Vimeo, Twitch, DailyMotion
  • Social: Facebook, Instagram, Twitter, LinkedIn
  • Media: SoundCloud, Bandcamp, Spotify (with premium)
  • And 1000+ more platforms - see yt-dlp supported sites

Key Features:

  • ✅ Multiple quality presets (4K, 1080p, 720p, audio-only)
  • ✅ Audio extraction and conversion (MP3, M4A, WAV, FLAC)
  • ✅ Playlist and channel downloads
  • ✅ Subtitle extraction
  • ✅ Custom format selection
  • ✅ Age-restricted content support

🕷️ Web Image Scraper v0.82

Advanced web scraping with 15 specialized site-specific handlers for optimal extraction:

Specialized Handlers:

  • Instagram - Optimized profile scraping with high discovery rates
  • Bluesky - Complete media extraction from profiles and posts
  • ArtStation - Project and portfolio downloads
  • Behance - Creative work collection
  • DeviantArt - Gallery scraping
  • Flickr, 500px - Photography platforms
  • Artsy, Cosmos, Google Arts - Art galleries and museums
  • Kavyar, Unsplash - Professional photography
  • Pinterest, Reddit, Tumblr - Social curation
  • WordPress - Blog and portfolio sites
  • YouTube - Video metadata and thumbnails
  • Generic Handler - Works with any website

Advanced Features:

  • ✅ Playwright browser automation for JavaScript-heavy sites
  • ✅ Scrapling integration for efficient HTML parsing
  • ✅ Authentication via cookies or login credentials
  • ✅ Profile/session management with persistent logins
  • ✅ Progress tracking and resume capability
  • ✅ Image filtering by dimensions (min/max width/height)
  • ✅ Metadata collection and export
  • ✅ Debug mode for troubleshooting
  • ✅ Stealth mode to avoid detection

🤖 MCP Integration

Model Context Protocol server for seamless Claude Desktop integration:

  • ✅ Use Download Tools directly from Claude Desktop
  • ✅ AI-assisted media downloading workflows
  • ✅ Structured prompts and responses
  • ✅ External tool integration

📦 Installation

Option 1: ComfyUI Manager (Recommended)

  1. Open ComfyUI Manager in your ComfyUI interface
  2. Click Install Custom Nodes
  3. Search for "Download Tools"
  4. Click Install
  5. Restart ComfyUI

Option 2: Manual Installation

Windows:

cd ComfyUI\custom_nodes
git clone https://github.com/EricRollei/Download_Tools.git
cd Download_Tools
..\..\..\python_embeded\python.exe -m pip install -r requirements.txt

Linux/Mac:

cd ComfyUI/custom_nodes
git clone https://github.com/EricRollei/Download_Tools.git
cd Download_Tools
pip install -r requirements.txt

Optional: FFmpeg Installation

For audio extraction and advanced video processing:

  • Windows: choco install ffmpeg or download from ffmpeg.org
  • macOS: brew install ffmpeg
  • Linux: apt-get install ffmpeg or yum install ffmpeg

🎯 Quick Start Examples

Example 1: Download Instagram Profile

1. Add "Gallery-dl Downloader" node to workflow
2. URL: https://www.instagram.com/nasa/
3. Enable "use_browser_cookies" (for private profiles)
4. Enable "organize_files" 
5. Enable "use_download_archive"
6. Execute!

Example 2: Download YouTube Video

1. Add "Yt-dlp Downloader" node
2. URL: https://www.youtube.com/watch?v=VIDEO_ID
3. Format: "best" or "audio-only"
4. Execute!

Example 3: Scrape ArtStation Portfolio

1. Add "Web Image Scraper" node
2. URL: https://www.artstation.com/artist
3. Min Width: 1920, Min Height: 1080
4. Max Files: 100
5. Execute!

📚 Comprehensive Documentation

We've included extensive documentation to help you get the most out of Download Tools:

Core Guides

Setup & Configuration

Platform-Specific Guides


🔐 Authentication & Privacy

Browser Cookie Authentication (Easiest)

Download Tools can automatically use your browser's login sessions:

  1. Log into the website in your browser (Chrome, Firefox, Edge, etc.)
  2. Enable use_browser_cookies in the node
  3. Select your browser from the dropdown
  4. Done! The node will access content as if you're logged in

Supported Browsers: Chrome, Firefox, Edge, Safari, Opera, Brave, Vivaldi

Manual Cookie Export

For more control or if automatic extraction fails:

  1. Install browser extension: "Get cookies.txt LOCALLY"
  2. Log into the website
  3. Export cookies to file
  4. Save to configs/SITENAME_cookies.json
  5. Reference in node's cookie_file parameter

Direct Login (Site Handlers)

Some site handlers support direct username/password login:

{
  "site.com": {
    "auth_type": "login",
    "username": "your_username",
    "password": "your_password"
  }
}

Note: Your credentials are stored locally and never transmitted except to the target website.


⚙️ System Requirements

Minimum:

  • Python 3.10 or higher
  • ComfyUI (any recent version)
  • 4GB RAM
  • 1GB disk space

Recommended:

  • Python 3.11+
  • 8GB+ RAM
  • 5GB+ disk space (for downloads)
  • FFmpeg installed (for audio extraction)

Supported Operating Systems:

  • ✅ Windows 10/11
  • ✅ macOS 10.15+
  • ✅ Linux (Ubuntu 20.04+, Debian, Fedora, Arch)

🎨 Use Cases

AI Training Dataset Collection

  • Collect thousands of images for Stable Diffusion training
  • Filter by resolution and aspect ratio
  • Automatic deduplication
  • Metadata preservation for captioning

Reference Library Building

  • Build personal art reference libraries
  • Organize by artist, style, or theme
  • Archive social media content before it's deleted
  • Backup your own content from multiple platforms

Content Archival

  • Archive entire YouTube channels or playlists
  • Save Instagram profiles before accounts are deleted
  • Preserve Twitter threads with media
  • Download portfolio sites for offline viewing

Research & Analysis

  • Collect data for academic research
  • Media monitoring and archival
  • Cultural preservation
  • Digital archaeology

🛠️ Troubleshooting

"Gallery-dl/Yt-dlp not found"

These are Python packages, not executables. They're auto-installed with requirements.txt. If you see this error, reinstall dependencies:

pip install -r requirements.txt

"Browser cookies not accessible"

Solutions:

  1. Run ComfyUI as administrator (Windows)
  2. Try a different browser (Firefox often works best)
  3. Use manual cookie export method
  4. Check browser is fully closed before extraction

"Instagram/Reddit downloads fail"

Authentication required for most content:

  • Enable use_browser_cookies and log in via browser
  • Or export cookies manually from logged-in session
  • Check that cookies haven't expired (log in again if needed)

"FFmpeg not found" (for audio extraction)

FFmpeg must be installed separately:

  • Install using package manager or from ffmpeg.org
  • Ensure it's in your system PATH
  • Restart ComfyUI after installation

"CUDA out of memory" errors

This is a ComfyUI issue, not related to Download Tools. These nodes don't use GPU.


📄 License

Download Tools for ComfyUI is available under a dual license:

Non-Commercial Use

For personal projects, research, education, and non-commercial use:

Commercial Use

For commercial projects, businesses, and revenue-generating activities:

Third-Party Dependencies

This software depends on several third-party tools, each with its own license:

  • gallery-dl (GNU GPL v2) by Mike Fährmann
  • yt-dlp (Unlicense/Public Domain)
  • Playwright (Apache 2.0) by Microsoft
  • Scrapling (Apache 2.0)

Important: You must comply with all third-party dependency licenses. See CREDITS.md for complete list.


🙏 Acknowledgments

Download Tools wouldn't be possible without these excellent open-source projects:

Core Tools

  • gallery-dl by Mike Fährmann - Incredible multi-site downloader supporting 100+ websites
  • yt-dlp - The best video downloader, supporting 1000+ platforms
  • Playwright by Microsoft - Powerful browser automation
  • Scrapling - Efficient web scraping library

Platform

  • ComfyUI community - For creating an amazing extensible platform

Python Ecosystem

  • Requests, urllib3, tqdm, colorama, and many others - See CREDITS.md

Special Thanks: To all the contributors and maintainers of these projects who make tools like this possible.


🤝 Contributing

We welcome contributions from the community!

Ways to Contribute

  • 🐛 Report bugs - Help us identify and fix issues
  • 💡 Suggest features - Share your ideas for improvements
  • 📖 Improve documentation - Help others get started
  • 🔧 Submit code - Fix bugs or add features
  • 🌍 Spread the word - Share with others who might benefit

Getting Started

  1. Read our Contributing Guide
  2. Check existing issues
  3. Fork the repository
  4. Create a feature branch
  5. Submit a pull request

Code of Conduct

Be respectful, inclusive, and constructive. We're all here to build great tools together.


📧 Support & Contact

Get Help

Contact Author

Commercial Inquiries

For commercial licensing, enterprise support, or custom development:


🔗 Important Links


🎯 What's Next?

This is just the beginning! We have exciting plans for future releases:

Upcoming Features (Tentative)

  • Additional site-specific handlers
  • Enhanced metadata extraction
  • Batch processing improvements
  • Advanced filtering options
  • Integration with ComfyUI workflows
  • Performance optimizations
  • More authentication methods

Want to influence the roadmap? Share your ideas in Discussions or vote on feature requests!


🎉 Ready to Get Started?

  1. Install via ComfyUI Manager or manual installation
  2. Add nodes to your ComfyUI workflow
  3. Configure authentication if needed
  4. Start downloading from 1000+ websites!

Questions? Check the documentation or open an issue.

Enjoying Download Tools? ⭐ Star the repository and share with others!


Happy Downloading! 🚀

Download Tools for ComfyUI - Bringing the web's media into your workflows