Crawled Data - https://drive.google.com/drive/folders/1RXtagArfV1uIKl7C-WqpscmX4jXI1YMi?usp=sharing
Setting up Reddit Scraper: https://www.youtube.com/watch?v=nssOuD9EcVk
-
Install Python
Download and install Python
-
Install necessary Python packages: PRAW and TQDM
pip install praw tqdm
- Open your terminal and navigate to your project directory:
cd path/to/your/project - Setup and activate virtual environment
python -m venv env
- Windows
Linux/macOS
env\Scripts\activate
source env/bin/activate - Run the script
python scraper.py
-
Follow the prompts to enter the number of subreddits to scrape
-
Enter subreddits to scrape
-
Enter Number of Posts to Scrape for each subreddit
-
When done using scraper deactivate the virtual environment using command:
deactivate