Skip to content

kevsaj/selenium_fun

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🕵️‍♂️ Selenium Scraper App

This project is a web scraping application built using Selenium. It automates the process of searching for items on a specified website, scrolling through lazy-loaded content, and extracting relevant data such as card name, price, category, rarity, and ID number.


📂 Project Structure

selenium-scraper-app
├── src
│   ├── main.py          # Entry point of the application
│   ├── scraper          # Module for scraping logic
│   │   ├── __init__.py  # Initialization file for the scraper module
│   │   └── scraper.py   # Contains the Scraper class with scraping methods
│   ├── utils            # Module for utility functions
│   │   ├── __init__.py  # Initialization file for the utils module
│   │   └── helpers.py   # Contains helper functions for the scraper
├── requirements.txt      # Lists project dependencies
├── .env                  # Contains environment variables
└── README.md             # Documentation for the project

⚙️ Setup Instructions

  1. Clone the repository:

    git clone https://github.com/yourusername/selenium-scraper-app.git
    cd selenium-scraper-app
  2. Install the required dependencies:

    pip install -r requirements.txt
  3. Configure environment variables:

    • Update the .env file with any required environment variables.

🚀 Usage

To run the application, execute the following command:

python src/main.py

✨ Features

  • 🔍 Automated Searching: Searches for items on a specified website.
  • 📜 Lazy Loading Support: Scrolls through lazy-loaded content to ensure all items are loaded.
  • 📊 Data Extraction: Extracts detailed information about each item, including:
    • 🃏 Card Name
    • 💲 Price
    • 📂 Category
    • Rarity
    • 🆔 ID Number

📜 License

This project is licensed under the MIT License.


📧 Contact

For questions or support, please contact kisstudios98@gmail.com.


© 2025 Kisstudios Production

About

web scraping application built using Selenium

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages