automopy Project

Overview

The automopy project is an automation tool designed to download files from specific websites using Celery for task orchestration. This project leverages Python's capabilities for web scraping and asynchronous task management.

Project Structure

automopy
├── src
│   └── automopy
│       ├── __init__.py
│       ├── celery_app.py
│       ├── tasks.py
│       ├── downloader.py
│       ├── config.py
│       └── utils.py
├── tests
│   ├── __init__.py
│   └── test_tasks.py
├── requirements.txt
├── pyproject.toml
├── setup.cfg
├── docker-compose.yml
├── Dockerfile
├── .env
├── .gitignore
└── README.md

Installation

1. Clone the repository:

   git clone <repository-url>
   cd automopy
   

2. Install the required dependencies:

   pip install -r requirements.txt
   

3. Set up environment variables in the .env file as needed.

Usage

To start the Celery worker, run:

celery -A src.automopy.celery_app worker --loglevel=info

To execute the download task, you can call the task defined in tasks.py from a Python shell or another script.

Testing

Run the tests using:

pytest tests/

Contributing

Contributions are welcome! Please submit a pull request or open an issue for any enhancements or bug fixes.

License

This project is licensed under the MIT License. See the LICENSE file for details.