MLE-Agent is designed as a pairing LLM agent for machine learning engineers and researchers. It is featured in three major modes:
- π Kaggle Mode will help you to easily participate in Kaggle competitions, prepare submissions and get a good score.
- β Baseline Mode can quickly build a baseline model for your AI project according to your requirements.
- π₯ Advanced Mode (Coming Soon) is designed to utilize users' favorite MLOps tools, understand SOTA methods, and suggest optimizations for users' machine learning projects.
π June 16th, 2024: Pre-release the Kaggle Mode (need to install from the source code)
π June 1st, 2024: Release the Baseline Mode (v0.1.0)
pip install mle-agent
You must set up an LLM and choose tools before using the agent.
mle config
Create a new project
mle new <project name>
A workspace with <project name>
will be created where you execute the mle new
command.
Start a project
mle start
Note
- Debugging on the cloud may incur high costs, please ensure you have enough budget.
- You can start a project under any path, the code/data generated will be stored in the target workspace.
Project-related operations
mle project ls # show all the available projects
mle project delete <project name> # delete a given project
mle project switch # switch the current working project
mle project show # show the status of the current project
The following is a list of the tasks we plan to do, welcome to propose something new!
π¨ Plan, Generate, Execute and Debug Code
- An easy-to-use CLI interface
- Create/Select/Delete a project
- Understand users' requirements to suggest the file name, dataset, task, model arch, etc
- Generate a detailed coding plan
- Write baseline model code
- Execute the code on the local machine/cloud
- Debug the code and revise the code
- Googling the error message to debug the code
- Data Augmentation
- Hyperparameter tuning
- Model evaluation
β More LLMs and Serving Tools
- Ollama LLama 2/3
- OpenAI GPT-3.5
- OpenAI GPT-4
- Codellama
- Codemitral
- Anthropic Codex
π Better user experience
- Web UI (coming soon)
- Discord
𧩠Integrations
- SkyPilot
- Snowflake
- Databricks
- Wandb
- MLflow
- DBT
- Airflow
π Search Enhancement
- GitHub
- HuggingFace
- Paper with Code
- Arxiv
We welcome contributions from the community. We are looking for contributors to help us with the following tasks:
- Benchmark and Evaluate the agent
- Add more features to the agent
- Improve the documentation
- Write tests
If you are interested in contributing, please check the CONTRIBUTING.md file.
- Discord community. If you have any questions, please feel free to ask in the Discord community.
- Twitter. Follow us on Twitter to get the latest updates.
Check LICENSE file for more information.