ml-stack

Complete Machine Learning infrastructure stack with MLflow, Kubeflow, Jenkins, and LLM services

Overview

This repository contains infrastructure and automation scripts for setting up and managing ml-stack components.

Prerequisites

• Docker and Docker Compose
• Ubuntu/Debian Linux environment
• Appropriate API keys and tokens (see Configuration section)

Installation

# Clone the repository
git clone https://github.com/wtfisai/ml-stack.git
cd ml-stack

# Make scripts executable
chmod +x *.sh

# Follow setup instructions below

Configuration

Before running the scripts, you may need to:

1. Set up environment variables
2. Configure API keys and tokens
3. Adjust configuration files for your environment

Usage

Machine Learning Setup

# Run the setup script
./setup.sh

# Start ML services
docker-compose up -d

# Access web interfaces
# - MLflow: http://localhost:5000
# - Jupyter: http://localhost:8888
# - Other services: check docker-compose.yml

File Structure

ml-stack/
├── README.md           # This file
├── .gitignore         # Git ignore patterns
├── docker-compose.yml # Docker services (if applicable)
├── *.sh              # Setup and deployment scripts
└── configs/           # Configuration files (if applicable)

Troubleshooting

Common Issues

1. Permission Denied: Make sure scripts are executable (chmod +x *.sh)
2. Docker Issues: Ensure Docker daemon is running
3. Port Conflicts: Check if required ports are available
4. Environment Variables: Verify all required environment variables are set

Logs

• Docker services: docker-compose logs -f
• System logs: journalctl -f
• Application logs: Check individual service documentation

Contributing

1. Fork the repository
2. Create a feature branch (git checkout -b feature/amazing-feature)
3. Commit your changes (git commit -m 'Add some amazing feature')
4. Push to the branch (git push origin feature/amazing-feature)
5. Open a Pull Request

Security

• Never commit sensitive information (API keys, passwords, etc.)
• Use environment variables for configuration
• Regularly update dependencies and base images
• Follow security best practices for your deployment environment

License

This project is licensed under the MIT License - see the LICENSE file for details.

Support

For issues and questions:

• Open an issue in this repository
• Check the troubleshooting section above
• Refer to the official documentation of the underlying technologies

Related Repositories

This is part of a larger development server infrastructure. See the dev-server-index repository for the complete overview.