🔍 System Monitoring and Auto-Healing Solution

A comprehensive proactive monitoring and auto-healing system for DevOps environments, developed in Python with real-time web interface.

✨ Features

🎯 Real-time Monitoring

• 📊 System Metrics: CPU, memory, disk, network
• 🔧 Services: Systemd service status (nginx, mysql, ssh, etc.)
• ⏱️ Configurable Interval: From 10 seconds to several minutes

🚨 Intelligent Alert System

• 📈 Customizable Thresholds: Flexible alert threshold configuration
• 📧 Email Notifications: HTML formatted alerts with built-in anti-spam
• ⚠️ Severity Levels: Warning and Critical

🔧 Automatic Auto-Healing

• 🔄 Service Restart: Automatic restart of stopped services
• 🧹 Intelligent Cleanup: Temporary files and cache management
• 💾 Memory Optimization: Termination of memory-hungry processes

📊 Interactive Dashboard

• 🌐 Web Interface: Dashboard accessible at http://localhost:8050
• 📈 Real-time Charts: Interactive visualizations with Plotly
• 🔄 Auto Refresh: Updates every 5 seconds

🚀 Quick Start

Prerequisites

• Python 3.8 or higher
• Administrator access (for service monitoring)
• Port 8050 available

Automatic Installation

🐧 Linux / macOS

chmod +x start.sh
./start.sh

🪟 Windows

.\start.ps1

Manual Installation

# Create virtual environment
python -m venv venv

# Activation (Linux/macOS)
source venv/bin/activate

# Activation (Windows)
venv\Scripts\activate

# Install dependencies
pip install -r requirements.txt

# Create directories
mkdir -p logs

Configuration

Create a .env file:

# Monitoring
MONITORING_INTERVAL=10
CPU_THRESHOLD=80.0
MEMORY_THRESHOLD=85.0
DISK_THRESHOLD=90.0

# Services to monitor
MONITORED_SERVICES=cron,dbus,apache2,nginx,mysql

# Auto-healing
AUTO_HEALING_ENABLED=True

# Email (optional)
EMAIL_ALERTS_ENABLED=True
EMAIL_SMTP_SERVER=smtp.gmail.com
EMAIL_SENDER=your@email.com
EMAIL_SENDER_PASSWORD=your_app_password
EMAIL_RECIPIENTS=alert@company.com

🎯 Usage

Complete Launch

python main.py

The system starts and the dashboard is accessible at: http://localhost:8050

Individual Modules

Monitoring Only

python monitoring/monitor.py

Dashboard Only

python visualization/dashboard.py

📁 Project Structure

monitoring-system/
├── 📊 main.py                    # Main entry point
├── 📋 requirements.txt          # Python dependencies
├── 🔐 .env                      # Configuration
├── 🚀 start.ps1                 # Windows installation
├── 🐧 start.sh                  # Linux installation
│
├── 📁 monitoring/               # Monitoring modules
│   ├── 🖥️ system_monitor.py    # System metrics
│   ├── 🔌 service_monitor.py   # Service monitoring
│   ├── 🚨 alert_manager.py     # Alert management
│   └── 🔧 monitor.py           # Main orchestrator
│
├── 📁 visualization/            # Interface
│   └── 📈 dashboard.py         # Web dashboard
│
├── 📁 config/                   # Configuration
│   └── ⚙️ settings.py          # Application parameters
│
├── 📁 autohealing/              # Auto-healing
│   ├── 🔧 service_healer.py    # Service repair
│   ├── 🛠️ system_healer.py    # System repair
│   ├── 📝 action_logger.py    # Action logging
│   └── ⚡ triggers.py          # Triggers
│
├── 📁 utils/                    # Utilities
│   ├── 📝 json_array_logger.py # JSON logger
│   └── 📧 email_sender.py     # Email sending
│
└── 📁 logs/                     # Data
    └── 📄 monitoring.json      # Structured JSON logs

🛠 Technologies Used

Language & Core

• Python 3.8+ - Main language
• Virtual Environment - Dependency isolation

Monitoring & Metrics

• psutil - System metrics (CPU, memory, disk, network)
• subprocess - Systemd service management
• platform - OS detection and hardware information

Visualization & Interface

• Dash - Web framework for analytical applications
• Plotly - Interactive real-time charts
• Pandas - Data manipulation and analysis
• Dash Bootstrap Components - Responsive UI

Data & Logging

• JSON - Structured logging format
• datetime - Timestamp management
• threading - Parallel execution

Notification & Communication

• smtplib - Email sending via SMTP/TLS
• email.mime - HTML message formatting

Configuration

• python-dotenv - Environment variables
• os - Filesystem interactions

📊 Output Examples

Monitoring Console

🔄 Monitoring cycle #1
📊 [2024-01-15 10:30:00] System metrics:
   CPU: 45.2% | Memory: 67.8% | Disk: 82.1%
🔧 Service status:
   🟢 cron: Active
   🟢 dbus: Active
   🔴 nginx: Stopped
🚨 ALERTS:
   🔴 Service nginx is stopped
🔧 AUTO-HEALING ACTIONS:
   ✅ service_restart: Service nginx restarted successfully

Structured JSON Logs

{
  "timestamp": "2024-01-15T10:30:00.000000",
  "event_type": "action",
  "action_type": "service_restart",
  "status": "SUCCESS",
  "service": "nginx",
  "message": "Service nginx restarted successfully"
}

🐛 Troubleshooting

Common Issues

❌ "systemctl not found" (Windows)

Solution: Adapt service_monitor.py to use PowerShell

📧 Emails not received

Check:

• SMTP settings in .env
• Gmail app password
• Firewall/antivirus

📊 Dashboard inaccessible

Check:

• Port 8050 available
• logs/monitoring.json file exists

Diagnostic Commands

# Check logs
tail -f logs/monitoring.json

# Test metrics
python -c "import psutil; print(f'CPU: {psutil.cpu_percent()}%')"

# Check services
systemctl status nginx mysql

🚀 Development

Contribution

Contributions are welcome!

1. Fork the project
2. Create a feature branch (git checkout -b feature/AmazingFeature)
3. Commit your changes (git commit -m 'Add some AmazingFeature')
4. Push to the branch (git push origin feature/AmazingFeature)
5. Open a Pull Request

Development Structure

# Development installation
pip install -r requirements.txt
pip install -e .

# Tests (to be implemented)
python -m pytest tests/

# Code validation
flake8 monitoring/ visualization/ autohealing/

📈 Roadmap

Upcoming Features

• Docker container monitoring
• Database metrics
• Slack/Teams notifications
• Complete REST API
• Dashboard authentication
• Automatic PDF reports

Technical Improvements

• Native Windows support
• Real-time database
• High availability cluster
• Machine learning for adaptive thresholds

📄 License

This project is licensed under the MIT License. See the LICENSE file for details.

👥 Authors

• Development Team - Sen-Se1

🙏 Acknowledgments

• psutil - For the excellent system metrics library
• Plotly/Dash - For interactive visualizations
• Python - For the language and ecosystem

---

📞 Support

• Documentation: README.md
• Issues: GitHub Issues
• Email: mbarkihoussem99@gmail.com

Get Started • Documentation • Contribute • Issues

---

⭐ Don't forget to star the project if you find it useful!