The complete platform for distributed logs. Your team's toolkit to stop configuring and start innovating. Securely collect, monitor, and analyze logs from any source with real-time insights.
- Real-Time Log Streaming - Watch logs flow in real-time with sub-second latency
- Advanced Search & Filtering - Powerful log search with service and level filtering
- Interactive Dashboard - Visual analytics with real-time charts and metrics
- Multi-Service Support - Monitor logs from multiple services in one place
- Smart Alerts - Configurable alerting system for critical events
- Live Metrics Dashboard - Track request rates, response times, and error rates
- Time-Series Visualization - Beautiful charts using Recharts library
- Log Volume Analysis - Analyze log patterns by severity (INFO, WARN, ERROR)
- System Performance Monitoring - CPU, memory, and resource utilization tracking
- API Key Management - Secure API key generation and rotation
- TLS Encryption - Secure log transmission with TLS support
- Team Collaboration - Role-based access control and team member management
- Integration Support - Connect with popular monitoring tools (Datadog, Splunk, etc.)
- Modern UI - Clean, responsive interface built with shadcn/ui components
- Dark/Light Mode - Theme support for comfortable viewing
- Real-Time Updates - Live data updates without page refreshes
- Export Capabilities - Download logs for offline analysis
- Framework: Next.js 14 - React framework with App Router
- Language: TypeScript - Type-safe JavaScript
- Styling: Tailwind CSS 4.1.9 - Utility-first CSS framework
- UI Components: shadcn/ui - High-quality React components
- Icons: Lucide React - Beautiful & consistent icons
- Charts: Recharts - Composable charting library
- Radix UI - Unstyled, accessible component primitives
- Dialog, Dropdown, Select, Tabs, Toast, and more
- Form Handling: React Hook Form with Zod validation
- Animations: Tailwind CSS Animate
- Font: Geist - Sans and Mono fonts from Vercel
- Analytics: Vercel Analytics - Web analytics
- Package Manager: pnpm
Distributed-Log-Monitoring-System/
├── app/ # Next.js App Router pages
│ ├── dashboard/ # Dashboard page with metrics
│ │ └── page.tsx
│ ├── logs/ # Log viewer page
│ │ └── page.tsx
│ ├── settings/ # Settings & configuration page
│ │ └── page.tsx
│ ├── page.tsx # Landing page
│ ├── layout.tsx # Root layout
│ ├── loading.tsx # Loading state
│ └── globals.css # Global styles
├── components/ # React components
│ ├── ui/ # shadcn/ui components
│ └── theme-provider.tsx # Theme provider
├── hooks/ # Custom React hooks
├── lib/ # Utility functions
├── public/ # Static assets
├── styles/ # Additional styles
├── next.config.mjs # Next.js configuration
├── tailwind.config.ts # Tailwind CSS configuration
├── tsconfig.json # TypeScript configuration
└── package.json # Dependencies
- Node.js 18.x or higher
- pnpm (recommended) or npm/yarn
- Modern web browser
-
Clone the repository
git clone https://github.com/johaankjis/Distributed-Log-Monitoring-System.git cd Distributed-Log-Monitoring-System -
Install dependencies
pnpm install # or npm install -
Run the development server
pnpm dev # or npm run dev -
Open your browser
Navigate to http://localhost:3000
# Build the application
pnpm build
# Start the production server
pnpm startThe landing page (/) provides an overview of LogStream features, metrics, and upcoming roadmap items.
- View real-time system metrics
- Monitor request rates and response times
- Track error rates and uptime
- Visualize log volume by severity level
- Access system resource utilization
- Stream logs in real-time
- Filter by service and log level
- Search through log messages
- View detailed log metadata
- Pause/resume live streaming
- Export logs for analysis
Configure your LogStream instance:
- General Settings: Project name, retention, timezone
- Alerts: Email/Slack notifications, error thresholds
- Security: TLS, API key rotation, IP whitelist
- Integrations: Connect with Datadog, Splunk, Grafana
- Team Management: Invite members, manage permissions
Install the log forwarding agent on your servers:
pip install logstream-agentConfigure the client:
import logstream
client = logstream.Client(
api_key="your_api_key_here",
host="logs.logstream.io",
port=6514,
tls=True
)
client.send_log(
level="INFO",
service="my-app",
message="Application started"
)- Navigate to Settings → Security
- Copy your API key from the dashboard
- Configure it in your application
- Enable API key rotation for enhanced security
- ElasticSearch Integration - Advanced log search with ElasticSearch and OpenSearch support
- Anomaly Detection - ML-based error clustering to automatically identify similar issues
- Multi-Tenant Dashboards - Team-specific dashboards with custom views and permissions
- Enhanced Alerting - Advanced alert rules with custom conditions
- Log Aggregation - Better log grouping and pattern detection
- Mobile App - Monitor logs on the go with native mobile apps
Contributions are welcome! Please follow these steps:
- Fork the repository
- Create a feature branch (
git checkout -b feature/amazing-feature) - Commit your changes (
git commit -m 'Add some amazing feature') - Push to the branch (
git push origin feature/amazing-feature) - Open a Pull Request
- Follow TypeScript best practices
- Use existing UI components from shadcn/ui
- Maintain consistent code style
- Write meaningful commit messages
- Test your changes thoroughly
This project is available for educational and demonstration purposes.
- Built with Next.js
- UI components from shadcn/ui
- Icons from Lucide
- Charts powered by Recharts
- Fonts by Vercel
For questions, issues, or feature requests, please open an issue on GitHub.
LogStream - Distributed log monitoring for modern teams 🚀