This project is a scalable, event-driven microservices-based backend designed to support the complex operations of an e-commerce platform. It consists of multiple independent services, each with its own database, connected asynchronously through Kafka and exposing APIs via GraphQL. The system is built with a strong focus on performance, reliability, and scalability, featuring Redis caching, JWT authentication, priority-based notification handling, and observability through monitoring tools like Prometheus and Grafana. The containerized architecture ensures seamless deployment and management.
https://www.loom.com/share/14913d88f649421eb5426c14fea0d507
Postman Collection : Postman Colletion Link
- Microservices: Independent services for handling User, Product, Order, Notification, and Recommendation functionalities.
- GraphQL API: A unified interface enabling efficient and flexible data querying across multiple services.
- Event-Driven Communication: Kafka-based asynchronous messaging for real-time updates and service decoupling.
- Redis Caching: Accelerates response times by caching frequently accessed resources and recommendations.
- Authentication & Security: Secure access using JWT-based authentication and role-based authorization.
- Monitoring & Observability: Integrated monitoring with Prometheus and Grafana for health checks and centralized logging.
- Containerized Deployment: Services are containerized using Docker Compose for streamlined deployment and scaling.
- User registration and authentication with secure JWT-based access control.
- Endpoints for creating, updating, and managing product details.
- Real-time inventory tracking and updates.
- Real-time order placement.
- Inventory reservation system to prevent overselling and ensure consistency.
- Kafka-driven real-time communication between services.
- Dead Letter Queues (DLQs) for error handling and message recovery.
- Enhanced resilience and fault tolerance.
- Consolidated API for querying data across services with flexibility and efficiency.
- Integrated caching of GraphQL responses in Redis for improved query performance.
- Frequently accessed data (e.g., product listings, recommendations) cached in Redis.
- Intelligent cache invalidation for inventory updates and recommendation updates.
- Optimized caching for high-demand scenarios.
- Automated email notifications for transactional, promotional, and recommendation-based messages.
- Priority-based queues:
- Critical Queue: For high-priority notifications like order updates and security alerts.
- Standard Queue: For lower-priority notifications like promotional emails.
- Cron jobs for scheduled or bulk notifications to improve efficiency.
- Event-driven triggers for sending notifications seamlessly.
- Efficient, rule-based recommendation engine using order history.
- Personalized suggestions based on past user behavior.
- Cached recommendations for faster response and reduced compute overhead.
- Prometheus for real-time metrics collection and monitoring.
- Grafana dashboards for visualizing system health, performance, and analytics.
- Centralized logging for improved debugging and auditing.
- Fully containerized system using Docker for seamless deployment.
- Orchestration with Docker Compose to run all services together or individually for debugging.
- Node.js with Express.js : Service APIs
- GraphQL : API Gateway for unified data querying
- Kafka : Event Streaming for service communication
- Redis : Key/Value caching
- MongoDB : NoSQL database for each service
- JWT Authentication : Secure token-based access
- Nodemailer / SMTP : Email notification service
- Docker & Docker Compose : Containerization and orchestration
- Prometheus : Metrics collection and monitoring
- Grafana : Dashboard visualization and analytics
The entire system can be run locally with a single command using Docker Compose.
docker-compose up --build- To run a specific service, navigate to its directory and follow the steps to install dependencies and start it individually.