name: Ranjan Kumar Choubey
role: Data Engineer @ Deloitte (Client: Walmart)
location: Bengaluru, India
education:
- M.Tech CS (Data Science) β ISI Kolkata (AIR 11, AIR 1 EWS)
- B.Tech IT β BIT Sindri (CGPA 8.89, Rank 1)
currently_building:
- Consumption layer pipelines in Spark-Scala for Walmart's enterprise data platform
- Ingestion from 100+ SAP tables and Kafka brokers into GCS/BigQuery
- Airflow DAGs with SLA monitoring & automated failure recovery
also_building:
- Notebook App β AI-powered note-taking (app.ranjankchoubey.com)
- PCGT β Graph Transformer research (M.Tech thesis)
teaching:
- GATE DA Faculty at IMS Academy (Probability, Statistics, ML)
open_to: Data Engineer | ML Engineer | Software Engineer roles at product companiesPython |
Scala |
SQL |
TypeScript |
GCP |
Docker |
React |
Next.js |
FastAPI |
PyTorch |
Firebase |
Linux |
Data Engineer (Consultant) @ Deloitte (May 2025 β Present)
Client: Walmart β Enterprise Data Platform (Ingestion & Consumption Layer)
Data Science Intern @ Allstate India (May β Jul 2024)
Lead Engineer @ Tata Power (Sep 2022 β Aug 2023)
Graduate Engineer Trainee @ Tata Power (Aug 2021 β Sep 2022)
| Project | Description | Tech | Link |
|---|---|---|---|
| PCGT | Graph Transformer replacing O(NΒ²) attention with partition-aware attention. Outperformed SGFormer on 10/12 benchmarks. | PyTorch, PyG, METIS | GitHub |
| Notebook App | AI-powered note-taking app with rich editor, code blocks, math, drawing, PDF export. | Next.js, React, Firebase, Gemini | Live Β· GitHub |
| π 100+ Tables SAP & Kafka β BigQuery |
β‘ Spark-Scala Consumption layer owner |
π Airflow DAGs Production orchestration |
π AIR 11 ISI Kolkata M.Tech |