Enterprise Storage Engineer ร AI/GenAI Researcher ยท Bridging the infrastructure that makes AI possible
I sit at the intersection of two worlds most engineers only know one of โ enterprise-grade storage systems and cutting-edge AI infrastructure. I've worked hands-on with IBM Storage, EMC PowerMax, and SAN fabrics at enterprise scale. Now I'm obsessed with how AI systems store, retrieve, and process information โ and I'm building the open knowledge base that connects both worlds.
Storage is the foundation AI is built on. I know both sides.
identity = {
"enterprise_storage": {
"systems": ["IBM Storage (FlashSystem, DS8000, Spectrum)", "EMC PowerMax"],
"networking": ["Brocade SAN Switches", "Cisco MDS & Nexus", "FC/FCoE/iSCSI"],
"concepts": ["SAN Architecture", "NAS Design", "Storage Fabric Zoning"],
"cloud": ["Cloud Storage Integration", "Hybrid Storage Architecture"],
},
"ai_and_genai": {
"current": ["LLM Inference Systems", "KV-Cache Optimization", "vLLM",
"Generative AI Architecture", "Vector Databases"],
"storage_ai": ["GPU Memory Management", "Flash Attention", "Model Storage",
"Checkpoint Systems", "Distributed Training I/O"],
"future": ["Agentic AI Systems", "Multimodal Storage",
"Neuromorphic Computing Storage", "AI-Native Storage"],
},
"building": {
"storagecraft": "Open knowledge base โ storage + AI infra",
"simulators": "Interactive visual learning tools",
"benchmarks": "Reproducible, Python-scripted real data",
"mission": "Make enterprise + AI knowledge free forever",
},
}The open knowledge base where enterprise storage meets AI infrastructure. Real knowledge. No paywalls. No NDAs. Open forever.
| Section | Description | Status |
|---|---|---|
| ๐ง Core Concepts | WAL, Write Amplification, COW, Erasure Coding | ๐ข Live |
| ๐ค AI Infrastructure | KV-Cache, vLLM, Flash Attention, GPU Memory | ๐ข Live |
| ๐ฎ Generative AI | LLM storage patterns, RAG, Vector DBs, Agents | ๐ก Building |
| โ๏ธ Storage Internals | NVMe, LSM Trees, RAID, ext4, ZFS internals | ๐ก Building |
| ๐ข Enterprise Storage | IBM FlashSystem, EMC PowerMax, SAN fabrics | ๐ก Building |
| ๐ฌ Simulators | Interactive RAID, LSM, SAN fabric, attention viz | ๐ก Building |
| ๐ Benchmarks | Reproducible Python benchmark suite | ๐ด Coming |
๐ manmeetnain.github.io/storagecraft โญ github.com/manmeetnain/storagecraft
โถ RAID-5 Visualizer See parity distribution, disk failures, and rebuild in real-time
LSM Tree Simulator โ Week 4 Attention KV-Cache Visualizer โ Month 2 SAN Fabric Zoning Simulator โ Month 2
- Write Amplification โ The hidden cost multiplier in SSDs, LSM trees, and distributed storage
- Write-Ahead Log โ How crash safety works in every major database
- KV-Cache in LLM Inference โ The most critical storage optimization in modern AI
Generative AI โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
How LLMs store and retrieve knowledge (KV-cache, RAG)
Agentic AI memory systems and persistent storage
Vector database internals (HNSW, IVF, PQ)
Multimodal AI storage patterns
AI-Native Storage (the future) โโโโโโโโโโโโโโโโโโโโโโโโโ
Storage systems designed for AI workloads from ground up
Checkpoint-optimized filesystems for training runs
Near-storage compute for ML inference
Neuromorphic and in-memory computing storage
Enterprise ร AI Intersection โโโโโโโโโโโโโโโโโโโโโโโโโโโ
Running LLM inference on enterprise storage arrays
IBM and EMC integration with AI pipelines
SAN fabrics for GPU cluster interconnect
Whether you need enterprise storage architecture advice or help designing AI infrastructure โ I bring both worlds together.
| ๐ Read | manmeetnain.github.io/storagecraft |
| ๐ผ Consulting | Enterprise storage ยท AI infra ยท GenAI architecture |
| ๐ง Email | manmeet.nain@gmail.com |
| โค๏ธ Sponsor | github.com/sponsors/manmeetnain |
StorageCraft is free, open source, and always will be. Enterprise storage knowledge and AI infrastructure insights shouldn't be locked behind paywalls. If this work helped you โ consider sponsoring to keep it going.
Tiers from โน200/month. Every contribution funds more deep dives.
Enterprise Storage ร Generative AI ร Open Source ยท Building from India ๐ฎ๐ณ ยท One commit every day