Skip to content
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

80 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

frozen-intelligence

Mask-locked inference chip design toolchain. The chip IS the agent.

Quick Start

git clone https://github.com/Lucineer/frozen-intelligence.git
cd frozen-intelligence
python3 tests/test_all.py
python3 cli.py --help
python3 cli.py simulate --prompt "Hello" --tokens 16
python3 cli.py estimate --model 3b --process 28nm --yield_pct 85

Vessel Classes

Class Parameters Power Tokens/s Use Case
Scout 1B <1W 100 Edge sensors, microcontrollers
Messenger 3B 2.5W 80 Voice assistants, smart devices
Navigator 7B 5W 50 Field operations, autonomous systems
Captain 13B 10W 30 On-premise reasoning, data center edge

Architecture

  • Weight-locked: Model weights hardwired into metal interconnect
  • TLMM: Table-Lookup MatMul (90% LUT reduction vs traditional MAC)
  • Yield-aware swarm tiling: MoE routing with defect tolerance
  • Zero boot time: Powers on and immediately processes tokens
  • Mixed precision: LayerNorm=FP32, Embed=INT8, Attention/FFN=INT4
  • Hardware security: TRNG, AES-256, secure boot, PUF authentication
  • NoC mesh: XY routing with virtual channels and wormhole switching
  • DDR4/LPDDR4: Bank-interleaved memory controller with refresh management

Modules (31 source + CLI + tests, stdlib only)

Core Toolchain

  1. metal_compiler.py — Weight quantization → binary METL format → die size
  2. weight_compiler.py — Full weight-to-metal pipeline (PyTorch → mixed-precision → binary)
  3. inference_engine.py — Chip simulation, thermal management, fleet routing
  4. verilog_generator.py — MAC units, systolic arrays, chip top module, testbench
  5. chip_verifier.py — Timing/power/DRC, test pattern generation

Physical Design

  1. gdsii_generator.py — GDSII stream format: weight tiles, pad rings, die assembly
  2. drc_checker.py — Design Rule Checker: width, spacing, enclosure, density (28nm LP)
  3. floorplanner.py — Chip floorplan: weight banks, I/O pads, power grid, clock tree, thermal
  4. fpga_toolkit.py — TLMM encoding, COE generation, Hilbert curve weight layout

FPGA Prototyping

  1. tlmm_engine.py — Table-Lookup MatMul (arXiv:2510.15926), 4×4 to 64×64 arrays
  2. weight_streamer.py — DDR4 → BRAM streaming controller with pipeline
  3. clock_gating.py — Hierarchical clock gating, DVFS, thermal throttling
  4. pcie_interface.py — PCIe config space, BAR mapping, MMIO, DMA simulation

Swarm Architecture

  1. swarm_tiler.py — Yield-aware MoE tiling, die grading (GOLD/SILVER/BRONZE/SCRAP), Monte Carlo

Digital Design

  1. netlist_gen.py — Structural Verilog netlist: MAC, multiplier, weight bank, top-level
  2. testbench_gen.py — Verilog testbench: stimulus, reset, scoreboard, response checking
  3. layer_simulator.py — NN layer simulation with mixed precision and per-vessel throughput

Analysis

  1. quant_research.py — Precision sweep, mixed-precision analysis, optimal bits per layer
  2. timing_analyzer.py — STA: MAC critical path, systolic arrays, PVT corner analysis
  3. power_estimator.py — Dynamic + leakage power, per-vessel, process node comparison
  4. signal_integrity.py — Eye diagrams, crosstalk, termination, transmission line modeling

Synthesis

  1. synth_estimator.py — Cell library area/power estimation, multiplier, systolic, full-chip

On-Chip Infrastructure

  1. memory_controller.py — DDR4/LPDDR4: command scheduling, bank interleaving, refresh
  2. noc_router.py — Mesh NoC: XY routing, virtual channels, wormhole switching

Integration & Security

  1. equipment_detector.py — USB vessel scanning, character sheet generation
  2. a2a_handler.py — A2A protocol, DID identity, fleet bus integration
  3. hardware_security.py — TRNG, AES-256 CTR, secure boot chain, PUF chip authentication

Verification

  1. formal_checker.py — Bounded model checking: safety, liveness, invariants, counterexamples
  2. rtl_simulator.py — Event-driven RTL sim: AND/OR/XOR/MUX/FA/DFF, trace, multi-cycle

Cost & Debug

  1. cost_model.py — NRE, unit cost, yield, packaging, volume/process comparison
  2. jtag_debug.py — JTAG TAP controller, DAP debug access, boundary scan

SDK & CLI

  1. sdk.py — Host-side USB transport, streaming generation, fleet mode
  2. cli.py — Unified CLI: compile, verify, estimate, simulate, benchmark

Swarm Tiling

    ┌─────────────────────────┐
    │  EDGE: expendable       │
    │  ┌───────────────────┐  │
    │  │  MID: important   │  │
    │  │  ┌─────────────┐  │  │
    │  │  │  CORE:      │  │  │
    │  │  │  Router     │  │  │
    │  │  │  Safety     │  │  │
    │  │  │  Primary    │  │  │
    │  │  └─────────────┘  │  │
    │  └───────────────────┘  │
    └─────────────────────────┘

Defective tiles disabled. MoE router skips dead tiles. Die binning:

  • GOLD: Full swarm → flagship
  • SILVER: Core + most experts → standard
  • BRONZE: Core only → budget
  • SCRAP: Non-functional

Zero Dependencies

All modules use Python stdlib only. Runs on Jetson ARM64, Raspberry Pi, any Python 3.11+.

Docker

docker build -t frozen-intelligence .
docker run -it frozen-intelligence --help

License

MIT — Lucineer (DiGennaro et al.)

About

The Frozen Intelligence — mask-locked inference as a vessel class. Silicon-bound cognition for sovereign edge agents. Part of the Lucineer ecosystem.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages