—4 min read
Chronicles: Day 1
personal
Software Engineer & Writer
Kumar Divya
Rajat
Building software, writing about the process, and sharing what I learn along the way. Currently exploring React Native, developer tools, and the craft of simple code.
Recent Writing
View all →—9 min read
Grokking has two phases, and you can see the boundary
A component-freezing ablation study on modular division reveals that grokking isn't one process. It's two: infrastructure setup, then computational reorganization. The boundary between them is sharp and measurable.
grokkingmechanistic-interpretabilityablationtransformersexperiments
—10 min read
One neuron changes everything: the 63 vs 64 puzzle
A 3-layer MLP learning F = m*a behaves completely differently with 63 neurons vs 64. The investigation reveals three training regimes, winner-take-all gradient dynamics, and a lesson about what you're actually ablating when you change architecture.
neural-networksinitializationtraining-dynamicsexperimentspuzzles
Featured Projects
View all →Inference Stack
Featured
Production-grade LLM inference API built from scratch. NestJS gateway + Python GPU workers. Scheduling, batching, KV cache, tensor parallelism, multi-modal, all against real GPUs.
nestjspythonhugging-face
Rendero
Featured
Figma-compatible Rust/WASM canvas engine. 134M-point rendering, built-in CRDT collaboration, native .fig import — one binary, zero JS dependencies.
rust