work

i rebuilt SmolLM2-135M from scratch in PyTorch, without AI-generated code, to close the gap between reading transformer diagrams and understanding how the pieces behave in an actual training loop. the implementation includes grouped-query attention, RoPE, SwiGLU, gradient accumulation, warmup and decay scheduling, plus KV caching for generation.