2026-09-09
Shrink the Embedder, Not the Idea
I swapped the 12-billion-parameter embedding model that powers local note retrieval for a 0.6-billion one. The vectors shrank 3.7x and the memory peak dropped from 12.3 GB to 185 MB. The docstring never got the memo.