-
v0.3.0
Stablereleased this
2026-11-09 06:40:40 +00:00 | 0 commits to master since this release- RAT: linear fast-weight attention, learned complex decay,
chunked causal prefill, O(1) decode. - Tests: 60 passed, 47 subtests (forward/step equivalence, prefill/generate,
registry). - FineWeb evidence: RAT33 3e-4/34k mean 1.2361 vs Real48 1e-4/36k mean
1.2355, 31% fewer RAT parameters. - README in English plus de/cs/ru/zh; legacy plots restored locally.
- CI: tests on push; build + publish only on v* tags.
Downloads
-
Source code (ZIP)
0 downloads
-
Source code (TAR.GZ)
0 downloads
- RAT: linear fast-weight attention, learned complex decay,