From absolute zero to transformer math — one platform, three explanation depths, dozens of live experiments.
Lesson 6 of 10 · Advanced level · interactive visualization (simplified teaching model)
Only a few expert FFNs fire per token. A router softmax picks top-k experts — huge parameter count, moderate compute.
Ask how anything on this page works…
Your progress is saved only in this browser. To continue on another device, export it to a file and import it there.
Your browser is blocking storage, so progress will be lost when you close this page. Use "Export my progress" to keep a copy.
Tap the card to flip · then mark if you knew it
How AI Works