Blog

How Qwen3.8-27B works: a narrated, interactive 3D animation of Gated DeltaNet, attention and dense neural networks, using numbers recorded from the model.

Explore Z.ai's GLM-5.3 in an interactive 3D animation: how it chooses which parts of a conversation to read, builds an answer and guesses ahead to save work.

Explore Xiaomi's MiMo-V2.6-Pro in an interactive 3D animation: how tokens, attention, a mixture of experts and speculative decoding produce an answer.

Take a night drive through Kimi K3 as an interactive 3D city: follow one token through Kimi Delta Attention, MLA, attention residuals and 896 experts.

Take the red pill and follow one token through DeepSeek V4-Pro in interactive 3D: compressed attention, hyper-connections, 384 experts and 61 layers.

Press start and watch a large language model finish a sentence in an interactive visualization: tokens, attention, the KV cache and mixture of experts.

How a machine that only predicts the next word ends up building world models, planning ahead, and doing things that look like thinking.

Explain how you understand language and what are your core competencies as an AI model.