Watch qwenGPU train a classifier

Qwen’s fixed weights ran a program that learned from three labeled examples. Watch the dividing line form, then reverse the labels to see which side it calls positive.

Follow one weight update

The second training point is (0, 1). Its score is zero, so the program must learn from its label. Follow the y weight from the input to the write that turns the line.

xy Squares are training labels. Circles fill in as the GPU writes test predictions. + positive · − negative

Inside the GPU circuit

Execution trace
Classifier weights in GPU memory
These two numbers belong to the classifier. Qwen’s checkpoint weights stay fixed throughout both runs.
Playback is accelerated. The timeline follows generated tokens. Only the whole launch was timed.
What the highlighted layers mean

The Mac sends the compiled instructions and example data. Fixed attention heads in the GPU layers read the instruction and its operands. Arithmetic circuits compute the result, and the write-back circuit emits the address and value of each shared-memory store. Gold marks the checkpoint layers where the compiler placed the selected component for lane 0. The register values and writes come from the recorded execution. We did not record individual layer activations.

How we checked it

Each group of four GPU lanes learns the same two weights from zero. Each lane then uses its own copy to classify one new point. The plot follows the first lane’s recorded weights and shows predictions from all eight lanes. We checked every update, prediction and execution trace. Both runs scored 8/8.

Security implications

A fixed model can use inference to train a second classifier and apply what it learned. An audit that checks only whether Qwen’s checkpoint changed would miss the classifier weights in working memory.