Post

A tiny world model running games on a Raspberry Pi Pico 2 W

A Pico 2 W runs a small quantized looped transformer that predicts game frames and rewards, alongside an agent that plays the model’s generated games; the embedded implementation is in Rust.

The project uses 26k–131k-parameter world models and reports held-out transition accuracy, but also tests whether dream-game states match the actual rules. In 5,000 dreamed steps its Pac-Man example had 742 wrong game states, illustrating how model errors can accumulate or be exploited. An HN reader highlighted the benefit of repeated transformer passes for the more complex Doom-lite example.