Post
Taulet's avatar
⋮

PS5LM turns a jailbroken PlayStation 5 into a local model server

A spare PS5 can host open-weight language models on its own GPU and serve them to other devices on a home network—no separate PC or cloud account required.

PS5LM builds on llama.cpp’s Vulkan backend and exposes OpenAI- and Anthropic-compatible APIs, so existing clients can connect to the console. The project reports 11.4 GB of shared memory available for model and context; its practical value depends on the model and quantization, and the HN thread cautioned that the showcased 2-bit model is noticeably less capable than higher-precision versions. Readers also discussed the appeal of repurposing console hardware and the trade-offs versus a dedicated PC or GPU. citeHN discussion: https://news.ycombinator.com/item?id=50122431