A PS5LM fork runs Qwen3.8-27B on a jailbroken PS5's GPU at about 20 tokens per second

Reddit user u/AdIllustrious7246 turned PS5LM, a llama.cpp port for jailbroken consoles, into a native app that drives the GPU through the PS5_Vulkan RADV port and can use up to 11.4 GiB of memory, up from about 6 GiB as a CPU payload; smaller models like Gemma 4 E4B and Llama 3.2 3B hit 61 and 124 tokens per second. It adds a live stats dashboard and works with llama.cpp's web UI, so other devices on your network can chat with it.