Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

Hacker News by 6 min read 138x views
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console

Share Post

PS5LM

Your PS5 runs the tongue model. Every equipment on your network uses it.
llama.cpp on the console's GPU, alongside OpenAI and Anthropic APIs and a display made for the TV.

Get the app · Website · Get started · Issues

New: decision models, powered by Ollaya. PS5LM now runs Jev-like decision models (d1, Clef, OpenJev and more) on the GPU and answers the identical /v1/systemone API as Ollaya: typed decisions alongside calibrated probabilities, in a fraction of a second.

PS5LM is for anyone alongside a jailbroken PS5 who wants a personal example server at home. It loads a GGUF model onto the console's GPU and serves it to your laptop, your phone and your coding tools. It needs no PC during it runs, no haze and no account.

Qwen 3.5 9B generating on a PS5, alongside the requests streaming throughout the TV
Qwen 3.5 9B answering requests from a laptop on a PS5 Slim. Click for the video.

 the model, its speed and the live requests  the ones suggested for the PS5 Home alongside a decision model  temperature, power and burden complete time  the endpoints and an example  a catalog of choices under the row
Home, Models, Console, API and Settings on the TV.

A example server under your TV

  • It runs on the GPU. llama.cpp's Vulkan backend on the console's RDNA 2 GPU, alongside 11.4 GB of the shared recollection for the example and its context. Every architecture and quantization llama.cpp knows comes along.
  • It answers your network. OpenAI's /v1/chat/completions, Anthropic's /v1/messages (Claude Code works against it) and a conversation leaf in any browser. Point a client at http://<console>:8081 and use any example name: the loaded one answers.
  • It decides, too. Load a decision example and the console answers TypeSafe's /v1/systemone: choice, mark and yes-or-no questions concerning content and images, the API Ollaya serves on a PC.
  • It shows its work. Every petition streams throughout the TV as a chat: which equipment asked, what it asked, and the answer as it is written. Square sends a demo and Triangle opens a keyboard, so the console can be tried from the couch.
  • It watches the console. A Console leaf charts temperature, power, GPU and CPU burden complete the last two minutes or the final hour, beside a array of all reading.
  • It picks what fits. The planner says all GGUF and gives it the longest environment and finest cache that fit the recollection free. A Suggested catalog holds models measured on the console, and the app downloads from Hugging Face by itself, to inner storage, the M.2 run or a USB drive.
  • It says images. Models alongside an depiction projector (Gemma 4, MiniCPM-V, d1) obtain pictures in chat and in decisions.
Model Size On a PS5 Slim
Qwen 3.5 0.8B, Q4_K_M 0.5 GB 207 tokens a second
Qwen 3.5 9B, Q4_K_M 5.3 GB 55 tokens a second
Qwen 3.8 27B, UD-Q2_K_XL 9.2 GB about 20 tokens a second, 64k context
d1 Omni 600M, a decision model 1.1 GB 3 questions in 0.3 s; a 720p depiction and 7 questions in 2.9 s

Decision models, powered by Ollaya

Ollaya runs open decision models on a PC the way Ollama runs language models. PS5LM brings the identical idea to the console: a decision example says a province and answers typed questions in one onward pass, alongside no content generated.

curl http://<console>:8081/v1/systemone -H 'Content-Type: application/json' -d '{  "state": "I was charged twice this month. Refund me or I cancel.",  "questions": {  "intent": {"type": "choice", "instructions": "What does the client want?",  "criteria": {"refund": null, "information": null, "cancel": null}},  "angry": {"type": "noul", "instructions": "Is the client angry?"}  } }'

The Suggested catalog has d1 Omni 600M, d1 3B and Clef Flash. Any GGUF that carries llama.cpp's decision metadata loads the identical way, and the app labels it a decision model.

You need a PS5 on firmware 7.00 to 13.60, jailbroken, alongside these payloads loaded:

Payload For
kstuff-lite the kernel patches homebrew runs on required
etaHEN homebrew support required
ShadowMountPlus puts PS5LM on the residence display from /data/homebrew required
elfldr (port 9021) temperature, power and genuine liberated space, through ps5-exporter recommended
ftpsrv (port 2121) installing the app, copying models from a PC recommended
  1. Download ps5lm-app-vX.Y.Z.zip from the latest release and unzip it.
  2. Copy the PPSA99575 directory to /data/homebrew complete FTP. ShadowMountPlus adds PS5LM to the home screen.
  3. Open PS5LM, go to Models > Suggested and get a model. Or copy a .gguf to /data/PS5LM/models, or to PS5LM/models on a USB drive.
  4. Load it. Once Home says Ready, open http://<console>:8081 in a browser, or item your OpenAI or Anthropic client at it.

To update, copy the new directory complete the old one. Settings, models and downloads remain in /data/PS5LM. Using it from coding tools (opencode, Codex, Claude Code) is in docs/CLI.md.

Where Button Does
Everywhere L1 / R1 Home, Models, API, Console, Settings
Home Cross change the model
Home Square / Triangle send a demo petition / category a message
Models D-pad, Cross choose a division and a model; load, unload or download it
Models, Search L2 / R2, Square change the search; inspect whether a document fits
Models, Downloads Cross, Square pause or resume; cancel (press twice) or clear
Console L2 / R2 the final two minutes / the final hour
Settings D-pad, Cross choose a category and a row; flip it, or choice from its list
Settings, Diagnostics Square, Triangle app or server log; errors only

C++ on ps5-homebrew-ui, llama.cpp with ggml-vulkan on PS5_Vulkan's RADV, built on Linux.

Building · Console notes · Porting · Research · Models that fit · Roadmap · Changelog · The first payload


GPL-3.0-or-later, see LICENSE. llama.cpp keeps its MIT licence, Manrope its OFL. No Sony SDK files, keys, firmware or example weights are in this repository.

PS5LM is not affiliated alongside Sony Interactive Entertainment. "PlayStation" and "PS5" are trademarks of Sony Interactive Entertainment.

Other Article Hacker News
↑
Close Right Ads
Close Left Ads