Claim◆Video · 6:56 · 2m
The large language model itself has become a commodity — interchangeable like gas from any gas station, where price (or marginal quality) is the only real differentiator.
Ali Ghodsi · BG2 Pod
Installing and running the plugin starts a localhost server on port 9001 that makes all LLM models available via an OpenAI Chat Completions compatible API. ✦ AI generated
Author · Simon Willison's Weblog · 2026-07-30 · original ↗
To test that out, I built this plugin: uv tool install llm --pre llm install llm-chat-completions-server llm chat-completions-server -p 9001 Running this starts a localhost server on port 9001 that exposes your full collection of LLM models (from any plugins you have installed) using a ChatGPT Completions compatible endpoint.
Read full article ↗excerpt · fair-use quotation