Ollama

Decision models in the CLI Decision models can now be used directly from the terminal with ollama run — ask yes/no questions, classify text into labels, or score against a rubric: ollama run nimble --ask "Is a refund being requested?" < ticket.txt What's Changed Kev decision models are now supported by the MLX runner on Apple silicon ollama launch can now be used with usage credits without upgrading to a paid plan ollama launch codex now includes locally installed Ollama models in its model picker. Use /model within the Codex CLI to swap models. Improved inference performance by reusing verified manifests and already loaded models Added support for multimodal embeddings through llama-server Fixed loading multimodal embedding models with small context windows Improved Gemma 4 prefill performance on NVIDIA GPUs with the MLX runner MLX runner now clips long Laya states instead of rejecting them Improved speculative decoding reliability in the MLX runner, including recurrent state handling after rollback Updated llama.cpp with native decision model support Updated README and documentation with clearer privacy and cloud-services wording Full Changelog: https://github.com/ollama/ollama/compare/v0.40.3...v0.40.4

What's Changed ollama launch claude no longer shows a warning about Claude connectors by @hoyyeva in https://github.com/ollama/ollama/pull/18878 ollama launch codex no longer warns about service tiers by @hoyyeva in https://github.com/ollama/ollama/pull/18879 Paused background model upgrade for embedding and other request performance, by @jmorganca in https://github.com/ollama/ollama/pull/18908 Full Changelog: https://github.com/ollama/ollama/compare/v0.40.2...v0.40.3

Model upgrades Models downloaded with earlier versions of Ollama are upgraded in the background the first time you run them, for better performance and compatibility when running on llama.cpp. To make downgrading safe, Ollama keeps the original copy as a backup, so upgraded models are temporarily kept on disk. A future release will remove these backups automatically. To remove backed up models now (requires jq): shell curl -s localhost:11434/api/tags | jq -r '.models[].name' | while read -r m; do curl -s localhost:11434/api/show -d "{\"model\":\"$m\"}" | jq -r \ 'select(any(.manifests[]?; .runner == "llamacpp")) | .manifests[] | select(.runner == "ggml") | .digest' done | sort -u | xargs -n1 ollama rm This only deletes the backups. If you later downgrade to a version older than 0.40, you'll need to re-pull those models. Other changes ollama list no longer shows duplicate entries for upgraded models by @dhiltgen in https://github.com/ollama/ollama/pull/18874 ollama launch claude uses the model's full context length by @jberg5 in https://github.com/ollama/ollama/pull/18855 README: add oxi to community integrations by @maziluiosif in https://github.com/ollama/ollama/pull/18739 New Contributors @maziluiosif made their first contribution in https://github.com/ollama/ollama/pull/18739 Full Changelog: https://github.com/ollama/ollama/compare/v0.40.1...v0.40.2-rc0

What's Changed server: proxy cloud usage and balance APIs by @drifkin in https://github.com/ollama/ollama/pull/18829 llama: fix clef head reads past 2GiB on windows by @Gigrise in https://github.com/ollama/ollama/pull/18777 cmd: remove account step from CLI onboarding by @hoyyeva in https://github.com/ollama/ollama/pull/18826 manifest: avoid symlinks on Windows by @dhiltgen in https://github.com/ollama/ollama/pull/18852 docs: fix 6 dead links in README community integrations list by @aniketkrs in https://github.com/ollama/ollama/pull/18814 docs: fix broken download links in app README by @chenlichao in https://github.com/ollama/ollama/pull/18233 mlx: drop carried metal residency patch now that it is upstream by @dhiltgen in https://github.com/ollama/ollama/pull/18854 New Contributors @Gigrise made their first contribution in https://github.com/ollama/ollama/pull/18777 @aniketkrs made their first contribution in https://github.com/ollama/ollama/pull/18814 @chenlichao made their first contribution in https://github.com/ollama/ollama/pull/18233 Full Changelog: https://github.com/ollama/ollama/compare/v0.40.0...v0.40.1-rc0

Clef decision models Ollama now supports Clef and Clef Flash, Cloudflare's new open-source decision models, through /v1/systemone. Clef (27B) and Clef Flash (9B) are multimodal: requests can now include images alongside the text state, shared by all questions and scored jointly with it. sh curl http://localhost:11434/v1/systemone -d '{ "model": "clef-flash", "state": "The user took this screenshot.", "images": [""], "questions": { "hasollama": {"type": "noul", "instructions": "Does this image contain Ollama?"} } }' { "model": "clef-flash", "answers": { "hasollama": { "type": "noul", "noul": 0.958 } }, "usage": { "inputtokens": 548, "outputtokens": 0 } } What's Changed Models using web search can now perform up to ten searches per response, up from three Modelfiles now support CAPABILITY declarations, so model creators can explicitly declare what a model can do. Declarations are preserved when creating from GGUF or safetensors, through model inheritance, and on Modelfile export ollama show and the model list now report only decision as the capability for decision models, so clients no longer offer them for general chat, tools, or thinking Updated llama.cpp and the MLX engine Full Changelog: https://github.com/ollama/ollama/compare/v0.35.0...v0.35.1

Decision models Ollama now supports decision models through /v1/systemone, based on TypeSafe’s Jev API. Decision models return choices, probabilities, and scores instead of text. Use them for tasks such as ticket triage, model routing, and content classification. Available models: Nimble from Bespoke Labs Tev1 from Together AI sh ollama pull nimble Send context and one or more questions: sh curl http://localhost:11434/v1/systemone \ -H 'Content-Type: application/json' \ -d '{ "model": "nimble", "state": "Our checkout has returned 500 errors since 9am.", "questions": { "label": { "type": "choice", "instructions": "Which label fits this ticket?", "criteria": { "billing": "Payments and refunds", "bug": "Software errors", "account": "Login and account access" } } } }' Example response: json { "model": "nimble", "answers": { "label": { "type": "choice", "choice": "bug", "probabilities": { "billing": 0.0125, "bug": 0.9781, "account": 0.0093 }, "confidence": 0.8906 } }, "usage": { "inputtokens": 174, "outputtokens": 1 } } The API supports three question types: choice: Select an option and return probabilities for each. noul: Return the probability that a condition is true. score: Return a score across an ordered set of criteria What's Changed Settings now opens without waiting for model discovery. Fixed the macOS update menu and icon not reflecting an available update at startup. Fixed stalled MLX model downloads hanging indefinitely. Requests containing the deprecated typicalp parameter now log a warning instead of failing. Full Changelog: https://github.com/ollama/ollama/compare/v0.34.4...v0.35.0

What's Changed Models run on MLX on Apple Silicon by default In this release, on Apple Silicon devices, model architectures supported by the MLX runtime will automatically run on MLX. ollama pull qwen3.8 ollama run qwen3.8 Additional models include gemma4, qwen3.6 and qwen3.5 Decision models are now available on MLX as well: Nimble tev1 clef clef-flash MLX now has support for an embedding model: embeddinggemma-2 We will continue testing and enabling additional models. Full Changelog: https://github.com/ollama/ollama/compare/v0.35.1...v0.40.0

What's Changed Structured outputs on thinking models now apply in a single pass, making them faster and more reliable. Fixed intermittent "model not found" errors with a large local library Fixed the macOS app becoming unresponsive when checking if ChatGPT or Codex is running. Qwen 3.8 prompt processing is faster on Apple Silicon. Gemma 4 on Apple Silicon now picks the best image resolution per image, keeping more detail in high-resolution images. Updated llama.cpp, MLX, and XGrammar. Full Changelog: https://github.com/ollama/ollama/compare/v0.34.3...v0.34.4

What's Changed GET /api/show now advertises each model's thinking controls and default: Available in the CLI with: ollama show gemma4 thinking levels false, true default true Available in the API with: sh curl http://localhost:11434/api/show -d '{"model": "glm-5.3-flash:cloud"}' json { "thinking": { "values": ["low", "high", "max"], "default": "max" } } Also available on ollama.com directly for cloud models. Nemotron H vision models are now supported on Apple Silicon with MLX Ollama's macOS app will now no longer reopen windows you've closed when activating it Fix for model pulls from HuggingFace Full Changelog: https://github.com/ollama/ollama/compare/v0.34.2...v0.34.3

What's Changed Added first-run setup when running ollama, with options to sign in or continue locally. Setup completion is shared with the desktop app on macOS and Windows. Added ollama://apps to open the desktop app’s Apps page directly on macOS and Windows. Fixed excessive memory growth during long generations with MLX speculative decoding. Updated llama.cpp. Full Changelog: https://github.com/ollama/ollama/compare/v0.34.1...v0.34.2

What's Changed MLX safetensors ollama create no longer experimental. GGUF model creation now requires using llama.cpp tooling for safetensor conversion and quantization. Improved MLX memory handling on Apple Silicon Runaway repeat token detection now requires 100 repeat tokens for reduced false positives (e.g. OCR) /api/tags is much faster on large model libraries (3.1 s → 294 ms cold in testing), and model capabilities are now reported consistently. Deprecated typicalp: it can no longer be set when creating new models, existing GGUF models retain support. MLX and llama.cpp updates Full Changelog: https://github.com/ollama/ollama/compare/v0.34.0...v0.34.1-rc1

Use Ollama models in ChatGPT Desktop Ollama models can now be used directly in ChatGPT Desktop, so you can keep your existing workflow while running open models. Setup is available from the Ollama app on MacOS. This release also improves structured output performance on Apple Silicon, adds support for OpenAI-compatible client tool search and response compaction. Full Changelog: https://github.com/ollama/ollama/compare/v0.33.3...v0.34.0

What's Changed gemma4 now supports images and audio on MLX engine Report cached prompt tokens Honor GGUF model defined default parameters MLX, MLX-C, llama.cpp update New Contributors @marcelpetrick made their first contribution in https://github.com/ollama/ollama/pull/17579 Full Changelog: https://github.com/ollama/ollama/compare/v0.33.2...v0.33.3

What's Changed Ollama's app now follows the system appearance again, restoring dark mode support Fixed the macOS app to properly hand off to an already-running instance instead of starting a second one The Claude Desktop proxy no longer interrupts in-flight requests when the model catalog updates Full Changelog: https://github.com/ollama/ollama/compare/v0.33.1...v0.33.2

What's Changed MLX: Qwen3.8 Flash Next support cmake: make external compat patches idempotent MLX and llama.cpp update mlxrunner: add structured output support mlxrunner: avoid Metal GPU timeouts when loading models from slow storage New Contributors @pd95 made their first contribution in https://github.com/ollama/ollama/pull/17948 Full Changelog: https://github.com/ollama/ollama/compare/v0.33.0...v0.33.1

What's Changed Claude Desktop Developers can now easily configure Claude Desktop to seamlessly work with Ollama as a third-party gateway provider. Improved caching Fixed a hang where agent clients that cancel long prefills Prefill restore points are now trustworthy by construction: a cancelled prefill keeps every restore point it crossed, so retries resume where they stopped instead of restarting from scratch Resumed prefills no longer record restore points that fail to cover what they claim; on models with recurrent layers this previously forced a request matching 46k of 47k tokens to reprocess from zero Disabled Claude Code's "tokens left" token-countdown system message, which Ollama moved to the front of the prompt and broke the KV cache on every request Other improvements DeepSeek Harness launcher now falls back to npx when the global npm install fails, with Windows command-shim support MLX dependency update (#17886) Fixed broken default packaging caused by macOS-specific assumptions affecting Linux/Windows builds Full Changelog: https://github.com/ollama/ollama/compare/v0.32.15...v0.33.0

What's Changed New desktop onboarding flow on first launch Caches resolved model metadata between requests, cutting time-to-first-token by roughly half (TTFT dropped from 995 ms to 524 ms in benchmarks) Fixes a bug where chat and generate could wedge after a mid-stream parser error Qwen 3.8 system messages are now normalized so non-leading system messages are handled consistently MLX and llama.cpp dependency updates New Contributors @gaugarg-nv made their first contribution in https://github.com/ollama/ollama/pull/17752 Full Changelog: https://github.com/ollama/ollama/compare/v0.32.14...v0.32.15

What's Changed llm: transcode WebP images for llama-server renderers/qwen: tolerate non-leading system messages Full Changelog: https://github.com/ollama/ollama/compare/v0.32.13...v0.32.14

What's Changed qwen3.8: support developer instructions Full Changelog: https://github.com/ollama/ollama/compare/v0.32.12...v0.32.13