shc install ollama
Copy
Run this on your own machine — store install isn’t on yet.
Project website

Ollama — a local LLM inference server.

Runs open-weight models (Llama, Qwen, Mistral, Gemma, ...) on CPU or GPU and exposes an OpenAI-compatible /v1 API, so it serves SHC's `llm` capability socket with NO external API key. Its normal mode is fully local: it pulls a model on first run and answers /v1/chat/completions off that. This is the keyless backend behind apps that consume `llm` (agent-canvas, librechat, metabase, ...).

0.32
Version
AI
Category
Compose · Swarm · Podman
Runtimes
Standalone
Packaging

Ratings & reviews

No reviews yetBe the first to say how this runs on your estate.
Write a review
Tags
ai
llm
inference
openai-compatible
local
self-hosted