Skip to content

docs(agents): openwebui — configure the bundled-Ollama model (CON-1566)#202

Open
robballantyne wants to merge 1 commit into
mainfrom
docs/agents-openwebui
Open

docs(agents): openwebui — configure the bundled-Ollama model (CON-1566)#202
robballantyne wants to merge 1 commit into
mainfrom
docs/agents-openwebui

Conversation

@robballantyne

Copy link
Copy Markdown
Collaborator

Tailors the Open WebUI agent guide toward what an operator actually configures: the served model. This image is Open WebUI backed by a bundled Ollama (it serves models locally, not just a front end). Part of the CON-1556 rollout.

The guide now covers:

  • Ollama (:21434) is the backend; Open WebUI (:17500) is pre-pointed at it (OLLAMA_BASE_URL).
  • Set the served model via OLLAMA_MODEL (pulled at boot; MODEL_NAME alias) or ollama pull at runtime — new models appear in Open WebUI's selector.
  • Persistence: models at ${WORKSPACE}/ollama/models, Open WebUI data at ${WORKSPACE}/data.
  • Boot order: open_webui waits on /tmp/.ollama_ready (server up + model pulled), so the UI is intentionally down while a large model downloads.
  • Direct API: Ollama's native /api + OpenAI-compatible /v1 (base_url + key from /capabilities/endpoints).

Docs-only. External image (rolling stock base; gets the agent surface from repo /ROOT).

…a model (CON-1566)

This image is Open WebUI backed by a bundled Ollama (it serves models, not just a
front end). Expand the stub to focus on the thing an operator actually configures:
the served model — set OLLAMA_MODEL (pulled at boot; MODEL_NAME alias) or `ollama pull`
at runtime; models persist at ${WORKSPACE}/ollama/models, Open WebUI data at
${WORKSPACE}/data. Note open_webui waits on /tmp/.ollama_ready (server up + model
pulled) so the UI is intentionally down while a large model downloads, and that
Ollama is directly usable via its native /api + OpenAI /v1 (base_url+key from
/capabilities/endpoints).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant