Home / Marketplace / Ollama on Ubuntu 24.04 LTS

Ollama on Ubuntu 24.04 LTS

Ollama is a local large-language-model runtime with an OpenAI-compatible API — pull open models (Llama, Mistral, Gemma and more) and serve them from your own VM. This image gives you a production-ready deployment within minutes of first boot — no dependency wrangling, no manual hardening checklist. Published and maintained by Derek Coleman & Associates Inc: freshly rebuilt against current security advisories and deployable straight from the Azure Marketplace into your own subscription.

Get it on Azure Marketplace Deploy on Azure Support & quick start

Version: Ollama 0.31.1 (no models pre-pulled)Platform: Ubuntu 24.04 LTSPorts: 11434 (HTTP API — no built-in authentication)Category: AI & GPU

What's included

Ollama installed from the official upstream source
Ubuntu 24.04 LTS base with automatic security updates enabled
No shared or default passwords baked into the image
Trusted Launch support: Secure Boot + vTPM
Azure Monitor Agent, Defender for Cloud, and Update Manager install cleanly

Quick start

Deploy from the Azure Marketplace (Get It Now → Create), choosing your SSH key at the Administration step.
Allow inbound SSH (22) for yourself plus the application port(s): 11434 (API) — to your clients only; there is no authentication — restrict to your own IP where possible. The in-image firewall already allows them; only the Network Security Group (NSG) keeps them closed.
SSH in, `ollama pull llama3.2`, and query the API (see First login below).
Point OpenAI-compatible clients at http://<VM-IP>:11434/v1.

Common use cases

Private LLM inference endpoint
OpenAI-compatible API for internal apps
Prototyping with open-weight models
Air-gapped or data-resident AI

Why our images

Freshly rebuilt against the latest security advisories, no shared default credentials, Trusted Launch support, and automatic OS security updates — everything runs in your own Azure subscription under your governance.

Need help?

Product support page
support@dcassociatesgroup.com
Contact form