Ollama (Local Models)

Run local LLMs with Ollama and RadarOS. No API key needed. Llama, CodeLlama, Mistral, and more.

Ollama (Local Models)

Use Ollama to run open-source models locally with RadarOS. No API key required—ideal for development, privacy-sensitive workloads, and cost-free experimentation.

---

Setup

1. Install Ollama

   Download and install Ollama from ollama.ai. Start the Ollama service (it runs on http://localhost:11434 by default).

2. Pull a model

   Pull the model you want to use:

   ollama pull llama3.1
   ollama pull codellama
   ollama pull mistral
   
3. Use in RadarOS

   Use the ollama factory with the model name:

import { ollama } from "@radaros/core";

const model = ollama("llama3.1");

---

Factory

import { ollama } from "@radaros/core";

const model = ollama("llama3.1");

modelId · string · required

The Ollama model name (e.g., llama3.1, codellama, mistral).

config · object

Optional configuration. See Config below.

---

Config

host · string · default: "http://localhost:11434"

Ollama server URL. Defaults to http://localhost:11434. Use this for remote Ollama instances or custom ports.

No API key needed

Ollama runs locally and does not require an API key. Just ensure the Ollama service is running.

Example

const model = ollama("llama3.1", {
  host: "http://localhost:11434",
});

// Remote Ollama instance
const remoteModel = ollama("mistral", {
  host: "http://192.168.1.100:11434",
});

---

Popular Models

Model	Use Case
llama3.1	General purpose, strong all-around performance
codellama	Code generation and understanding
mistral	Fast, efficient, good for chat
mixtral	Mixture of experts, higher capability
phi3	Small, fast, good for edge devices

Discover more models

Run ollama list to see installed models. Browse ollama.com/library for the full catalog.

---

Full Example

import { Agent, ollama } from "@radaros/core";

const agent = new Agent({
  name: "Local Assistant",
  model: ollama("llama3.1"),
  instructions: "You are a helpful assistant running locally.",
});

const output = await agent.run("Explain recursion in one sentence.");
console.log(output.text);