Skip to content

fiale-plus/omi-local

 
 

Repository files navigation

omi

A 2nd brain you trust more than your 1st

Omi captures your screen and conversations, transcribes in real-time, generates summaries and action items, and gives you an AI chat that remembers everything you've seen and heard. Works on desktop, phone and wearables. Fully open source.

Trusted by 300,000+ professionals.

DiscordGitHub Repo starsLicense: MIT

Website · Docs · Discord · Twitter · DeepWiki

Quick Start

git clone https://github.com/BasedHardware/omi.git && cd omi/desktop && ./run.sh --yolo

Builds the macOS app, connects to the cloud backend, and launches. No env files, no credentials, no local backend.

Requirements: macOS 14+, Xcode (includes Swift & code signing), Node.js


🖥️ Local Mode — Fully Offline, No Account

Run Omi entirely on your Mac — no Firebase, no cloud services, no account required.

Prerequisites:

  • Ollama installed and running (brew install ollama && ollama serve)
  • A model downloaded: ollama pull llama3 (or any model you prefer)

One-command start:

cd desktop && ./run-local.sh

That's it. The script will:

  • Start the Rust backend on port 10201 (LOCAL_MODE=1)
  • Start the Python backend on port 8080 (LOCAL_MODE=1)
  • Skip Firebase auth, Firestore, GCS, Deepgram, and Pinecone entirely
  • Route all AI through your local Ollama instance

Smoke test:

curl http://127.0.0.1:10201/v4/local/status

Configure the local LLM — edit desktop/Backend-Rust/.env.local:

LOCAL_LLM_BASE_URL=http://localhost:11434/v1   # your Ollama endpoint
LOCAL_LLM_MODEL=llama3                         # your model name

Stop services:

./run-local.sh --stop

For troubleshooting, see desktop/Desktop/Sources/LocalDiagnosticsView.swift (built into the app's Settings → Troubleshooting panel when running in local mode).

Full Installation

For local development with the full backend stack:

  1. Install prerequisites
xcode-select --install
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
  1. Clone and configure
git clone https://github.com/BasedHardware/omi.git
cd omi/desktop
cp Backend-Rust/.env.example Backend-Rust/.env
  1. Build and run
./run.sh

See desktop/README.md for environment variables and credential setup.

Mobile App

cd app && bash setup.sh ios    # or: bash setup.sh android

Download for macOS Download on the App Store Get it on Google Play

Try in Browser

How it works
┌─────────────────────────────────────────────────────────┐
│                      Your Devices                       │
│                                                         │
│  ┌──────────┐  ┌──────────────┐  ┌───────────────────┐  │
│  │ Omi      │  │ macOS App    │  │ Mobile App        │  │
│  │ Wearable │  │ (Swift/Rust) │  │ (Flutter)         │  │
│  └────┬─────┘  └──────┬───────┘  └────────┬──────────┘  │
│       │    BLE         │   HTTPS/WS        │             │
└───────┼────────────────┼───────────────────┼─────────────┘
        │                │                   │
        ▼                ▼                   ▼
┌─────────────────────────────────────────────────────────┐
│                    Omi Backend (Python)                  │
│                                                         │
│  ┌─────────┐  ┌──────────┐  ┌─────────┐  ┌──────────┐  │
│  │ Listen  │  │ Pusher   │  │ VAD     │  │ Diarizer │  │
│  │ (REST)  │  │ (WS)     │  │ (GPU)   │  │ (GPU)    │  │
│  └─────────┘  └──────────┘  └─────────┘  └──────────┘  │
│                                                         │
│  ┌─────────┐  ┌──────────┐  ┌─────────┐  ┌──────────┐  │
│  │ Deepgram│  │ Firestore│  │ Redis   │  │ LLMs     │  │
│  │ (STT)   │  │ (DB)     │  │ (Cache) │  │ (AI)     │  │
│  └─────────┘  └──────────┘  └─────────┘  └──────────┘  │
└─────────────────────────────────────────────────────────┘
Component Path Stack
macOS app desktop/ Swift, SwiftUI, Rust backend
Mobile app app/ Flutter (iOS & Android)
Backend API backend/ Python, FastAPI, Firebase
Firmware omi/ nRF, Zephyr, C
Omi Glass omiGlass/ ESP32-S3, C
SDKs sdks/ React Native, Swift, Python
AI Personas web/personas-open-source/ Next.js

Documentation

Getting Started

Building Apps

API & SDKs

Architecture

Omi Hardware

Omi

Open-source AI wearables that pair with the mobile app for 24h+ continuous capture.

Omi Wearable Omi Glass

License

MIT — see LICENSE

About

Let's see if full local setup is possible for Omi tooling

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Dart 39.9%
  • C 19.6%
  • Python 14.6%
  • Swift 11.4%
  • TypeScript 6.8%
  • Rust 2.6%
  • Other 5.1%