Skip to content

An adaptable, open-source context-aware inference engine designed for privacy, control, and independence from proprietary models.

License

Notifications You must be signed in to change notification settings

schmitech/orbit


License Python GitHub stars

ORBIT: The Unified AI Gateway

Open Retrieval-Based Inference Toolkit

Connect 20+ LLM providers and your data (SQL, Vector, NoSQL, APIs, etc.) through one API.

ORBIT is a self-hosted gateway that eliminates vendor lock-in and glue code. It unifies the fragmented components—LLMs, databases, and voice engines—into a single interface.

Try the Sandbox | API Reference | Docker Guide


⚡ Quick Start: Chat via Curl

Try our hosted API immediately with no setup:

curl -X POST https://orbit.schmitech.ai/v1/chat \
  -H 'Content-Type: application/json' \
  -H 'X-API-Key: default-key' \
  -H 'X-Session-ID: test-session' \
  -d '{
    "messages": [{"role": "user", "content": "What is ORBIT?"}],
    "stream": false
  }'

🚀 Key Capabilities

  • Unified API: Swap OpenAI, Anthropic, Gemini, Groq, or local models (Ollama/vLLM) via config only.
  • Agentic AI & MCP: Fully compatible with the Model Context Protocol (MCP). Use ORBIT as a tool provider for agentic applications like OpenClaw, Claude Desktop, and more.
  • Native RAG: Connect Postgres, MongoDB, Elasticsearch, or Pinecone. Query your data using natural language.
  • Voice-First: Real-time, full-duplex speech-to-speech with interruption handling via PersonaPlex.
  • Production Ready: Built-in RBAC, rate limiting, audit logging, and circuit breakers.
  • Privacy First: Self-host on your own infrastructure to maintain full data sovereignty.

🛠️ One Gateway, Many Clients

Client Link Description
Web Chat ORBIT Chat React UI.
CLI pip install schmitech-orbit-client Chat directly from your terminal.
Mobile ORBIT Mobile iOS & Android app built with Expo.
SDKs Node SDK Or use any standard OpenAI-compatible SDK.

📦 Deployment

Docker (Instant)

docker run -d -p 3000:3000 -p 5173:5173 schmitech/orbit:basic

Stable Release (Recommended)

curl -L https://github.com/schmitech/orbit/releases/download/v2.5.0/orbit-2.5.0.tar.gz -o orbit-2.5.0.tar.gz
tar -xzf orbit-2.5.0.tar.gz && cd orbit-2.5.0

cp env.example .env && ./install/setup.sh
source venv/bin/activate
./bin/orbit.sh start && cat ./logs/orbit.log

🧩 Supported Integrations

Inference: OpenAI, Anthropic, Google Gemini, Groq, DeepSeek, Mistral, AWS Bedrock, Azure, Together, Ollama, vLLM, llama.cpp.

Data Adapters: PostgreSQL, MySQL, MongoDB, Elasticsearch, DuckDB, Chroma, Qdrant, Pinecone, Milvus, Weaviate.


📚 Resources & Support

Help ORBIT grow: Star the repo to support the project and get notified of new adapters!

📄 License

Apache 2.0 – see LICENSE.

About

An adaptable, open-source context-aware inference engine designed for privacy, control, and independence from proprietary models.

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors