Echolace_LLM_Router

Suggested GitHub topics: llm, router, local-llm, privacy, cloud-llm, intent-routing, rag, python.

Registry Entry: echolace-llm-router

Echolace_LLM_Router - concise onboarding summary.

Release governance is tracked in RELEASE_MATRIX.md.

Overview

Python app/script folder.

Intent & Audience

Python engineers.

Relationship to this repo

Vault path: 03_Production_Applications/Echolace_LLM_Router. Upstream repo reference path: 07_Production_Applications/Echolace_LLM_Router. Related: 05_Agent_Library, 06_Orchestration_Framework, 10_Documentation.

Agent Integration

No direct Agent dependencies found.

Quickstart - Run locally

1. cd 03_Production_Applications/Echolace_LLM_Router
2. python -m venv .venv then activate it
3. pip install -e .
4. pip install -r requirements-dev.txt
5. python -m pytest -q

Configuration

The router reads provider credentials from environment variables. Common keys:

• OpenAI: OPENAI_API_KEY (+ optional OPENAI_MODEL)
• Azure OpenAI: AZURE_OPENAI_ENDPOINT, AZURE_OPENAI_API_KEY, AZURE_OPENAI_DEPLOYMENT
• Anthropic: ANTHROPIC_API_KEY (+ optional ANTHROPIC_MODEL)
• Google Gemini: GOOGLE_API_KEY (+ optional GOOGLE_MODEL)
• HuggingFace API: HUGGINGFACE_API_KEY (+ optional HF_API_MODEL)
• Universal OpenAI-compatible endpoints: UNIVERSAL_OPENAI_BASE_URL, UNIVERSAL_OPENAI_API_KEY (+ optional UNIVERSAL_OPENAI_MODEL)

Local model configuration:

• HF Local: HF_LOCAL_MODEL
• HF Image Local: HF_IMAGE_MODEL

Key Files & Structure

• .echolace-project.yaml; .flake8

Workflows / Orchestration

No orchestration workflows found.

Deployment

Deployment target and process: see docs/DEPLOYMENT.md.

Testing

Run python -m pytest -q.

Example usage / snippets

cd 03_Production_Applications/Echolace_LLM_Router

Examples:

• python examples/basic_usage.py
• python examples/provider_selection.py
• python examples/privacy_first_routing.py
• python examples/semantic_intent_classification.py
• python examples/hardware_adaptive_routing.py

Troubleshooting & Common Issues

• Check env vars.
• Confirm runtime versions.
• Verify entrypoint command.

Security & Privacy

Potential secret/data handling detected.

Contributing

Guidelines: CONTRIBUTING.md. Open issues/PRs: https://github.com/EcholaceDI/Echolace-DI/issues

Maintainers & Contact

Maintainers: see MAINTAINERS.md.

License & Credits

Repo license: LICENSE.

TODO / Suggested Improvements

• Confirm provider credential handling meets your secret-management expectations.
• Expand CI runner coverage for the optional backends you rely on (OpenAI/Anthropic/Gemini/local).

Generated metadata footer

Generated by Codex on 2026-03-22 at commit c13bd12. Existing content:

Echolace LLM Router

Echolace LLM Router is a unified Python interface for cloud and local LLM backends with policy-driven routing on top. It now includes privacy-aware routing, semantic intent selection, hardware-adaptive offload logic, continuous telemetry, and guided healing for broken local runtimes.

Release

• Checklist template: docs/release-checklist-template.md
• Project-specific command set and evidence map: RELEASE.md