Provider-agnostic RAG evaluation harness powered by RAGAS with pluggable LLM and embedding backends.
-
Updated
Jun 2, 2026 - Python
#
harness-ai
Here are 5 public repositories matching this topic...
Pluggable DeepEval scaffold for RAG, agents, and LLM apps across Anthropic, Bedrock, Azure OpenAI, and Vertex. Ships traceability, test synthesis, safety/PII gating, multi-turn conversation eval, agentic tool-use scoring, JSON validation, judge benchmarks, hyperparameter sweeps, and pytest CI — one Makefile target per feature.
bedrock evaluation-metrics vertex-ai azure-openai anthropic ollama rag-evaluation ragas deepeval harness-ai deepeval-metrics
-
Updated
Jun 3, 2026 - Python
Drop-in TruLens evaluation harness for tool-calling LangGraph agents. Swap LLM providers (OpenAI, Anthropic via LiteLLM, Bedrock, Cortex, Gemini, Ollama) with a single env var. Ships with the RAG Triad plus Plan Quality, Plan Adherence, Execution Efficiency, and Logical Consistency metrics.
bedrock evaluation-metrics vertex-ai azure-openai anthropic ollama rag-evaluation trulens ragas deepeval harness-ai deepeval-metrics
-
Updated
Jun 3, 2026 - Python
enjoy harness ai, auto drive, Autonomous harness driving
-
Updated
Apr 9, 2026 - Shell
Building AI developer tools in Rust 🦀 | MCP servers • Agentic CI/CD • Code Intelligence • Hodei Platform
rust mcp sandbox ci-cd developer-tools ai-agents platform-engineering code-intelligence model-context-protocol harness-ai
-
Updated
Apr 30, 2026
Improve this page
Add a description, image, and links to the harness-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the harness-ai topic, visit your repo's landing page and select "manage topics."