Skip to content

Hermes toolsets live: full governed catalog, yaml-driven preload, and cronjob probe fix#3

Merged
maniotrix merged 2 commits into
mainfrom
fix-plugin-new-mechanism
Jun 23, 2026
Merged

Hermes toolsets live: full governed catalog, yaml-driven preload, and cronjob probe fix#3
maniotrix merged 2 commits into
mainfrom
fix-plugin-new-mechanism

Conversation

@maniotrix

Copy link
Copy Markdown
Member

Summary

  • Move Hermes builtin preload map from hardcoded Python to builtin_module in repo tools.yaml (validated tools. prefix; plugin + shared loaders stay in sync).
  • Expand toolsets live test to verify all governed catalog tools (including cronjob) on registry schemas and OpenAI tools= payload — not just the native E2E tier.
  • Fix schema probe: set HERMES_GATEWAY_SESSION=1 in the probe subprocess so cronjob passes Hermes check_fn (preload alone was not enough).
  • Add per-run marker (intentframe-toolsets-<run_id>) for OpenAI Platform log correlation; extend provider/gateway contract helpers and unit tests.
  • Extend loader parity test to compare builtin_module and enabled between plugin and shared loaders.
  • Document bugs fixed and testing surfaces in gateway README, integration guide, state report, and governance README.
  • Align e2e.sh with CI by running test_make_catalog_yaml.py on every e2e invocation.

Bugs fixed

Issue Why it failed Fix
Toolsets test skipped cronjob Probe/dump used native E2E tool set only Use full governed_tool_names() / template_governed_tool_names()
Preload map drift Hardcoded dict in builtin_preload.py could diverge from catalog builtin_module per tool in tools.yaml
cronjob missing from schema probe Registered via preload but filtered by check_cronjob_requirements() without gateway session env Probe harness sets HERMES_GATEWAY_SESSION=1

Test plan

  • uv run --package intentframe-integrations-cli python tests/hermes_plugin/test_gate.py
  • uv run --package intentframe-integrations-cli python tests/hermes_plugin/test_builtin_preload.py
  • uv run --directory integrations/hermes/shared python tests/test_governance.py
  • uv run --package intentframe-integrations-cli python tests/hermes_gateway/test_governed_tool_coverage.py
  • uv run --package intentframe-integrations-cli python tests/hermes_gateway/test_provider_request_contract.py
  • RUN_HERMES_GATEWAY_TOOLSETS=1 ./tests/scripts/test-hermes-gateway-toolsets.sh (requires OPENAI_API_KEY)
  • ./scripts/e2e.sh (includes test_make_catalog_yaml.py)

@maniotrix maniotrix merged commit 93e5ef8 into main Jun 23, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant