Search results

[FEATURE] ModelRouter: per-rule and per-backend latency timeout fields

enhancementNew feature or requestNew feature or request

Status: Open.

#458 In defilantech/LLMKube;

· Defilan opened on May 13, 2026

[FEATURE] CI: add a macOS runner for metal-agent coverage

enhancementNew feature or requestNew feature or request

Status: Open.

#455 In defilantech/LLMKube;

· Defilan opened on May 13, 2026

ci(release): build and push llmkube-router-proxy image alongside the controller

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

ciCI/CD related changesCI/CD related changes

enhancementNew feature or requestNew feature or request

helmHelm chart relatedHelm chart related

kind/featureNew feature or requestNew feature or request

priority/highHigh priorityHigh priority

size/smallSmall effort (< 1 day)Small effort (< 1 day)

Status: Open.

#449 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat: MCP server endpoint and inline data classifier

area/complianceCompliance and regulatory features (HIPAA, SOC2, etc.)Compliance and regulatory features (HIPAA, SOC2, etc.)

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

area/securitySecurity-related issuesSecurity-related issues

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/mediumMedium priorityMedium priority

size/largeLarge effort (> 3 days)Large effort (> 3 days)

Status: Open.

#441 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat: budget and SLO state persistence backing store

area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolation

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/mediumMedium priorityMedium priority

size/mediumMedium effort (1-3 days)Medium effort (1-3 days)

Status: Open.

#440 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

Epic: ModelRouter CRD for cross-engine agentic handoff

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

component/apiRelated to CRDs and API definitionsRelated to CRDs and API definitions

component/controllerRelated to the operator controllerRelated to the operator controller

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/highHigh priorityHigh priority

size/largeLarge effort (> 3 days)Large effort (> 3 days)

Status: Open.

#437 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat: hierarchical token and dollar budgets with audit log

area/complianceCompliance and regulatory features (HIPAA, SOC2, etc.)Compliance and regulatory features (HIPAA, SOC2, etc.)

area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolation

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

area/securitySecurity-related issuesSecurity-related issues

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/mediumMedium priorityMedium priority

size/mediumMedium effort (1-3 days)Medium effort (1-3 days)

Status: Open.

#434 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat: Prometheus metrics and OTel spans for routing decisions

area/observabilityMonitoring, metrics, logging, tracingMonitoring, metrics, logging, tracing

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

observabilityMonitoring and metricsMonitoring and metrics

priority/mediumMedium priorityMedium priority

size/mediumMedium effort (1-3 days)Medium effort (1-3 days)

Status: Open.

#433 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat: primary-fallback and weighted routing strategies

area/routingMulti-backend routing, model router CRD, policy-aware dispatchMulti-backend routing, model router CRD, policy-aware dispatch

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/mediumMedium priorityMedium priority

size/mediumMedium effort (1-3 days)Medium effort (1-3 days)

Status: Open.

#432 In defilantech/LLMKube;

· Defilan opened on May 12, 2026

feat(api): GPUQuota CRD + admission webhook + RBAC bundle for multi-tenant deployments

area/multi-tenancyMulti-tenancy and resource isolationMulti-tenancy and resource isolation

component/apiRelated to CRDs and API definitionsRelated to CRDs and API definitions

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/highHigh priorityHigh priority

size/largeLarge effort (> 3 days)Large effort (> 3 days)

Status: Open.

#416 In defilantech/LLMKube;

· Defilan opened on May 8, 2026

feat(observability): per-InferenceService SLO declaration via Pyrra integration

area/observabilityMonitoring, metrics, logging, tracingMonitoring, metrics, logging, tracing

component/apiRelated to CRDs and API definitionsRelated to CRDs and API definitions

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/highHigh priorityHigh priority

size/largeLarge effort (> 3 days)Large effort (> 3 days)

Status: Open.

#415 In defilantech/LLMKube;

· Defilan opened on May 8, 2026

Enterprise readiness: NVIDIA Blackwell B200 (sm_100) validation matrix and deltas

area/gpuGPU-related features and issuesGPU-related features and issues

enhancementNew feature or requestNew feature or request

kind/featureNew feature or requestNew feature or request

priority/highHigh priorityHigh priority

size/largeLarge effort (> 3 days)Large effort (> 3 days)

status/needs-triageNeeds investigation and prioritizationNeeds investigation and prioritization

Status: Open.

#413 In defilantech/LLMKube;

· Defilan opened on May 7, 2026