Skip to content

Add monitoring hooks and harden Triton runtime setup#40

Open
ryanznie wants to merge 6 commits into
mainfrom
feature/monitoring
Open

Add monitoring hooks and harden Triton runtime setup#40
ryanznie wants to merge 6 commits into
mainfrom
feature/monitoring

Conversation

@ryanznie
Copy link
Copy Markdown
Owner

Summary

  • add Prometheus monitoring hooks and a endpoint
  • add monitoring metrics collection for heuristic, model, and fallback paths
  • harden LayoutLMv3 processor loading with local compatibility fallbacks
  • add runtime support for LayoutLMv3 image processing
  • add monitoring and traffic-generation documentation

Testing

  • python3 -m py_compile app.py src/api.py src/inference.py
  • python3 -m py_compile scripts/generate_traffic.py
  • exercised Docker/Triton startup iteratively during integration

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Mar 29, 2026

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  .
  app.py
Project Total  

This report was generated by python-coverage-comment-action

@ryanznie ryanznie self-assigned this Apr 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant