Skip to content

ci: add GitHub Actions workflow to run tests on PRs#99

Open
mrshu wants to merge 1 commit intoevaleval:mainfrom
mrshu:mrshu/auto-test-trigger
Open

ci: add GitHub Actions workflow to run tests on PRs#99
mrshu wants to merge 1 commit intoevaleval:mainfrom
mrshu:mrshu/auto-test-trigger

Conversation

@mrshu
Copy link
Copy Markdown
Contributor

@mrshu mrshu commented Apr 6, 2026

Previously no CI workflow ran pytest on pull requests, so regressions could land undetected. This adds a test.yml workflow triggered on PRs and pushes to main.

  • Split into three parallel jobs: core, inspect, helm
  • Core job runs tests that need no optional dependencies
  • Inspect and HELM jobs install their respective extras
  • Follows the same uv/setup-uv pattern as regenerate_types.yml

Closes #88

@mrshu mrshu force-pushed the mrshu/auto-test-trigger branch from 7a61a37 to 9cd77ab Compare April 6, 2026 16:22
Previously no CI workflow ran pytest on pull requests, so
regressions could land undetected. This adds a test.yml
workflow triggered on PRs and pushes to main.

- Split into three parallel jobs: core, inspect, helm
- Core job runs tests that need no optional dependencies
- Inspect and HELM jobs install their respective extras
- Pin action versions to match regenerate_types.yml
- Add timeout-minutes: 10 to guard against hung jobs
- Update uv.lock

Closes evaleval#88
@mrshu mrshu force-pushed the mrshu/auto-test-trigger branch from 9cd77ab to 7f66665 Compare April 6, 2026 16:23
@mrshu
Copy link
Copy Markdown
Contributor Author

mrshu commented Apr 6, 2026

@nelaturuharsha not sure if this is what you had in mind -- happy to update it in any way you'd prefer!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Expand test-suite and add automatic trigger for running it on PRs

1 participant