Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,7 +102,7 @@ pwsh actions/Invoke-OSAction.ps1 -Describe run-unit-tests

## Runner Types

Workflows distinguish between standard GitHub-hosted images and integration runners with preinstalled tooling. See [docs/runner-types.md](docs/runner-types.md) for a detailed comparison.
Workflows distinguish between standard GitHub-hosted images and integration runners with preinstalled tooling. See [docs/runner-types.md](docs/runner-types.md) for a detailed comparison. Administrators can update runner metadata without a pull request by following the [Update Runner Runtime guide](docs/update-runner-runtime.md).

## Testing

Expand Down
4 changes: 2 additions & 2 deletions artifacts/linux/summary-standard.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
### Test Summary
| OS | Passed | Failed | Skipped | Duration (s) | Pass Rate (%) |
| --- | --- | --- | --- | --- | --- |
| overall | 60 | 0 | 0 | 24.77 | 100.00 |
| linux | 60 | 0 | 0 | 24.77 | 100.00 |
| overall | 60 | 0 | 0 | 17.37 | 100.00 |
| linux | 60 | 0 | 0 | 17.37 | 100.00 |

_For detailed per-test information, see [traceability-standard.md](traceability-standard.md)._
4 changes: 2 additions & 2 deletions artifacts/linux/summary.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
### Test Summary
| OS | Passed | Failed | Skipped | Duration (s) | Pass Rate (%) |
| --- | --- | --- | --- | --- | --- |
| overall | 60 | 0 | 0 | 24.77 | 100.00 |
| linux | 60 | 0 | 0 | 24.77 | 100.00 |
| overall | 60 | 0 | 0 | 17.37 | 100.00 |
| linux | 60 | 0 | 0 | 17.37 | 100.00 |

### Requirement Summary
| Requirement ID | Description | Owner | Total Tests | Passed | Failed | Skipped | Pass Rate (%) |
Expand Down
80 changes: 40 additions & 40 deletions artifacts/linux/traceability-standard.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,19 +4,19 @@

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-023 | parses-nested-junit-structures | Passed | 0.012 | | |
| REQ-023 | parses-nested-junit-structures | Passed | 0.009 | | |

#### REQ-024 (100% passed)

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-024 | captures-root-testsuites-attributes | Passed | 0.011 | | |
| REQ-024 | captures-root-testsuites-attributes | Passed | 0.005 | | |

#### REQ-025 (100% passed)

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-025 | captures-testsuite-attributes | Passed | 0.008 | | |
| REQ-025 | captures-testsuite-attributes | Passed | 0.005 | | |

#### REQ-026 (100% passed)

Expand All @@ -28,7 +28,7 @@

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-027 | captures-testcase-attributes-and-skipped-message | Passed | 0.002 | | |
| REQ-027 | captures-testcase-attributes-and-skipped-message | Passed | 0.005 | | |

#### REQ-028 (100% passed)

Expand All @@ -46,7 +46,7 @@

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-030 | builds-traceability-matrix-with-skipped-reasons | Passed | 0.002 | | |
| REQ-030 | builds-traceability-matrix-with-skipped-reasons | Passed | 0.001 | | |

#### REQ-031 (100% passed)

Expand All @@ -64,60 +64,60 @@

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| REQ-033 | throws-error-for-malformed-xml | Passed | 0.002 | | |
| REQ-033 | throws-error-for-malformed-xml | Passed | 0.001 | | |

<details><summary>Unmapped (100% passed)</summary>

| Requirement | Test ID | Status | Duration (s) | Owner | Evidence |
| --- | --- | --- | --- | --- | --- |
| Unmapped | associates-classname-with-requirement | Passed | 0.013 | | |
| Unmapped | buildissuebranchname-formats-branch-name | Passed | 0.002 | | |
| Unmapped | associates-classname-with-requirement | Passed | 0.016 | | |
| Unmapped | buildissuebranchname-formats-branch-name | Passed | 0.001 | | |
| Unmapped | buildissuebranchname-rejects-non-numeric-input | Passed | 0.001 | | |
| Unmapped | buildprofile1.iconeditor.addtokentolabview.dispatcher.dry-runs-add-token-to-labview-with-expected-arguments- | Passed | 0.482 | | |
| Unmapped | buildprofile1.iconeditor.applyvipc.dispatcher.dry-runs-apply-vipc-with-expected-arguments- | Passed | 0.042 | | |
| Unmapped | buildprofile1.iconeditor.buildvipackage.dispatcher.dry-runs-build-vi-package-with-expected-arguments- | Passed | 0.106 | | |
| Unmapped | buildprofile1.iconeditor.closelabview.dispatcher.dry-runs-close-labview-with-expected-arguments- | Passed | 0.036 | | |
| Unmapped | buildsummary-splits-totals-by-os | Passed | 0.001 | | |
| Unmapped | collecttestcases-captures-requirement-property | Passed | 0.011 | | |
| Unmapped | collecttestcases-uses-evidence-property-and-falls-back-to-directory-scan | Passed | 0.009 | | |
| Unmapped | collecttestcases-uses-machine-name-property-for-owner | Passed | 0.008 | | |
| Unmapped | computestatuscounts-tallies-test-statuses | Passed | 0.001 | | |
| Unmapped | detects-downloaded-artifacts-path | Passed | 1.280 | | |
| Unmapped | collecttestcases-captures-requirement-property | Passed | 0.014 | | |
| Unmapped | collecttestcases-uses-evidence-property-and-falls-back-to-directory-scan | Passed | 0.014 | | |
| Unmapped | collecttestcases-uses-machine-name-property-for-owner | Passed | 0.009 | | |
| Unmapped | computestatuscounts-tallies-test-statuses | Passed | 0.000 | | |
| Unmapped | detects-downloaded-artifacts-path | Passed | 0.902 | | |
| Unmapped | dispatchers-and-parameters-include-descriptions | Passed | 0.003 | | |
| Unmapped | errors-when-strict-unmapped-mode-enabled | Passed | 1.369 | | |
| Unmapped | errors-when-strict-unmapped-mode-enabled | Passed | 0.874 | | |
| Unmapped | escapemarkdown-escapes-special-characters | Passed | 0.002 | | |
| Unmapped | escapemarkdown-leaves-plain-text-untouched | Passed | 0.000 | | |
| Unmapped | fails-when-commit-lacks-requirement-reference | Passed | 1.427 | | |
| Unmapped | fails-when-requirement-lacks-test-coverage | Passed | 1.607 | | |
| Unmapped | fails-when-tests-are-unmapped | Passed | 1.243 | | |
| Unmapped | fails-when-tests-reference-unknown-requirements | Passed | 1.286 | | |
| Unmapped | fails-without-runner-metadata | Passed | 0.861 | | |
| Unmapped | fails-when-commit-lacks-requirement-reference | Passed | 0.982 | | |
| Unmapped | fails-when-requirement-lacks-test-coverage | Passed | 1.125 | | |
| Unmapped | fails-when-tests-are-unmapped | Passed | 0.888 | | |
| Unmapped | fails-when-tests-reference-unknown-requirements | Passed | 0.929 | | |
| Unmapped | fails-without-runner-metadata | Passed | 0.654 | | |
| Unmapped | formaterror-handles-plain-objects | Passed | 0.000 | | |
| Unmapped | formaterror-handles-primitives | Passed | 0.001 | | |
| Unmapped | formaterror-handles-real-error-objects | Passed | 0.004 | | |
| Unmapped | formaterror-handles-primitives | Passed | 0.000 | | |
| Unmapped | formaterror-handles-real-error-objects | Passed | 0.006 | | |
| Unmapped | formaterror-handles-unstringifiable-values | Passed | 0.001 | | |
| Unmapped | generate-ci-summary-features | Passed | 0.037 | | |
| Unmapped | groups-owners-and-includes-requirements-and-evidence | Passed | 1.620 | | |
| Unmapped | grouptomarkdown-omits-numeric-identifiers | Passed | 0.007 | | |
| Unmapped | grouptomarkdown-supports-optional-limit-for-truncation | Passed | 0.001 | | |
| Unmapped | generate-ci-summary-features | Passed | 0.034 | | |
| Unmapped | groups-owners-and-includes-requirements-and-evidence | Passed | 1.038 | | |
| Unmapped | grouptomarkdown-omits-numeric-identifiers | Passed | 0.002 | | |
| Unmapped | grouptomarkdown-supports-optional-limit-for-truncation | Passed | 0.003 | | |
| Unmapped | handles-root-level-testcases | Passed | 0.001 | | |
| Unmapped | handles-zipped-junit-artifacts | Passed | 1.056 | | |
| Unmapped | ignores-stale-junit-files-outside-artifacts-path | Passed | 1.163 | | |
| Unmapped | loadrequirements-logs-warning-on-invalid-json | Passed | 0.008 | | |
| Unmapped | loadrequirements-merges-multiple-files | Passed | 0.010 | | |
| Unmapped | loadrequirements-warns-and-skips-invalid-entries | Passed | 0.005 | | |
| Unmapped | logs-a-warning-when-no-junit-files-are-found | Passed | 1.281 | | |
| Unmapped | partitions-requirement-groups-by-runner\_type | Passed | 1.036 | | |
| Unmapped | passes-with-coverage-and-requirement-reference | Passed | 1.508 | | |
| Unmapped | handles-zipped-junit-artifacts | Passed | 0.734 | | |
| Unmapped | ignores-stale-junit-files-outside-artifacts-path | Passed | 0.769 | | |
| Unmapped | loadrequirements-logs-warning-on-invalid-json | Passed | 0.018 | | |
| Unmapped | loadrequirements-merges-multiple-files | Passed | 0.005 | | |
| Unmapped | loadrequirements-warns-and-skips-invalid-entries | Passed | 0.010 | | |
| Unmapped | logs-a-warning-when-no-junit-files-are-found | Passed | 0.891 | | |
| Unmapped | partitions-requirement-groups-by-runner\_type | Passed | 0.748 | | |
| Unmapped | passes-with-coverage-and-requirement-reference | Passed | 0.892 | | |
| Unmapped | requirementssummarytomarkdown-escapes-pipes-in-description | Passed | 0.001 | | |
| Unmapped | skips-invalid-junit-files-and-still-generates-summary | Passed | 1.681 | | |
| Unmapped | summarytomarkdown-handles-no-tests | Passed | 0.001 | | |
| Unmapped | skips-invalid-junit-files-and-still-generates-summary | Passed | 1.079 | | |
| Unmapped | summarytomarkdown-handles-no-tests | Passed | 0.000 | | |
| Unmapped | summarytomarkdown-sorts-os-alphabetically-and-escapes-special-characters | Passed | 0.001 | | |
| Unmapped | throws-when-no-junit-files-found-and-strict-mode-enabled | Passed | 0.840 | | |
| Unmapped | uses-latest-artifact-directory-when-multiple-are-present | Passed | 1.125 | | |
| Unmapped | warns-when-all-tests-are-unmapped | Passed | 1.550 | | |
| Unmapped | writeerrorsummary-appends-error-details-to-summary-file | Passed | 0.005 | | |
| Unmapped | throws-when-no-junit-files-found-and-strict-mode-enabled | Passed | 0.631 | | |
| Unmapped | uses-latest-artifact-directory-when-multiple-are-present | Passed | 0.760 | | |
| Unmapped | warns-when-all-tests-are-unmapped | Passed | 1.173 | | |
| Unmapped | writeerrorsummary-appends-error-details-to-summary-file | Passed | 0.004 | | |
| Unmapped | writeerrorsummary-skips-summary-file-for-non-error-throws | Passed | 0.004 | | |
| Unmapped | writes-outputs-to-os-specific-directory | Passed | 1.985 | | |
| Unmapped | writes-outputs-to-os-specific-directory | Passed | 1.447 | | |

</details>
Loading
Loading