Problem
Tests pass in CI but fail using the make run-tests command locally.
CI uses the REMOTE_CLUSTER_CONTEXT=kind-skv2-test-remote PATH="$(pwd)/_output/.bin:$PATH" go test ./... to run tests and all the tests pass, but make run-tests uses a ginkgo command and different tests fail every time.
This is likely because make run-tests randomizes the test execution order and the CI command doesn't.
Desired Outcomes
- Update the command that CI and/or make use to be the same and include execution order randomization.
- Make sure
make run-tests succeeds when run locally
Problem
Tests pass in CI but fail using the
make run-testscommand locally.CI uses the
REMOTE_CLUSTER_CONTEXT=kind-skv2-test-remote PATH="$(pwd)/_output/.bin:$PATH" go test ./...to run tests and all the tests pass, butmake run-testsuses a ginkgo command and different tests fail every time.This is likely because
make run-testsrandomizes the test execution order and the CI command doesn't.Desired Outcomes
make run-testssucceeds when run locally