Crashing tests in 1.2.0 release

[mdmitry1]

Reproduction

1. Create regression script

mkdir -p ~/shared
echo 'cd smlp/tests/smlp_regression && env -u DISPLAY ./run_smlp_regression && tcsh -f' ~/shared/regression.sourceme
chmod +x ~/shared/regression.sourceme

2. Run regression script

#!/usr/bin/tcsh
set cmd=`echo docker run -v $HOME/shared:/shared -it smlp-test-build-ubuntu_24.04-python311-system bash -c '"source /shared/regression.sourceme"'`
set run_script=/tmp/docker_run_${USER}_$$
echo $cmd > $run_script
chmod +x $run_script
cat $run_script
$run_script

3. After regression script finishes withing docker container:

• Change directory to regression area:

cd ../../regr_smlp/code

• Run script

#!/usr/bin/env bash
for f in $(grep -l "Executing run_smlp.py script: Start" *.txt); do
    echo "$f $(grep -c 'Executing run_smlp.py script: End' "$f")"
done | grep -Ev ' 1$'

Test104_smlp_toy_num_resp_mult.txt 0
Test107_smlp_toy_num_resp_mult.txt 0
Test145_doe_two_levels_opt.txt 0
Test146_explore_doe_two_levels.txt 0
Test205_doe_two_levels_opt.txt 0

4. Run crashed tests one by one and collect error messages

python3.11 ./smlp_regr.py -t 104 -p | sed 's@../../src/run_smlp.py@smlp@' | grep ^smlp | source /dev/stdin |& tail -1

Exception: Knobs ['p1', 'p2'] are not assigned constant values as part of specification, in "verify" mode: aborting...

python3.11 ./smlp_regr.py -t 107 -p | sed 's@../../src/run_smlp.py@smlp@' | grep ^smlp | source /dev/stdin | & tail -1

Exception: Beta constraints are not supported in "verify" mode: aborting...

python3.11 ./smlp_regr.py -t 145 -p | sed 's@../../src/run_smlp.py@smlp@' | grep ^smlp | source /dev/stdin | & tail -1

Exception: DOE levels grid file ../grids/doe_two_levels_opt.csv does not eist

python3.11 ./smlp_regr.py -t 146 -p | sed 's@../../src/run_smlp.py@smlp@' | grep ^smlp | source /dev/stdin | & tail -1

Exception:` DOE levels grid file ../grids/explore_doe_two_levels.csv does not eist

python3.11 ./smlp_regr.py -t 205 -p | sed 's@../../src/run_smlp.py@smlp@' | grep ^smlp | source /dev/stdin | & tail -1

Exception: DOE levels grid file ../grids/doe_two_levels_opt.csv does not eist

[fbrausse]

Tests 104 and 107 are expected to fail. They are sanity checks.

[fbrausse]

The others, 145, 146 and 205 produce the same result for me.

[fbrausse]

The others, 145, 146 and 205 produce the same result for me.

Coincidentally, these are the only tests that specify the -doe_spec option with a concrete path. They have -mode optimize, too. All other tests (finally) using -doe_spec on the command line do so by adapting the second column (data) in smlp_regr.csv. So I'm suspecting either:

1. The -doe_spec option is actually not required for those tests.
2. The .csv file format describing the regression tests is not enough for those 3 tests.

@zurabksmlp Do you have any insights regarding those 3 tests?