Skip to content

Rework results directory

Douglas Raillard requested to merge github/fork/douglas-raillard-arm/custom_results_base into master

The current behavior relies on TestEnv being initialized once per lisa-test command. This will create a results_dir directory that will be used by all tests. The default argument wipe=True does not wipe this folder since it is ignored after the first TestEnv is created. Unfortunately, this has a number of downsides: TestEnv are sharing a results_dir that is supposed to be private. It makes it harder to map files to the test they belong to. The shared state in TestEnv also means the trace events are initialized once per lisa-test command, so the first test in alphabetical order will get its required events but it will be a gamble for the following tests.

The fix consists in limiting the shared state to the target attribute and closely related attributes. The rest of TestEnv is now initialized properly for every test, including a new results directory base on the name of the test. The base folder containing all the tests' results directory can be specified with -o lisa-test option.

close #316 (closed)

Merge request reports