User Tools

Site Tools


battery:addtest

This is an old revision of the document!


The test battery

The test battery is an investigation conducted to verify and validate the recent developments in Lagamine code. This work is in the framework of improving the robustness of the code and going towards Lagamine OPEN.

User guide

Flowchart

The organisation chart of the procedure is presented as follows:

Fig. 1: Test battery flowchart

For the moment, the test battery is installed in “\\obelix\c\Test Battery”.

Requested folders/files

  • The principal python script to run the test battery: Test_battery_launcher.py
  • The file defining the test battery path and the names of the tests in the same folder as the principal python script: Test_battery.txt

Fig. 2: The pricipal script working directory

Fig. 3: Test_battery.txt file

  • The folder containing all the tests:
    • Each test is in a separate folder named with the same name as the test defined in “Test_battery.txt”:
      • The simulation files
      • The reference simulation in a folder with the same name as the test +“_ref”
      • A comparator python script attached to each test and possesses the same name as this test: in this script, the user defines the numerical results to compare and the cost function

Fig. 4: Test_battery.txt file

Output files

  • Local report (attached to the test folder) (name_test.rep):
    • Local error
    • Decision (Success/ Failure): Acceptance value = 0.1% for Mini test and 1% for Big test

Fig. 5: Local report

  • Global report (attached to the principal python script folder) (Report_date.rep):
    • Number of tests
    • Global error
    • List of tests
    • Decision (Success/ Failure): once one test is failed, the whole test battery is failed
    • List of failed tests (if the test battery is failed)

Fig. 6: Global report

Summary

  • To add a new test, the user should:
    • Modify the file Test_battery.txt: add the name of the new test
    • Add the new test in the test battery folder:
      • The files of simulation
      • The reference simulation folder
      • The comparator python script (take an existing script and adapt it with the new test)
battery/addtest.1631189097.txt.gz · Last modified: 2021/09/09 14:04 by ehssen