Proposal: develop a standard, automated method for generating most of the standard 140 reports. Most of the data, including plots, can be automatically generated. The exception are the explanations given by the modelers in the modeler's report.
To enable this, the following is proposed:
- Develop a Jupyter notebook which will serve as the test suite runner.
- Jupyter notebook will serve as the project interface.
- The modeler will specify the test suite configurations here. e.g. OS SHA, E+ SHA, etc.
- The modeler will execute the test from the notebook.
- Plots will be reported to the notebook.