Table 2 Quality of Study Reporting using the Strengthening the Reporting of Empirical Simulation Studies (STRESS) guidelines—System Dynamics Guidelines (STRESS-SD)
From: System dynamics models of depression at the population level: a scoping review
Section, item, and recommendation | Patten 2002 [26] | Tam 2020a [27] | Tam 2020b [28] | Tandon 2021 [29] |
|---|---|---|---|---|
1. Objectives | ||||
1.1 Explain the background and rationale for the model | Yes | Yes | Yes | Yes |
1.2 Describe all outcome variables that are reported. Include details on how they are calculated during the model run | Yes | Yes | Yes | Somewhat. Does not specify numeric output of stocks in the model. Unclear which stocks are related to outcome |
1.3 If the model has been used for policy analysis (user-designed experiments) and policy formulation (multiple experiments to obtain best policy), state the research questions that it was used to answer | Yes | NA | Yes | Yes |
1.3 a.) Policy based analysis—Provide a name and description of each policy tested, providing a rationale for the choice of policies and parameters employed | Yes | NA | Yes | Yes |
1.3 b.) Design of experiments—Provide details of the design and the parameters that will be used | Yes | NA | Yes | Yes |
1.3 c.) Simulation Optimisation—Provide full details of what is to be optimised and the parameters that will be included and the algorithm that will be used | NA | NA | Yes | Yes |
2. Logic | ||||
2.1 Base model overview diagram. Provide one or more causal loop, stock and flow (a.k.a level and rate) or equivalent diagrams to describe the basic logic of base model to readers | Yes | Yes | Yes | No |
2.2 Base model logic. Give details of the base model logic in terms of feedback loops | Yes | Yes | Yes | Yes |
2.3 Scenario logic. Give details of the logical difference between the base case model and policies, scenarios and experiments | Yes | NA | Yes | Yes |
2.4 Algorithms. Provide detail on any algorithms, functions or equations that mimic complex or manual processes in the real world | Yes | Yes | Yes | NA |
2.5 Components | ||||
2.5.1 Stocks/Levels. Give details of all stocks within the simulation including a description of their role in the model | Yes | Yes | Yes | Yes |
2.5.2 Flows/Rates. List all flows within the model along with units and equations. Describe the role of flows in the model e.g. if they have a delay | Yes | Yes | Yes | Somewhat. Does not include units |
2.5.3 Constants/Converters/Auxilliary. List all variables within the model and detail their equations (if applicable) including units | Yes | Yes | Yes | NA |
2.5.4 Graphical Functions / lookup tables. List and detail all graphical functions within the model and describe their data sources | NA | NA | NA | NA |
2.5.5 Sources / sinks. Give details of the model boundaries i.e. all infinite sources and sinks within the model | Yes | Yes | Yes | No |
3. Data | ||||
3.1 Data sources. List and detail all data sources | Yes | Yes | Yes | No, does not detail data sources |
3.2 Pre-processing. Provide details of any data manipulation that has taken place before its use in the simulation | Yes | NA | NA | NA |
3.3 Input parameters. List of all input variables in the model, provide a description of its use and include parameter values | Yes | Yes | Yes | Yes |
3.4 Where data or knowledge of the real system is unavailable what assumptions are included in the model? | Yes | Yes | Yes | Unclear |
4. Experimentation | ||||
4.1 Initialization. List all initial stocks and auxiliary variables within the model | Yes | Yes | Yes | No |
4.2 Run length. Describe the run length of the simulation model and time units | Yes | Yes | Yes | Unclear |
4.3 Estimation approach | Yes | Yes | Yes | Yes |
5. Implementation | ||||
5.1 Software or programming language. State the operating system and version and build number | NA | Yes | Yes | No |
5.2 Random sampling. State the algorithm used to generate random samples with in the software/programming language used | NA | Yes | Yes | NA |
5.3 Model execution. Report the integration method used along with time step settings | Yes | Yes | Yes | No |
5.4 System specification. State the model run time and specification of hardware used | No | No | No | No |
6. Code access | ||||
6.1 Computer model sharing statement. Describe how someone could obtain the model described in the paper, the simulation software and any other associated software (or hardware) needed to reproduce the results | Yes | Yes | Yes | No |