Cause Model Template

Important

To begin documenting a cause in GBD 2019 for a Vivarium simulation, start by following these steps (after you have created a new git branch to work in):

  1. Make a subdirectory cause_name/ in the folder gbd2019/causes/ , where cause_name is replaced with the (potentially shortened) name of the cause you are modeling, such as measles/ or neonatal_encephalopathy/. This subdirectory is where you will put all the files for your cause model documentation, including this document, image files, .csv files, etc.

  2. Copy this template into your subdirectory and rename it index.rst.

  3. Replace the internal hyperlink target .. _2019_cause_model_template: at the top of this file with a unique reference label for your cause. The reference label should have the form .. _2019_cause_{cause_name}:, where {cause_name} is replaced with a unique descriptive name or abbreviation for your cause, e.g. .. _2019_cause_measles:.

  4. Delete this document’s title above:

    --------------------
    Cause Model Template
    --------------------
    

    Once the above title is deleted, all the other section titles will be promoted up one level.

  5. The subtitle below should now be the document’s title. Replace the text in the below (sub)title with the full name of your cause in GBD 2019. For example, if you were modeling the cause “Neonatal encephalopathy due to birth asphyxia and birth trauma,” then the title

    ==============================
    Full Name of Cause in GBD 2019
    ==============================
    

    should be replaced by

    ==============================================================
    Neonatal encephalopathy due to birth asphyxia and birth trauma
    ==============================================================
    

    Note: Be sure to adjust the length of the title’s underline ====== and overline ====== to match the length of your new document title, or you will get errors in the section structure when Sphinx builds HTML from the index.rst file.

  6. Once you complete these steps, delete this .. important:: directive from index.rst.

Todo for template development

Make it clear what content and structure we are looking for in this document. In particular:

  • In Pull Request 93 @James suggested the following high-level organization:

    Operationally, a useful way to think about what these documents are laying out is

    1. An overview of what experts in the world think about the cause

    2. An overview of what GBD thinks about the cause

    3. A modeling strategy that synthesizes 1 & 2 into a coherent simulation model with enough detail to both implement it and to reason about how it will behave.

    These 3 content categories correspond to the following 3 sections below:

    I think the introductory paragraph for the document should indicate that this is how the document is organized, and I think the Todo’s in each section should expand on what this means.

  • I have begun to reorganize the template to use the following document layout, also suggested by @James in Pull Request 93:

    =====
    Title
    =====
    
    Summary paragraph describing what's in the document.
    
    .. contents::
       :local:
       :depth: 1
    
    Section 1
    ---------
    
    Section overview
    
    Subsection 1.1
    ++++++++++++++
    
    Subsection contents.
    
    Etc.
    

    The template should guide the reader to follow this general layout. In particular, I added Todo’s for adding overviews of the document and the three sections, but perhaps a better strategy would be to actually write template overviews to put in this document.

Full Name of Cause in GBD 2019

Todo

Add a brief introductory paragraph for this document.

Abbreviations

Abbreviation

Definition

Note

Todo

Fill out table with any abbreviations and their definitions used in this document.

Disease Overview

Todo

Add a general clinical overview of the cause.

Todo for template development

Note: This custom admonition indicates tasks to do while we write this template, whereas the ordinary Todo’s (and the “Important” directives) are intended to remain in the template to instruct the cause modeler how to fill out the cause model document.

  • In the above todo box, add more details about what we’re looking for in cause descriptions, such as:

    • Useful external data sources

    • note to flesh out how this cause kills or causes disability among the with condition

    • Important features of the cause (vaccine coverage, is it a progressive disease, etc.)

    • Links to other prominent mathematical models of the cause if they exist (e.g. @yongqx found like 40 different versions of tb models).

  • Add instructions in other sections, including:

    • Using editable .svg format for figures

    • For cause model diagram: description of what the bubbles and arrows represent. Maybe include svg templates for common diagrams like SI, SIS, SIR, etc.

    • For cause hierarchy: description of our strategy for making cause hierarchy diagrams (rules + example)

    • For data tables: Template tables and instructions for filling them in

    • Expand Todo’s for Vivarium model Scope and Assumptions and Limitations sections, with specific examples and guidelines

    • Add instructions for filling out the GBD Restrictions table

GBD 2019 Modeling Strategy

Todo

Add an overview of the GBD modeling section.

Cause Hierarchy

Restrictions

The following table describes any restrictions in GBD 2019 on the effects of this cause (such as being only fatal or only nonfatal), as well as restrictions on the ages and sexes to which the cause applies.

GBD 2019 Cause Restrictions

Restriction Type

Value

Notes

Male only

Female only

YLL only

YLD only

YLL age group start

YLL age group end

YLD age group start

YLD age group end

Vivarium Modeling Strategy

Todo

Add an overview of the Vivarium modeling section.

Scope

Todo

Describe which aspects of the disease this cause model is designed to simulate, and which aspects it is not designed to simulate.

Assumptions and Limitations

Todo

Describe the clinical and mathematical assumptions made for this cause model, and the limitations these assumptions impose on the applicability of the model.

Cause Model Diagram

State and Transition Data Tables

This section gives necessary information to software engineers for building the model. This section usually contains four tables: Definitions, State Data, Transition Data and Data Sources.

Definitions

This table contains the definitions of all the states in cause model diagram.

State Definitions

State

State Name

Definition

For example, the Definitions table for SIR and With-Condition and Free of Condition Model models are as below:

SIR Model

State Definitions

State

State Name

Definition

S

Susceptible

Susceptible to {cause name}

I

Infected

Infected with {cause name}

R

Recovered

Infected with {cause name}

With-Condition and Free of Condition Model

State Definitions

State

State Name

Definition

C

With Condition

Born with {cause name}

F

Free of Condition

Born without {cause name}

Include states, their names and definitions appropriate to your model.

States Data

This table contains the measures and their values for each state in cause-model diagram. This information is used to initialize the model. The common measures in each state are prevalence, birth prevalence, excess mortality rate and disability weights. Cause specific mortality rate is the common measure for all states. In most of the models either prevalence or birth prevalence is used. But in some rare cases like neonatal models both prevalence and birth prevalence are used in model initialization. The Value column contains the formula to calculate the measure in each state.

The structure of the table is as below. For each state, the measures and values must be included.

States Data

State

Measure

Value

Notes

State

prevalence

State

birth prevalence

State

excess mortality rate

State

disabilty weights

ALL

cause specific mortality rate

An example of SI model with both prevalence and birth prevalence in the initialization is given below to explain better.

States Data

State

Measure

Value

Notes

S

prevalence

1-prevalence_cid

S

birth prevalence

1-birth_prevalence_cid

S

excess mortality rate

0

S

disabilty weights

0

I

prevalence

prevalence_cid

I

birth prevalence

birth_prevalence_cid

I

excess mortality rate

\(\frac{\text{deaths_cid}}{\text{population} \times \text{prevalence_cid}}\)

= (cause-specific mortality rate) / prevalence

I

disability weights

\(\displaystyle{\sum_{s\in \text{sequelae_cid}}} \scriptstyle{\text{disability_weight}_s \,\times\, \text{prevalence}_s}\)

= total disability weight over all sequelae

ALL

cause specific mortality rate

\(\frac{\text{deaths_cid}}{\text{population}}\)

Transition Data

This table contains the measures needed for transition from one state to other in the cause model. The common measures used are incident rate to move from Susceptible to Infected and remission rate to move from Infected to Susceptible or Recovered states. Some times there may not be transition between states as in Neonatal disorders.

The structure of the table is as below.

Transition Data

Transition

Source

Sink

Value

Notes

i

S

I

r

I

R

An example, if the data is present in GBD,

Transition Data

Transition

Source

Sink

Value

Notes

i

S

I

\(\frac{\text{incidence_rate_cid}}{\text{1 - prevalence_cid}}\)

r

I

R

remission_rate_cid

Sometimes, we might need to use modelable entity id to get data. Sometimes, we might need to calculate remission rate based on average case duration. In that case, the row would look like,

Transition Data

Transition

Source

Sink

Value

Notes

r

I

R

remission_rate_cid \(= \frac{\text{365 person-days}}{\text{average case duration in days} \times \text{1 year}}\)

Data Sources

This table contains the data sources for all the measures. The table structure and common measures are as below:

Data Sources

Measure

Sources

Description

Notes

prevalence_cid

birth_prevalence_cid

deaths_cid

population

sequelae_cid

incidence_rate_cid

remission_rate_m1594

disability_weight_s{sid}

prevalence_s{sid}

An example, that contains common sources for the measures,

Data Sources

Measure

Sources

Description

Notes

prevalence_cid

como

Prevalence of cause

birth_prevalence_cid

como

Birth prevalence of cause

deaths_cid

codcorrect

Deaths from cause

population

demography

Mid-year population for given age/sex/year/location

sequelae_cid

gbd_mapping

List of sequelae

incidence_rate_cid/mid

como/dismod

Incidence rate for cause

remission_rate_cid/mid

como/dismod

Remission rate for cause

disability_weight_s{sid}

YLD appendix

Disability weight of sequela with id sid

prevalence_s{sid}

como

Prevalence of sequela with id sid

Validation Criteria

References

Todo

Update references to GBD 2019 once published

GBD-2019-YLD-Appendix-Cause-Model-Template

Pages ???-??? in Supplementary appendix 1 to the GBD 2017 YLD Capstone:

(GBD 2017 YLD Capstone) GBD 2017 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392: 1789–858. DOI: https://doi.org/10.1016/S0140-6736(18)32279-7

GBD-2019-CoD-Appendix-Cause-Model-Template

Pages ???-??? in Supplementary appendix 1 to the GBD 2017 CoD Capstone:

(GBD 2017 CoD Capstone) GBD 2017 Causes of Death Collaborators. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980–2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018; 392: 1736–88. DOI: http://dx.doi.org/10.1016/S0140-6736(18)32203-7

Tip

In the citations above, replace “Pages ???-???” with the correct page numbers for your cause in the two appendices, and replace the Cause-Model-Template suffix in the citation names with the name of your cause. The suffix is necessary because Sphinx requires citation names to be unique throughout the entire documentation.

You can follow the syntax above to add your own references, and you can cite the references such as [GBD-2019-YLD-Appendix-Cause-Model-Template] and [GBD-2019-CoD-Appendix-Cause-Model-Template] from within your text by enclosing the full citation name in brackets and adding a trailing underscore, like this: [Full-Citation-Name]_.

Delete this .. tip:: directive once you fill in the correct page numbers for your cause in the appendices and rename the references appropriately.

Todo for template development

Is there a better solution to the global citation problem than making citation names longer to ensure that they’re unique?

The same “append a suffix” rule would also apply to other common citations like WHO, CDC, UpToDate, and Wikipedia. For example, the WHO citation for Measles would be [WHO-Measles].

In Pull Request 99, we decided to go with the above naming convention for now. But @James said it should be possible to adapt the sphinx builder to resolve citations to the most local level if desired.

Todo for template development

Decide on section names and overall structure.

In Pull Request 93, people seemed generally good with the existing structure, but there were several suggestions for reorganization (in particular from @James and @Beatrix) that I have implemented above.

Here are some of the questions and comments we have discussed so far:

Question: Are the sections in a good order?

In Pull Request 91, @Lu said:

The template looks good to me. I was putting the model assumptions and limitations section right after the cause model diagram. But I think this order makes more sense.

(“This order” referring to: Cause Model Diagram, Data Description, Model Assumptions and Limitations.)

And @Yongquan said:

Model assumptions and/or limitations can be mentioned in summary disease model description and fully explained in Model Assumptions and Limitations section.

Whereas @James said:

I think the restrictions in this section (Model Assumptions and Limitations) should move up to the GBD Modeling section.

Also, perhaps we should have a section following the GBD section called vivarium modeling strategy which would include the scope and the restrictions we apply to the model (which might be different than GBD’s restrictions). To serve as a narrative description accompanying the cause model diagram and data tables.

On the other hand, @Kiran said:

I am good with this structure. But, we have to make changes to the causes that are finished. Also, for restrictions I like it under Assumptions and Limitations section. We can add subsections if there are different types of restrictions.

Question: Do we have examples of restrictions we would apply that are different from GBD restrictions?

See Pull Request 93 for some thoughts on this question from @Ali and @James.

Also, in Pull Request 76, @Beatrix said:

I kind of like Model Assumptions and Limitations before the data description, because i like the idea of going from most high-level to most nitty-gritty as you go through the document. In that schema, in my mind, it would go:

model diagram,
then limitations,
then data description

(as kiran has).

If we wanted the diagram near the tables that reference it (which i also like), what if we did model diagram, then data descriptions, then limitations? to maintain some of the newspaper-style high level —> detailed ordering?