Table 3 Summary of findings

SAGAT (Dishman 2020)

Content validity

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Sufficient

Moderate ^c

SAGAT (Gardner 2017)

Content validity

Criterion validity

Relevance + 

Comprehensiveness –

Comprehensibility –

SA significantly predicted teamwork ratings (first scenario R2 = 0.50; second scenario R2 = 0.55)

Inconsistent

Sufficient

Very Low ^{a, c}

Very Low ^{a, c}

SAGAT (Lavoie 2016)

Content validity

Internal consistency

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Cronbach’s alpha rating for total scale: 0.64

Sufficient

Insufficient

Moderate ^a

Very Low ^a

SAGAT (Hogan 2006)

Content validity

Internal consistency

Hypothesis Testing

Relevance –

Comprehensiveness + 

Comprehensibility –

Cronbach’s alpha rating for total scale: 0.76

Hypothesis confirmed

Inconsistent

Indeterminate

Indeterminate

Very Low ^{a, c}

Very Low ^{a, c}

Very Low ^{a, c}

Unnamed (O'Neill 2018)

Content validity

Criterion validity

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Area under the curve and Correlation not reported

Sufficient

Indeterminate

Low ^a

Not evaluated

TSAGAT

Content validity

Hypothesis Testing

Relevance –

Comprehensiveness + 

Comprehensibility + 

Hypothesis confirmed

Inconsistent

Sufficient

Low ^a

Very Low ^a

Unnamed (Frere 2017)

Content validity

Internal consistency

Relevance –

Comprehensiveness –

Comprehensibility –

Cronbach’s alpha rating ≥ 0.7

Insufficient

Sufficient

Low ^{a, c}

Moderate ^c

NOTSS

Content validity

Structural validity

Internal consistency

Criterion validity

Hypothesis Testing

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Confirmatory factor analysis demonstrated an acceptable model fit RMSEA: 0.094–0.213; Comparative fit index: 0.554–0.944; χ2/d.f: 1.69–4.55; Multidimensional scale (4 subscales)

Cronbach’s alpha rating for total scale from 0.7 to 0.95

Area under the curve and Correlation not reported

3 out of 4 Hypotheses confirmed

Sufficient

Inconsistent

Inconsistent

Indeterminate

Sufficient

Moderate ^c

Moderate ^b

Moderate ^b

Not evaluated

Moderate ^b

NoTSUS

Content validity

Criterion validity

Relevance –

Comprehensiveness –

Comprehensibility –

Correlation of the NoTSS and NoTSUS scores: 0.88–0.93

Insufficient

Sufficient

Low ^{a, c}

Moderate ^c

ANTS

Content validity

Internal consistency

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Cronbach’s alpha for situation awareness subscale: 0.87

Cronbach’s alpha rating for total scale from 0.79 to 0.86

Sufficient

Sufficient

Moderate ^c

Low ^{a, c}

ANTS-AP

Content validity

Internal consistency

Reliability

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Cronbach’s alpha for situation awareness subscale: 0.78

Interclass Correlation Coefficient for situation awareness subscale: 0.54

Sufficient

Sufficient

Insufficient

Moderate ^c

Low ^{a, c}

Low ^{a, c}

T-NOTECHS

Content validity

Reliability

Relevance + 

Comprehensiveness –

Comprehensibility + 

Interclass Correlation Coefficient for situation awareness subscale: 0.87

Interclass Correlation Coefficient for total scale: 0.71

Inconsistent

Sufficient

Very Low ^{a, c}

Very Low ^{a, c}

NOTECHS

Content validity

Reliability

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Interclass Correlation Coefficient not reported

Sufficient

Indeterminate

Very Low ^{a, c}

Not evaluated

NOTECHS II

Content validity

Hypothesis Testing

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Hypothesis confirmed

Sufficient

Sufficient

Very Low ^{a, c}

Very Low ^{a, c}

ICARS

Content validity

Internal consistency

Hypothesis Testing

Relevance + 

Comprehensiveness + 

Comprehensibility + 

Cronbach’s alpha rating for total scale: 0.92

Hypothesis confirmed

Sufficient

Sufficient

Sufficient

Very Low ^{a, c}

Moderate ^c

Moderate ^c

EPOC

Content validity

Measurement error

Hypothesis Testing

Relevance + 

Comprehensiveness –

Comprehensibility –

Measurement error not reported

Hypothesis confirmed

Inconsistent

Indeterminate

Sufficient

Very Low ^a

Not evaluated

Moderate ^a

SPLINTS

Content validity

Internal consistency

Reliability

Hypothesis Testing

Relevance + 

Comprehensiveness + 

Comprehensibility –

Cronbach’s alpha for situation awareness subscale: 0.7

Interclass Correlation Coefficient for total scale: 0.85

Hypothesis confirmed

Inconsistent

Sufficient

Sufficient

Sufficient

Very Low ^a

Low ^c

Very Low ^{a, c}

Very Low ^{a, c}

Ottawa GRS

Content validity

Internal consistency

Relevance –

Comprehensiveness –

Comprehensibility –

Cronbach’s alpha not reported

Insufficient

Indeterminate

Very Low ^{a, c}

Not evaluated