- Open Access
- Open Peer Review
Measurement properties of self-report pedestrians’ road crossing behavior questionnaires constructed based on the theory of planned behavior: protocol for a systematic review
Systematic Reviews volume 8, Article number: 192 (2019)
Pedestrians’ unsafe crossing behavior exposes them at risk of trauma and death and puts a tremendous burden on the health care system. The theory of planned behavior (TPB) is one of the leading theoretical models used to develop pedestrians’ road crossing behavior questionnaires, yet the quality of measurement properties of them has not been evaluated. The aim of the proposed systematic review is to evaluate the quality of measurement properties of the questionnaires constructed based on the TPB to predict pedestrians’ road crossing behavior.
We will include studies validating or evaluating one or more psychometric properties of the self-reported questionnaire employing the TPB for predicting pedestrians’ road crossing behavior. A comprehensive search strategy will be formulated based on the components of review aim. The databases of MEDLINE, Embase, PubMed, Cochrane Library, PsycINFO, PsycARTICLES, and ProQuest, also grey literature and the reference lists of the included studies, will be searched. A hand search for the relevant journals and Google Scholar will be conducted. COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) Risk of Bias checklist will be used to evaluate the measurement properties of the included questionnaires. First, we will assess standards for the methodological quality of each study. Then, each scale or subscale of a questionnaire will be rated using the updated criteria for good measurement property. We will quantitatively pool or qualitatively summarize the results and will evaluate them against the criteria for good measurement properties. Finally, we will grade the pooled or summarized evidence using the GRADE (Grading of Recommendations, Assessment, Development, and Evaluation) approach and provide recommendations for the most appropriate instrument.
The proposed systematic review will evaluate the measurement properties of self-report pedestrians’ road crossing behavior questionnaires constructed based on the TPB. The findings will help researchers in selecting the appropriate TPB-based instrument for pedestrians’ road crossing behavior.
Systematic review registration
Pedestrian injuries and deaths should be considered as a growing public health problem [1,2,3]. Pedestrians are amongst the most vulnerable road users globally, accounting for 23% of the world’s road accident deaths in 2018 . Unsafe road crossing behavior exposes them to risk of trauma and death and imposes a heavy burden on the health care system [5, 6]. The United Nations (UN) recommends governments to pay more attention to vulnerable road users such as pedestrians, by making proper policies and practices for pedestrian safety . The high rate of pedestrian injury and mortality highlights the importance of an urgent call for evidence-based health education and safety promotion programs . Nevertheless, research and interventions to improve pedestrian safety are still unsatisfactory [4, 9, 10].
Ensuring appropriate targets for intervention , the theory-driven interventions are more effective than interventions lacking theory [10,11,12]. The theory of planned behavior (TPB) developed by Ajzen  is one of the most frequently applied social-psychological models and helps health professionals to identify key beliefs to develop appropriate health behavior change intervention [11, 14, 15]. A number of researchers have used the TPB to predict pedestrians’ intention to cross the road in a potentially hazardous situation [16,17,18,19,20,21,22,23,24]. The TPB renders an authoritative framework for conceptualization, measurement, and identifying issues affecting behavior . The TPB argues that behavioral intention and perceived behavioral control (PBC) are proximal predictors of actual behavior and is determined by its three basic constructs, including attitude toward the behavior, subjective norms, and PBC [14, 22]. In order to measure intention, it is necessary to measure its predictors. These predictors are latent variables and should be measured indirectly through a questionnaire response .
Development of a valid and reliable questionnaire as a measurement instrument is a very critical point, particularly in social-psychological and health-related behavior research. Due to some confusing issue and diverse views about the operationalization of the TPB, particularly for non-psychologist researchers, Ajzen , Francis et al. , Fishbein and Ajzen , Conner and Norman , and Godin and Kok  proposed some sort of guidelines for constructing the TPB-based questionnaire to help the researchers in developing a valid and reliable tool. In developing a TPB-based questionnaire, initial qualitative study, the wording of questions, response formats, and scoring should be considered as essential steps . Different questionnaires based on the TPB have been used to measure pedestrians’ road crossing intention/behavior worldwide [16,17,18,19,20,21,22,23,24, 30]. To what extent these questionnaires enjoy satisfactory measurement properties (MPs) is unknown. COSMIN (COnsensus-based Standards for the selection of health Measurement Instruments) initiative, is an international multidisciplinary team of researchers which has provided a new updated modular tool for conducting a systematic review of patient-reported outcome measures (PROMs) and evaluating the outcome measurement instruments . COSMIN methodology uses the word patient but, the target population could be not the patient. In this study, the target population is pedestrian, and the outcome measure is the pedestrians’ road crossing behavior. So, here the capital letter P in the PROMs represents pedestrian instead of patient or in general let us say, participant. Systematic reviews of PROMs provide an overall understanding of the MPs of PROMs to select the most suitable PROM for a certain objective . An initial search conducted within the Cochrane Database of Systematic Reviews, PubMed\MEDLINE, and PROSPERO indicates that the only systematic review for evaluating the quality of TPB-based questionnaires and their development processes has been conducted by Oluka et al. in 2014, regardless of concentration on a specific subject like pedestrian behavior . Since there are no current or underway systematic reviews on the topic, a systematic review is needed and reasonable to identify, appraise, summarize, and compare the quality of MPs of available self-reported TPB-based questionnaires predicting pedestrians’ road crossing intention or behavior.
So the aim of the proposed systematic review is to evaluate the quality of MPs of the questionnaires constructed based on the theory of planned behavior (TPB) to predict pedestrians’ road crossing intention/behavior by using the updated COSMIN methodology. The following specific objectives will be achieved by the proposed systematic review.
To identify the existing TPB-based questionnaires predicting pedestrians’ road crossing intention or behavior
To evaluate the methodological quality of the included studies
To assess the quality of MPs
To grade the overall quality of evidence
To provide recommendation on the most suitable questionnaires
A multidisciplinary research team which consists of the following members prepared this protocol and will conduct the main review: MM, a full professor in Health Education & Promotion, is an expert in the theory of planned behavior. SP, a Ph.D. candidate of Health Promotion, concentrated in pedestrian injury prevention and safety promotion. AK, an associate professor of Health Service Management, is an expert in systematic review methodology and measurement instruments. HS is an associate professor of Epidemiology specialist in the field of Statistical Modeling concentrated in Injury Prevention and Safety Promotion. He is also a lecturer of the JBI (Joanna Briggs Institute) Database of Systematic Reviews and Implementation Reports. FS, a Ph.D. candidate of Health Information Management, is a skilled librarian, specialist in systematic search, a member of National Research Center for Evidence-Based Medicine, and also a member of JBI and lecturer of systematic search strategies and systematic review.
This protocol has been registered in the International Prospective Register of Systematic Review (PROSPERO): CRD42017047793. We followed recommendations of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) statement  and the COSMIN for conducting a systematic review of PROMs . The first version of COSMIN  only provided “standards” that concern study design and statistical methods used to assess the methodological quality of the MPs. We will use the last version of COSMIN methodology  which also developed “criteria” that concerns the quality of PROM and provides gold standards for good MPs. The COSMIN methodology was originally developed to use for the PROMs which are used for evaluative purposes, but it is applicable for predictive application, as suggested by its developers . A PRISMA-P checklist for this protocol is available in Additional file 1.
The following four key elements of a systematic review of PROMs will be used to formulate eligibility criteria:
The construct of the study is pedestrian road crossing behavior. By road crossing behavior, we mean both safe and unsafe road crossing behavior, but not railroad crossing behavior. The first one keeps them safe from collision with road vehicles, and the second one has the potential of collision with road vehicles and subsequently could lead to injury and even death.
Population of interest
We will consider studies that have included pedestrians of any age.
Type of instrument
We will consider primary studies that have presented pedestrian self-reported TPB-based questionnaire to predict road crossing behavior or intention.
We will consider studies that have reported on MPs concerning the content validity including face validity, structural validity, consistency, cross-cultural validity or measurement invariance, reliability, measurement error, hypothesis testing, and responsiveness.
We will include original studies that have employed the TPB as a theoretical framework for predicting pedestrians’ road crossing intention or behavior, where the study is a validation study or evaluating one or more psychometric properties of the self-reported questionnaire. We will not consider any restrictions on the type of population or participants, geographical location, language, setting, and time. Although we will not restrict the search strategy to the type of language, we will include only articles written in English. The non-English studies will be reported merely to inform readers about the existence of such questionnaires .
The exclusion criteria will be as follows: (1) full-text not available, (2) duplicate publications or sub-studies of included research, and (3) studies that only use self-reported TPB-based questionnaire as an outcome measurement instrument.
Pertinent keywords obtained from the preliminary search were tested and verified by a qualified reviewer (FS). The agreed keywords based on the main components of the review aim and consistent with the inclusion criteria will be used to formulate the search strategy which consists of a comprehensive set of search terms including index terms and free text words for:
Construct of interest: road crossing behavior
Population of interest: pedestrians
Measurement properties: content validity including face validity, structural validity, consistency, cross-cultural validity or measurement invariance, reliability, measurement error, hypothesis testing, and responsiveness
Type of instrument: self-reported TPB-based questionnaire
The Ovid MEDLINE® search strategy will be tailored to other databases. Two librarians (FS and FA) will help to formulate search strategy and then do search independently. The PRESS checklist for MEDLINE and Embase databases will be filled up by a medical librarian (Z F), who is an expert in a systematic review, and at the same time, she does not cooperate with the team. A draft search strategy for Ovid MEDLINE® is provided in Table 1.
We will conduct an electronic search through the following bibliographic databases: MEDLINE (via Ovid), Embase, PubMed, Cochrane Library, PsycINFO (via EBSCO), PsycARTICLES (via EBSCO), and ProQuest. We will also search grey literature and will check the reference lists of the included studies. The databases of SCOPUS and Web of Science will be used for citation tracking to include the articles which have cited the included articles if they meet the inclusion criteria. Along with electronic search, we will fulfill a hand search for the relevant journals like Transportation Research Part F: Traffic Psychology and Behavior, and Accident analysis; and Google Scholar.
We will export the results of database searches to EndNote reference management software (VX6) to manage records during the review and remove duplicate references.
Two independent reviewers (SP, MM) will screen the title and then abstracts of the retrieved articles. If they meet the inclusion criteria, reviewers will read the full texts and assess them against the inclusion criteria. They will scan the reference lists of included studies to ensure literature saturation. In the case of any disagreement, the reviewer will discuss for clarification and resolution. If they could not reach a consensus, a third party (AK) will arbitrate. We will calculate inter-rater-agreement using Cohen’s κ to verify the level of agreement between two reviewers. Justification for the excluded articles will be provided. A PRISMA flow diagram will demonstrate included and excluded studies as depicted in Additional file 2 .
Assessment of methodological quality
The COSMIN Risk of Bias (RoB) checklist will be used by two independent reviewers (SP, MM) to evaluate the MPs of the included PROMs. The COSMIN RoB checklist contains ten boxes to assess required standards for good methodological quality of single studies included in systematic reviews in terms of design requirements and statistical methods/analysis [35, 37]. We will first determine which MPs are assessed in each article to complete the corresponding box of COSMIN RoB checklist for that MP. Content validity (CV) is the most important MP because it makes clear if the items of the PROM are relevant, comprehensive, and comprehensible regarding the construct of interest and study population. So, as a general procedure, we will first evaluate PROM development and CV (boxes 1 and 2, respectively) . If the PROM has sufficient CV, in the second step, we will assess the internal structure of the PROMs, including first, structural validity, followed by internal consistency, and cross-cultural validity or measurement invariance (boxes 3, 4, and 5 respectively) . Otherwise, we will exclude it from the review. This step will be done if the PROM is based on a reflective model (i.e., a scale or subscale manifests itself in the items of one underlying construct). Two types of measures can be applied in the TPB model to predict intention and direct and indirect measures. The indirect measures are formative and the direct measures are reflective indicators of attitude, subjective norm, and perceived behavioral control respectively. Some researchers use only direct measures and some use both. Lastly, we will evaluate the remaining MPs including reliability, measurement error, hypotheses testing for construct validity, and responsiveness (boxes 6–7 and 9–10 respectively) . Criterion validity (box 8)  will not be assessed because there is no gold standard for predicting pedestrians’ road crossing behavior. As such, we will not use part a of box 10 for assessing responsiveness which is based on criterion approach. We will use parts b, c, and d of the box 10 for assessing responsiveness which based on the construct approach assesses hypotheses testing by comparison with other outcome measurement instruments, between subgroups, and before and after the intervention if it is the case .
For the evaluation of each MP of the TPB-based pedestrian behavior, first, we will assess standards for the methodological quality of each study on MP using the corresponding COSMIN RoB checklist and applying a 4-point rating scale: very good, adequate, doubtful, and inadequate. The worst score count principal (i.e., taking the lowest score) will be employed to achieve the overall rating of the methodological quality of every single study on MP. Then, each scale or subscale of a PROM will be rated using the updated (gold) criteria for good MP as sufficient (+), insufficient (−), or indeterminate (?)  (Fig. 1).
We will extract the data on characteristics of the PROM(s), on characteristics of the included sample(s), on results of the MPs, and on interpretability and feasibility. This information will be presented in overview tables . The characteristics of the included PROMs will consist of the name of the PROMs, reference to the PROM development article, constructs being measured, language and study population for which the PROM was developed, intended context of use, available language version of the PROM, number of scales or subscales, number of items, response options, and recall period. The characteristics of the populations will consist of the geographical location, language, target population, sample size, age, gender, and setting . We will contact the authors of included studies if we need any further information for clarification or obtaining missing data.
Using information taken by data extraction tables, if the results of different studies for a given MP are consistent, we will quantitatively pool, otherwise, qualitatively summarize them. The pooled or summarized results of the MP will be reported in Summary of Finding (SoF) tables  and will again be evaluated against the gold criteria for good MPs to get an overall rating as sufficient (+), insufficient (–), inconsistent (±), or indeterminate (?). Unlike the evaluation of the MP studies, the focus here is on the PROM itself, not on the single study. To be confident how the overall ratings are trustworthy, we will apply a modified GRADE (Grading of Recommendations, Assessment, Development, and Evaluation) approach for grading the pooled or summarized evidence as high, moderate, low, or very low (Fig. 1). Using the modified GRADE approach, we will consider four factors: risk of bias, inconsistency, imprecision, and indirectness to downgrade the quality of evidence ranging from one to three levels when the trustworthiness of the results is problematic . Risk of bias refers to the methodological quality of the studies, inconsistency concerns the unexplained discrepancy of the results between studies, imprecision refers to low sample size, and indirectness means that the populations, interventions, or outcomes of the evidence differ from what the review interested in . Imprecision, due to not being a matter of concern for CV, will not be considered for grading the quality of CV. COSMIN RoB checklists and detailed instructions on rating each standard are described elsewhere .
Developing recommendations to use
Finally, we will classify the included questionnaires into one of the three groups:
Group “A” recommended for use and results of them would be trusted (i.e., questionnaires with sufficient content validity evidence and at least low evidence for sufficient internal consistency). Group “B” has the potential to recommend, but additional research is needed to reassess the quality of them (i.e., the questionnaires classified not in group “A” or group “C”). Group “C” will not recommend for use because there is strong evidence for an insufficient MP .
The proposed systematic review will identify and evaluate self-report questionnaires that expected to predict pedestrians’ road crossing behavior. Such a review has not been done before. The findings will reveal the existing self-report pedestrians’ road crossing behavior questionnaires constructed based on the TPB and will show the overall quality of evidence and provide recommendation for researchers to identify and select the most appropriate instrument to predict pedestrians’ road crossing intention/behavior and to determine their underlying beliefs of attitude, subjective norms, and perceived behavioral control.
Availability of data and materials
Not applicable (this is a systematic review protocol so there are no primary data available).
COnsensus-based Standards for the selection of health Measurement Instruments
Elton B. Stephens Co
Excerpta Medica database
Grading of Recommendations, Assessment, Development, and Evaluation
Medical Literature Analysis and Retrieval System Online
Perceived behavioral control
International Prospective Register of Systematic Reviews
Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols
Patient-reported outcome measures
Psychological Information Database
Risk of bias
Summary of findings
Theory of planned behavior
Stoker P, Adkins A, Ewing R. Pedestrian safety and public health. In: Walking. edn. p. 211–29.
Chakravarthy B, Lotfipour S, Vaca FE. Pedestrian injuries: emergency care considerations. Cal J Emerg Med. 2007;8(1):15.
Organization WH: Pedestrian safety: a road safety manual for decision-makers and practitioners. 2013.
WHO: Global status report on road safety 2018. 2018.
Ding T, Wang S, Xi J, Zheng L, Wang Q. Psychology-based research on unsafe behavior by pedestrians when crossing the street. Adv Mech Eng. 2015;7(1):203867.
Peden M, Scurfield R, Sleet D, Mohan D, Hyder AA, Jarawan E, Mathers CD. World report on road traffic injury prevention. In: World Health Organization Geneva; 2004.
United Nations: Improving global road safety, resolution adopted by the General Assembly on 15 April 2016. 2016.
Sminkey ML. Global Plan for the Decade of Action for Road Safety 2011-2020. In: World Health Organization www who int/roadsafety/decade_of_action; 2011.
Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. 2010;29(1):1.
Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res. 2010;12(1):e4.
Glanz K, Rimer BK, Viswanath K: Health behavior and health education: theory, research, and practice, 4th edn: John Wiley & Sons; 2008.
Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull. 2007;133(4):673.
Ajzen I. The theory of planned behavior. Organ behav Hum Decis Process. 1991;50(2):179–211.
Francis JJ, Johnston M, Eccles MP, Grimshaw J, Kaner EF. Measurement issues in the theory of planned behaviour: a supplement to the manual for constructing questionnaires based on the theory of planned behaviour. Newcastle: Centre for Health Services Research; 2004.
Epton T, Norman P, Harris P, Webb T, Snowsill FA, Sheeran P: Development of theory-based health messages: three-phase programme of formative research. Health promotion international 2014:dau005.
Dıaz EM. Theory of planned behavior and pedestrians’ intentions to violate traffic regulations. Transport Res Part F: Traffic Psychol Behav. 2002;5(3):169–75.
Evans D, Norman P. Understanding pedestrians’ road crossing decisions: an application of the theory of planned behaviour. Health Educ Res. 1998;13(4):481–9.
Evans D, Norman P. Predicting adolescent pedestrians’ road-crossing intentions: an application and extension of the Theory of Planned Behaviour. Health Educ Res. 2003;18(3):267–77.
Holland C, Hill R. The effect of age, gender and driver status on pedestrians’ intentions to cross the road in risky situations. Accid Anal Prev. 2007;39(2):224–37.
Holland C, Hill R. Gender differences in factors predicting unsafe crossing decisions in adult pedestrians across the lifespan: a simulation study. Accid Anal Prev. 2010;42(4):1097–106.
Zhou H, Romero SB, Qin X. An extension of the theory of planned behavior to predict pedestrians’ violating crossing behavior using structural equation modeling. Accid Anal Prev. 2015.
Zhou R, Horrey WJ. Predicting adolescent pedestrians’ behavioral intentions to follow the masses in risky crossing situations. Transportation research part F: traffic psychology and behaviour. 2010;13(3):153–63.
Zhou R, Horrey WJ, Yu R. The effect of conformity tendency on pedestrians’ road-crossing intentions in China: an application of the theory of planned behavior. Accid Anal Prev. 2009;41(3):491–7.
Wang L, Gou J, Zou Q. The Analysis of Pedestrian Violations Based on the Revised TPB (Theory of Planned Behavior). In: LISS 2013. edn.: Springer; 2015: 1181-1186.
Ajzen I. Constructing a TPB questionnaire: Conceptual and methodological considerations; 2002.
Francis JJ, Eccles MP, Johnston M, Walker A, Grimshaw J, Foy R, Kaner EF, Smith L, Bonetti D. Constructing questionnaires based on the theory of planned behaviour. In: A manual for health services researchers; 2004.
Fishbein M, Ajzen I. Predicting and changing behavior: the reasoned action approach: Taylor & Francis; 2011.
Conner M, Norman P. Predicting health behaviour: McGraw-Hill Education (UK; 2005.
Godin G, Kok G. The theory of planned behavior: a review of its applications to health-related behaviors. Am J Health Promot. 1996;11(2):87–98.
Jalilian M, Mostafavi F, Mahaki B, Delpisheh A, Rad GS. An application of a theory of planned behaviour to determine the association between behavioural intentions and safe road-crossing in college students: perspective from Isfahan, Iran. JPMA. 2015;65(7):742–6.
Prinsen CA, Mokkink LB, Bouter LM, Alonso J, Patrick DL, De Vet HC, Terwee CB. COSMIN guideline for systematic reviews of patient-reported outcome measures. Qual Life Res. 2018;27(5):1147–57.
Oluka OC, Nie S, Sun Y. Quality assessment of TPB-based questionnaires: a systematic review. PloS One. 2014;9(4):e94419.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1):1.
Mokkink LB, Prinsen C, Patrick DL, Alonso J, Bouter LM, de Vet HC, Terwee CB, Mokkink L. COSMIN methodology for systematic reviews of patient-reported outcome measures (PROMs). User Manual. 2018;78:1.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, Bouter LM, de Vet HC. COSMIN checklist manual. Amsterdam: University Medical Center; 2012.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.
Mokkink LB, De Vet HC, Prinsen CA, Patrick DL, Alonso J, Bouter LM, Terwee CB. COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures. Qua Life Res. 2018;27(5):1171–9.
Terwee CB, Prinsen C, Chiarotto A, de Vet H, Bouter LM, Alonso J, Westerman MJ, Patrick DL, Mokkink LB: COSMIN methodology for assessing the content validity of PROMs–user manual. 2018.
We thank Dr. Caroline B Terwee, the founder of the COSMIN initiative, for her assistance in reviewing the manuscript and making valuable comments on it.
This study protocol, and subsequent systematic review, is a part of a Ph.D. project. Funding is provided by the Social Development & Health Promotion Research Center, Gonabad University of Medical Sciences, Gonabad, Iran. The funder had no involvement in the study design, writing the manuscript, or submitting for publication.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.