- Open Access
- Open Peer Review
Systematic review of effectiveness of universal self-regulation-based interventions and their effects on distal health and social outcomes in children and adolescents: review protocol
Systematic Reviewsvolume 6, Article number: 175 (2017)
Growing evidence suggests that childhood and adolescence self-regulation contributes to multiple health, educational and social outcomes. Considering the potential impact of self-regulation skills on improved life chances in conjunction with evidence suggesting that self-regulation can be modified by interventions, there is a need to identify interventions which are most effective in improving childhood and adolescence self-regulation. The present systematic review was designed to determine the effectiveness of universal interventions focused on enhancing the self-regulation of children and adolescents. As secondary outcomes, we will also examine the effectiveness of such interventions on distal health and social outcomes.
Eligible studies include randomised controlled trials (including cluster randomised trials) reporting on universal interventions designed to improve self-regulation in childhood and adolescence (age 0–19 years). The following databases will be searched for peer-reviewed publications using an iterative search strategy: Medline, PsycINFO, EMBASE, ERIC, CINAHL Plus, British Education Index, Child Development & Adolescent Studies and CENTRAL without applying language or date filters. Additionally, reference lists and citations of included studies will be searched for eligible studies. A 10% proportion of the total titles and abstracts will be randomly selected and screened independently by two reviewers (AP and DH). Results will be compared to ensure less than 5% discrepancy, followed by screening of all results by one reviewer (AP). Full-text review and data collection will be independently performed by two reviewers. Any discrepancies will be solved by mutual discussion, and if unresolved, a third reviewer (RV) will be consulted. Meta-analysis will be conducted to quantify trial effects, if the data is sufficiently homogenous to allow quantitative synthesis. Otherwise, results will be described narratively.
The evidence derived from the systematic review will strengthen the evidence base to inform planning of effective interventions targeting self-regulation skills in childhood and adolescence. This will benefit policy makers, academicians, researchers, health professionals, and also, young people who will benefit from policy and interventions informed by this review.
Systematic review registration
Self-regulation, also known as self-control, encompasses a range of competencies including capacity for controlling emotions, positive interactions with others, avoiding inappropriate or aggressive actions, and becoming a self-directed learner . The cognitive components of self-regulation, referred to as executive function, includes the ability to direct attention, shift perspective, and adapt flexibly to changes (cognitive flexibility), retain information (working memory), and inhibit automatic or impulsive responses in order to achieve a goal such as problem solving (impulse control) [2, 3].
Evidence suggests that self-regulation skills can be a powerful predictor of positive health, educational, financial and social outcomes. Positive effects on a range of outcomes have been reported including school readiness, academic achievement, healthy behaviour, physical and mental health outcomes [4,5,6,7]. Conversely, poor self-regulation has been linked to adverse outcomes like health risk behaviours, psychiatric disorders, substance dependence, crime and unemployment [8,9,10,11,12]. Self-regulation is considered to be a malleable skill which can be shaped by environment, thus making it an important target for interventions [13, 14]. Children and adolescents are an important target group for such interventions considering the potential long-term benefits of positive health and social outcomes in this group. Though interventions to target self-regulation skills in childhood and adolescence are in their infancy, they have demonstrated potential for modification of self-regulation [15,16,17]. It is vital to recognise the nature of interventions that are most effective in improving self-regulation skills and thus impact outcomes in multiple domains.
No review has summarised the effectiveness of self-regulation interventions on health and social outcomes in children and adolescents, with previous systematic reviews restricted to specific populations or age-groups [18, 19]. Further, reviews have not examined the effects of interventions on distal health and social outcomes. With this background, we propose to conduct a systematic review with the objective of assessing the effectiveness of self-regulation-based interventions in improving self-regulation in children and adolescents. As a secondary objective, we also intend to study the effectiveness of such interventions in improving various health and social outcomes. We are interested in all potential effects of such interventions and shall include all reported outcomes of such interventions from eligible studies.
What is the effectiveness of universal self-regulation-based interventions to improve self-regulation skills and distal health and social outcomes in children and adolescents?
The review protocol is reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) guidance, which can be found in Additional file 1.
Our review will be restricted to studies on human participants. Studies will be eligible for inclusion if they report on children and/or adolescents (0–19 years). In cases where studies include participants beyond this age, the study will be included only if the median/mean age group of study participants falls within the 0–19 year range.
In order to be included in the review, studies should explicitly state that it includes intervention designed to improve self-regulation. It may be the only intervention or a part of a package of multiple interventions. Under this criterion, self-regulation (or a related-term) must be mentioned in the title or key sentences describing the nature of the intervention.
Only universal interventions (interventions targeted to entire group of children and/or adolescents, not having or identified as having risk of any medical/behavioural disorder) intended to improve self-regulation shall be included for the review.
Interventions designed to improve self-regulation may vary by the type of activity (classroom-based activities, presentations or exercises), content, settings (school based, out of school, community based etc.) format (face to face or online), delivery methods (one to one or group), child based/parent based and intensity (in terms of length and frequency).
There will be no exclusion based on the type, format, settings and intensity of intervention.
We will include studies which compare self-regulation interventions with those receiving usual care, wait-listed groups, groups receiving no intervention or an intervention unrelated to self-regulation.
Studies will be included if they report at least one child-/adolescent-based outcome measure related to self-regulation skills. This may include self-regulation skills as reported by teachers, educational administrators, study subjects (self-reported), parents, and/or researchers (subjective measures) as well as task performance-based measures indicated by objective measures.
We are interested in outcomes that are related to health and social parameters. However, we are also interested in understanding the different outcomes resulting from self-regulation skills and therefore our search strategy will not be limited by outcomes. The secondary outcomes may include, but might not be limited to health and social outcomes such as school readiness, academic achievement, physical health, mental health, employment, income and substance abuse.
Types of studies
Our review will be restricted to randomised (including cluster randomised) controlled trials of interventions.
Original research manuscripts published in peer-reviewed journals will be included. There will be no exclusion on the basis of study country; however, we will only include studies published in English. We shall not apply limits on the date of publication.
We developed the search strategy after a number of initial scoping searches, with input from experts in the field. The strategy was further refined following a series of test searches and the discussion of the results among the review team. We designed our search strategy to include a list of terms, including controlled vocabulary terms for various databases to capture all variations within each of the three categories: population, intervention and study design). Since we are interested in all outcomes, no filters will be applied for outcomes. A published search filter (Cochrane 2008 Highly Sensitive Search Strategy) will be used for the section of the search strategy pertaining to study design . We will search the following electronic databases: Medline, PsycINFO, Excerpta Medica Database (EMBASE) via OVID; Education Resources Information Center (ERIC), Cumulative Index to Nursing and Allied Health Literature (CINAHL), PLUS, British Education Index, Child Development & Adolescent Studies via EBSCO and Cochrane Controlled Trials Register (CENTRAL) without applying language or date filters. The detailed search strategy for each database is available in Additional file 2. A preliminary search in July 2016 yielded the following results: (Medline, n = 4538; PsycINFO, n = 5703; EMBASE, n = 5425; ERIC, n = 1592; CINAHL PLUS = 1112; British Education Index, n = 88; Child Development and adolescent studies, n = 707; and Cochrane, n = 2432). We will import the search results into EPPI-Reviewer 4 software, which will be used throughout the review to store and manage records. An updated search will be carried out, and additionally, we shall also search reference lists and citations of included articles for eligible studies.
Study selection process
Titles and abstracts will be screened to identify studies eligible for full-text review based on predefined eligibility criteria. A 10% proportion of the total titles and abstracts will be randomly selected and screened independently by two reviewers (AP and DH), followed by screening of all results by one reviewer (AP). Screening results by both reviewers for subsample screening will be compared to ensure if there is agreement on at least 95% titles and abstracts (Kappa more than 0.7). If there is lack of agreement on more than 5%, the entire sample will be rescreened by both reviewers following a training on review protocol. Full-text papers of studies fulfilling eligibility criteria on title and abstract screening will be obtained. Full-text articles of eligible studies will be assessed independently by two reviewers (AP and DH) against the study inclusion criteria. Articles that do not fulfil the eligibility criteria would be allotted an exclusion justification code and excluded. If there are discrepancies regarding study inclusion among the reviewers, it will be solved by consensus or by a third reviewer (RV), if necessary. If the study details are not sufficient to determine eligibility, corresponding authors will be contacted for further details. If such details are not available, the study will be deemed ineligible. Review authors will not be blinded to author name, institution or journal title.
Data extraction and quality assessment
Data will be extracted using pre-piloted data extraction forms (see Table 1). Two reviewers (AP and DH) will independently extract data regarding the study participants, characteristics of intervention and its evaluation and do quality assessment. Any discrepancy in data extraction will be resolved by mutual consensus.
Quality assessment of included studies will be done by assessing the studies with regards to selection bias, study design, confounders, blinding, data collection methods, withdrawals and drop outs, intervention integrity and analyses using the Effective Public Health Practice Project (EPHPP) Quality Assessment Tool For Quantitative Studies , which is a validated tool for quality assessment.
Attempts will be made to resolve disagreements on quality assessment by two reviewers through discussion and consensus. If there is no agreement, a third reviewer (RV) will be consulted.
Data synthesis and analysis
Detailed information about included studies will be extracted independently by two review authors (AP and DH) regarding the characteristics of study participants, interventions and its evaluation. Data will be assessed for intervention effects in terms of change in self-regulation and other health and social outcomes. If there are multiple points of measurements, then intervention effects will be reported as short term (<1 year) or long term (>1 year). If there are multiple follow-up assessments, the data from the final trial endpoint fulfilling age eligibility will be used.
Quantitative data would be extracted and wherever sufficient data is available, odds ratio (for categorical outcome data) or standardised mean differences/Cohen’s d (for continuous data) and their 95% confidence intervals will be calculated from the extracted data from each included randomised controlled trial. Multiple papers of the same study would be coded as related studies. If needed and deemed appropriate, data will be combined as a single study for inclusion in meta-analysis.
Meta-analysis will be performed using random effects model if the data is sufficiently homogenous. Separate meta-analysis will be conducted for each outcome if enough information is available to conduct such analysis. To assess heterogeneity, we will calculate I 2 statistic and visually inspect forest plots. If heterogeneity exists, the sources of heterogeneity will be investigated and sub-group analysis will be conducted. If quantitative synthesis is not possible, a narrative review will be presented.
Issues of clustering
It is likely that in some of the cluster randomised trials, effects of clustering might not be adjusted in the original studies. In such situations, intra-class correlations will be requested from corresponding authors. If such information is not available, estimates will be obtained from similar studies and generic inverse variance approach would be used to combine their results.
This review will aid in building an evidence base for the effectiveness of self-regulation interventions in children and adolescents. Self-regulation has sparked policy interest internationally, as a part of ongoing search to define abilities that predict success and better life chances. Identifying interventions that demonstrate a potential for modification of self-regulation in childhood and adolescence will provide an opportunity to better inform the development of interventions for this group to potentially promote health and social outcomes in child and adolescent populations. The review will be useful to policy makers, academicians, researchers and health professionals who are interested in such interventions. The review will also identify any gaps in the existing evidence to provide direction for future research.
Given the complex nature of the construct of self-regulation and the lack of a uniform definition, we expect that there will be inconsistency in the studies in defining and measuring self-regulation. We will take this variability into account when combining results and interpreting them. Also, issues of unit of analysis will be taken into account while combining data from randomised and cluster randomised studies.
Cochrane central register of controlled trials
Cumulative index to nursing and allied health literature
Excerpta Medica Database
Education Resources Information Center
Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols
Randomised controlled trial
Bronson MB. Recognizing and supporting the development of self-regulation in young children. Young Children. 2000;55(2):32–7.
Early Childhood Development. In World Bank Group, editors. World Development Report 2015: Mind, Society, and Behavior [Internet]. Washington, DC: World Bank; 2014 [cited 11 July 2017]. Available from: https://elibrary.worldbank.org/doi/book/10.1596/978-1-4648-0342-0.
Hughes C, Ensor R. Individual differences in growth in executive function across the transition to school predict externalizing and internalizing behaviors and self-perceived academic success at 6 years of age. J Exp Child Psychol. 2011;108(3):663–76.
Moffitt TE, Arseneault L, Belsky D, Dickson N, Hancox RJ, Harrington H, Houts R, Poulton R, Roberts BW, Ross S, Sears MR, Thomson WM, Caspi A. A gradient of childhood self-control predicts health, wealth, and public safety. Proc Natl Acad Sci U S A. 2011 Feb 15;108(7):2693–8.
Bierman KL, Nix RL, Greenberg MT, Blair C, Domitrovich CE. Executive functions and school readiness intervention: impact, moderation, and mediation in the head start REDI program. Dev Psychopathol. 2008;20(3):821–43. doi: 10.1017/S0954579408000394.
Duckworth AL, Tsukayama E, May H. Establishing causality using longitudinal hierarchical linear modeling: an illustration predicting achievement from self-control. Social Psychol Personality Sci. 2010;1(4):311–7. doi: 10.1177/1948550609359707.
Galla BM, Duckworth AL. More than resisting temptation: beneficial habits mediate the relationship between self-control and positive life outcomes. J Pers Soc Psychol. 2015;109(3):508–25. doi: 10.1037/pspp0000026.
Bogg T, Roberts BW. Conscientiousness and health behaviors: a meta-analysis. Psychol Bull. 2004;130:887–919.
Caspi A, Moffitt TE, Newman DL, Silva PA. Behavioral observations at age 3 years predict adult psychiatric disorders. Longitudinal evidence from a birth cohort. Arch Gen Psychiatry. 1996;53:1033–9.
Pahl K, Brook JS, Lee JY. Adolescent self-control predicts joint trajectories of marijuana use and depressive mood into young adulthood among urban African Americans and Puerto Ricans. J Behav Medi. 2014;37(4):675–82. doi: 10.1007/s10865-013-9518-5.
Gottfredson M, Hirschi T. A general theory of crime. Palo Alto: Stanford Univ Press; 1990.
Daly M, Delaney L, Egan M, Baumeister RF. Childhood self-control and unemployment throughout the lifespan: evidence from two British cohort studies. Psychol Sci. 2015;26(6):709–23. doi: 10.1177/0956797615569001.
Blair C. Stress and the development of self-regulation in context. Child Dev Perspec. 2010;4(3):181–8. doi: 10.1111/J.1750-8606.2010.00145.X.
Blair C, Raver CC. School readiness and self-regulation: a developmental psychobiological approach. Ann Rev Psychol. 2015;66:711–31. doi: 10.1146/annurev-psych-010814-015221.
Brotman LM, Dawson-McClure S, Calzada EJ, et al. Cluster (school) RCT of ParentCorps: impact on kindergarten academic achievement. Pediatrics. 2013;131(5):e1521–9. doi: 10.1542/peds.2012-2632.
Raver CC, Jones SM, Li-Grining C, Zhai F, Bub K, Pressler E. CSRP’s impact on low-income preschoolers’ preacademic skills: self-regulation as a mediating mechanism. Child Dev. 2011;82(1):362–78. doi: 10.1111/j.1467-8624.2010.01561.x.
Flook L, Goldberg SB, Pinger L, Davidson RJ. Promoting prosocial behavior and self-regulatory skills in preschool children through a mindfulness-based kindness curriculum. Dev Psychol. 2015;51(1):44–51. doi: 10.1037/a0038256.
Varela W, Abrami P, Upitis R. Self-regulation and music learning: a systematic review. Psychol Music. 2014;44(1):55–74.
Piquero AR, Jennings WG, Farrington DP. Self-control interventions for children under age 10 for improving self-control and delinquency and problem behaviors. Campbell Systematic Rev. 2010;2:9–26. doi:10.4073/csr.2010.2.
Lefebvre C, Manheimer E, Glanville J. Chapter 6: Searching for studies. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley; 2008. p. 97–147. doi:10.1002/9780470712184.ch6.
Tools| EPHPP. http://www.Ephpp.Ca/Tools.Html ephpp.Ca. 2016 Accessed 26 Sep 2016
The Policy Research Unit in the Health of Children, Young People, and Families (CPRU) is funded by the Department of Health Policy Research Programme. This is an independent report commissioned and funded by the Department of Health. The views expressed are not necessarily those of the department. We also thank members of the CPRU: Terence Stephenson, Catherine Law, Ruth Gilbert, Miranda Wolpert, Amanda Edwards, Steve Morris, Helen Roberts and Catherine Shaw.
This is an independent report commissioned and funded by the Policy Research Programme in the Department of Health.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.