The impact of oxytocin administration on brain activity: a systematic review and meta-analysis protocol
© The Author(s). 2016
Received: 24 May 2016
Accepted: 16 November 2016
Published: 29 November 2016
Converging evidence demonstrates the important role of the neuropeptide hormone oxytocin (OT) in human behaviour and cognition. Intranasal OT administration has been shown to improve several aspects of social communication, such as the theory of mind performance and gaze to the eye region, and reduce anxiety and related negative cognitive appraisals. While this early research has demonstrated the potential for intranasal OT to treat psychiatric illnesses characterized by social impairments, the neurobiological mechanisms are not well known. Researchers have used functional magnetic resonance imaging (fMRI) to examine the neural correlates of OT response; however, results have been variable and moderating factors are poorly understood. The aim of this meta-analysis is to synthesize data examining the impact of intranasal OT administration on neural activity.
Studies that report fMRI data after intranasal OT administration will be identified. PubMed, Embase, PsycINFO, and Google Scholar databases will be searched as well as the citation lists of retrieved articles. Eligible articles written in English from 2005 onwards will be included in the meta-analysis, and corresponding authors of these papers will be invited to contribute t-maps. Data will be collected from eligible studies for synthesis using Seed-based d Mapping (SDM) or Multi-Level Kernel Density Analysis (MKDA), depending on the number of usable t-maps received. Additionally, publication bias and risk of bias will be assessed.
This systematic review and meta-analysis will be the first pre-registered synthesis of data to identify the neural correlates of OT nasal spray response. The identification of brain regions underlying OT’s observed effects will help guide future research and better identify treatment targets.
Systematic review registration
KeywordsOxytocin Brain imaging Systematic review Meta-analysis Protocol
The neuropeptide oxytocin (OT) has attracted significant scientific and lay interest for its role in social cognition and behaviour [1, 2]. For example, a single administration of OT has been shown to modulate the perception of social cues , motivate in-group cooperation , increase gaze to the eye region of faces , and reduce anxiety [6, 7]. Due to these reported cognitive and behavioural effects, researchers have begun investigating OT’s potential to treat psychiatric conditions, such as autism spectrum disorders, schizophrenia, and social anxiety disorder in a number of clinical trials (for a review, see ).
Although the modulatory effects of OT on social behaviour and cognition have been demonstrated repeatedly [8, 9], the mechanisms are poorly understood [10, 11]. To better elucidate these behavioural and cognitive effects, researchers have investigated the neural correlates of OT’s effects using brain-imaging tools such as functional magnetic resonance imaging (fMRI). Converging evidence from this field suggests the amygdala—a key brain region involved in the processing of emotional  and social stimuli —is an important target of OT administration [14–18]. Although the amygdala has received significant research interest, other areas of the brain have also implicated in OT’s response .
Various methods are available for the meta-analysis of brain-imaging data . Prior research synthesizing OT fMRI data has adopted a meta-analytic approach using effect size signed differential mapping . This approach uses extracted fMRI peak coordinates to create an estimated map of all possible brain region coordinates, which are then synthesized. However, this approach can bias effects of interest estimates where individual studies have reported a relatively high number of peaks when compared to others by chance. Additionally, it is difficult to analyse and interpret the impact of key study design characteristics such as dose and sex using this approach, unless a large number of studies are available. The impact of these problems on effect size-based meta-analysis results is difficult to determine within the existing limitations of the literature; therefore, meta-analysis methods that produce interpretable consistency measures are likely to provide guidance for future experimental investigation in this area. Given this is the ultimate goal, the Multi-Level Kernel Density Analysis (MKDA) coordinate-based approach is suitable  in that it provides clear interpretability and is unbiased by number of within-study peaks (see more details below). However, an updated version of effect size signed differential mapping—Seed-based d Mapping (SDM)—has been released , which can combine reported coordinates and t-maps, which are statistical parametric maps displaying the t statistic after estimation of the experimental parameters of interest for a given study. The t statistic is estimated at each voxel—the small volumetric unit of the statistical parametric map (e.g. 2 mm3)—for the whole brain, which in the context of performing a meta-analysis allows estimation of effect sizes at each voxel. By increasing the number of t-maps entered into the analysis, this approach has increasing sensitivity while reducing false positives . The use of t-maps is preferable, as the inclusion of studies with reported coordinates requires the statistical estimation of unreported voxels. However, this approach relies on the availability of t-maps (e.g. as supplementary material or by direct researcher request). Therefore, if studies have a significant number of usable t-maps available (i.e. which will significantly increase sensitivity and decrease false positives), we will employ SDM in the first instance. Once data is extracted from eligible studies, maps of d values  and their variances are then created for meta-analysis (see below for further synthesis details).
The aim of the present study is to examine the effects of OT administration on human brain activity by synthesizing data from available research studies. This protocol is registered with PROSPERO (CRD42016038781) and has been reported here according to PRISMA-P  guidelines (see Additional file 1). Pre-registration of the analysis protocol will also help avoid potential bias by providing documentation of a priori analysis plans . If protocol amendments are required, the PROSPERO registration will be updated.
Inclusion and exclusion criteria
In this meta-analysis, we will include studies that meet the following criteria: (a) The study measured blood oxygenation level-dependent response using fMRI to assess response after OT administration; (b) the study provides standard Talairach or Montreal Neurological Institute (MNI) coordinates, allowing for comparison of findings; (c) the study includes a placebo comparison group; and (d) the study was written in English. A range of study designs (e.g. crossover, between-subjects) will be considered for inclusion as well as articles from the grey literature (e.g. pre-prints). Study authors will be contacted if any information germane to study inclusion is unclear.
We will conduct a systematic literature search to collect studies that explore the neural effects of OT administration. Searches will be performed in PubMed, Embase, PsycINFO, and Google Scholar with the following combination of terms which were developed in consultation from two academic libraries: (“oxytocin” OR “syntocinon”) AND (“fMRI” OR “brain imaging” OR “functional magnetic resonance imaging” OR “MRI” OR “magnetic resonance imaging”). The search will be limited to articles published from 2005 (first fMRI OT study; 20) onwards. In a second iteration, reference lists within studies will be examined for remaining studies that include the critical measures.
Data extraction and management
Two independent reviewers will independently scan primary titles to select articles for further scrutiny, deleting any duplicate titles. Abstracts of potentially eligible studies will then be read to determine eligibility for coding into a spreadsheet. When the title and abstract cannot be rejected, the full text of the article is obtained and reviewed for inclusion using a coding form. Any disagreements will be adjudicated by a third reviewer. If both reviewers agree that the trial does not meet eligibility criteria, it will be excluded. The two reviewers will then extract data from all eligible studies using a data extraction form. The coding forms will be developed specifically for this study, based on a pilot review, extraction, and calibration of five randomly included studies. Any disagreements regarding data extraction will be solved via discussion with a third reviewer. Data from studies initially selected based on title and abstract and articles included in the review will be documented. Reasons for the exclusion of retrieved articles will also be recorded for eventual documentation in a study search and data extraction flow diagram.
Available coordinates will be extracted from eligible papers and entered into a data collection form. This form will include (a) general information on studies including authors and titles; (b) information about the participants including, gender, age, and physical and mental health status; (c) information about the level the study on other moderator variables, including study type, experimental paradigm, and cognition modality (e.g. visual, auditory); and (d) information concerning study characteristics (e.g. publication year) and the risk of bias measures as defined by the Cochrane risk of bias tool. Corresponding authors from eligible studies will be contacted in order to request and obtain t-maps. In order to review and synthesize studies qualitatively, reported coordinates and peaks from t-maps (if available) will be plotted in MNI space for visualization and discussed in light of the methodologies employed and the authors’ conclusions.
Risk of bias and strength of evidence
The Cochrane risk of bias tool will be used to assess risk of bias . This tool encompasses six domains: selection bias, performance bias, detection bias, attrition bias, reporting bias, and other bias (i.e. bias problems not covered in the other domains). A table describing risk of bias across these domains for each included study will be provided to assess risk of bias within studies, as recommended . The strength of evidence will be assessed and reported using the GRADE system .
SDM is an effect size-based approach that has been used to pool coordinate and t-map data largely from patient and control groups [35, 36]. If SDM is chosen, analysis will be performed using the SDM tool package (http://www.sdmproject.com). Available t-maps are simply converted to effect size d maps, and when only coordinates are available, an unnormalized Gaussian kernel (where a full width at half maximum is set, initially, 20 mm as recommended) is used to estimate effect size of voxels around the peak, which itself can is the only effect size that can be exactly calculated. Here, a random effects model would be implemented and carried out as recommended , as applicable to pooling the identified studies. Each study will be weighted by the inverse of the sum of its variance plus the between-study variance using the DerSimonian-Laird estimator , which gives greater weight to studies with smaller variance or larger sample size. The null hypothesis for SDM is that effect sizes are randomly distributed throughout the brain. Given that different t-maps will be thresholded with different correction methods, a combination of thresholds is recommended. Initially, an uncorrected threshold of p = .005 allows analysis of the robustness and heterogeneity of the findings with increasingly conservative thresholds.
MKDA is a coordinate-based approach that has been previously used to assess the impact of psychopharmacological agents on neural activity . The MKDA statistic reflects the number of nominally independent contrast maps (i.e. statistical parametric maps from individual studies) that activate in the vicinity (e.g. within 10 mm) of each voxel in the brain; the null hypothesis is that the activation “blobs” from individual contrast maps are randomly distributed. Thus, a significant result indicates that more contrast maps activate near a specific voxel than expected by chance. If MKDA is chosen, analyses will be performed in MATLAB, using the MKDA tool package [25; http://wagerlab.colorado.edu/files/tools/meta-analysis.html]. MKDA difference analysis will be conducted to directly contrast the OT and task type conditions. The threshold for statistical significance will be determined using a Monte Carlo simulation (5000 iterations) and provided family-wise error rate correction for multiple comparisons at α < .05 corrected.
With the employment of either primary approach, moderators will also be entered in as covariates in meta-regression analyses. Where applicable, a Jackknife sensitivity analysis—where the same analysis will be repeated excluding one data point at a time—will determine if results are replicable. Given concerns surrounding publication bias in biobehavioural oxytocin research , a funnel plot of meta-analytic peaks will be constructed and analysed in order to determine publication bias in the collected sample as outlined by Egger and co-workers . Moreover, between-study heterogeneity will also be assessed by constructing heterogeneity Q-maps (and corresponding p values). These maps will reveal brain regions that show significant between-study heterogeneity.
Participants. The effects of OT may vary between healthy and clinical populations. Thus, we will examine whether population type acts as a moderator for effect sizes. Furthermore, we will examine whether effect sizes are moderated by gender and age of participants.
Experimental paradigms. These paradigms can vary in studies that investigate the effect of OT on brain activity during tasks. For instance, the primary modality assessed can include visual stimuli, auditory stimuli, and executive function.
OT dosage. While 24IU is the typically administered OT dose, other dosages are occasionally administered. Considering the dose-dependent effects of OT , dosage will be included as a moderator where applicable.
fMRI methodology. The potential moderating effect of imaging package  and field strength will also be investigated.
Year of publication. Early, more preliminary studies may potentially exhibit different effect sizes due to improvements in study methodology or publication bias , so year of publication is included as an additional moderator to potentially assess bias.
There is growing interest in the neural correlates of intranasal OT administration in an effort to better understand its cognitive and behavioural effects. However, there is little consensus on the specific brain regions associated with intranasal OT administration and the impact of moderators such as gender and experimental paradigm. The present protocol describes the first systematic review and meta-analysis of fMRI studies that investigate the impact of intranasal OT. The inclusion of t-map data will provide greater precision than a coordinate-only analysis. The confidence in the body of evidence will also be assessed by measures of study quality and publication bias. Identification of specific brain regions underlying the effects of OT will assist future research and help identify treatment targets.
Functional magnetic resonance imaging
Multi-Level Kernel Density Analysis
Montreal Neurological Institute
Seed-based d Mapping
The authors wish to thank Hege Kristin Ringnes and Magnus Heie Gregersen (University of Oslo Library) for assistance with developing the database search strategy.
The Research Council of Norway (RCN) and OptiNose AS contributed to funding this review through a BIA project grant (219483) via salary support to DSQ and project support to DSQ, OAA, and LTW. TO is supported by an NHMRC Program Grant (APP1073041) awarded to GSM, and LTW is supported by the South-Eastern Norway Regional Health Authority (Grant no. 2014097).
Availability of data and materials
The datasets during and/or analysed during the current study are available from the corresponding author on reasonable request.
DSQ and TO conceived the study idea. DSQ, TO, LTW, GSM, and OAA contributed to the design of the systematic review. DSQ and TO contributed to the data analysis plan. DSQ, TO, LTW, GSM, and OAA contributed to the write-up and editing of the manuscript and approved the final manuscript. DSQ takes responsibility for the contents of the protocol. All authors read and approved the final manuscript.
DSQ, LTW, and OAA are investigators in a project examining the impact of oxytocin administration on social cognition and neural activity supported by the Research Council of Norway (BIA grant: 219483) and OptiNose AS (Oslo, Norway). GSM has received grant or research support from AstraZeneca, Eli Lilly & Co., Organon, Pfizer, Servier, and Wyeth; has been a speaker for AstraZeneca, Eli Lilly & Co., Janssen Cilag, Lundbeck, Pfizer, Ranbaxy, Servier, and Wyeth; and has been a consultant for AstraZeneca, Eli Lilly & Co., Janssen Cilag, Lundbeck, and Servier. OAA has received speaker’s honoraria from GSK, Lundbeck, and Otsuka. The funders and/or partner had no influence in the ideas contained in the manuscript and no role in the writing of the manuscript. TO has no competing interests to declare.
Consent for publication
Ethics approval and consent to participate
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Guastella AJ, Einfeld SL, Gray KM, Rinehart NJ, Tonge BJ, Lambert TJ, Hickie IB. Intranasal oxytocin improves emotion recognition for youth with autism spectrum disorders. Biol Psychiatry. 2010;67(7):692–4.View ArticlePubMedGoogle Scholar
- Kosfeld M, Heinrichs M, Zak PJ, Fischbacher U, Fehr E. Oxytocin increases trust in humans. Nature. 2005;435(7042):673–6.View ArticlePubMedGoogle Scholar
- Quintana DS, Westlye LT, Rustan ØG, Tesli N, Poppy CL, Smevik H, Tesli M, Røine M, Mahmoud RA, Smerud K, et al. Low dose oxytocin delivered intranasally with Breath Powered Device affects social-cognitive behavior: a randomized 4-way crossover trial with nasal cavity dimension assessment. Transl Psychiatry. 2015;5(e601):1–9.Google Scholar
- De Dreu CKW, Greer LL, Van Kleef GA, Shalvi S, Handgraaf MJJ. Oxytocin promotes human ethnocentrism. Proc Natl Acad Sci. 2011;108(4):1262–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Guastella AJ, Mitchell PB, Dadds MR. Oxytocin increases gaze to the eye region of human faces. Biol Psychiatry. 2008;63(1):3–5.View ArticlePubMedGoogle Scholar
- Hall SS, Lightbody AA, McCarthy BE, Parker KJ, Reiss AL. Effects of intranasal oxytocin on social anxiety in males with fragile X syndrome. Psychoneuroendocrinology. 2012;37(4):509–18.View ArticlePubMedGoogle Scholar
- De Oliveira DC, Zuardi AW, Graeff FG, Queiroz RH, Crippa JA. Anxiolytic-like effect of oxytocin in the simulated public speaking test. J Psychopharmacol (Oxf). 2012;26(4):497–504.View ArticleGoogle Scholar
- Shahrestani S, Kemp AH, Guastella AJ. The impact of a single administration of intranasal oxytocin on the recognition of basic emotions in humans: a meta-analysis. Neuropsychopharmacology. 2013;38(10):1929–36.View ArticlePubMedPubMed CentralGoogle Scholar
- Van IJzendoorn MH, Bakermans-Kranenburg MJ. A sniff of trust: meta-analysis of the effects of intranasal oxytocin administration on face recognition, trust to in-group, and trust to out-group. Psychoneuroendocrinology. 2012;37(3):438–43.View ArticlePubMedGoogle Scholar
- Leng G, Ludwig M. Intranasal oxytocin: myths and delusions. Biol Psychiatry. 2016;79(3):243–50.View ArticlePubMedGoogle Scholar
- Quintana DS, Alvares GA, Hickie IB, Guastella AJ. Do delivery routes of intranasally administered oxytocin account for observed effects on social cognition and behavior? A two-level model. Neurosci Biobehav Rev. 2015;49:182–92.View ArticlePubMedGoogle Scholar
- LeDoux JE. Emotion circuits in the brain. Sci Ment Health: Fear and anxiety. 2001;259.
- Seeley WW, Menon V, Schatzberg AF, Keller J, Glover GH, Kenna H, Reiss AL, Greicius MD. Dissociable intrinsic connectivity networks for salience processing and executive control. J Neurosci. 2007;27(9):2349–56.View ArticlePubMedPubMed CentralGoogle Scholar
- Domes G, Heinrichs M, Gläscher J, Büchel C, Braus DF, Herpertz SC. Oxytocin attenuates amygdala responses to emotional faces regardless of valence. Biol Psychiatry. 2007;62(10):1187–90.View ArticlePubMedGoogle Scholar
- Labuschagne I, Phan KL, Wood A, Angstadt M, Chua P, Heinrichs M, Stout JC, Nathan PJ. Oxytocin attenuates amygdala reactivity to fear in generalized social anxiety disorder. Neuropsychopharmacology. 2010;35(12):2403–13.View ArticlePubMedPubMed CentralGoogle Scholar
- Petrovic P, Kalisch R, Singer T, Dolan RJ. Oxytocin attenuates affective evaluations of conditioned faces and amygdala activity. J Neurosci. 2008;28(26):6607–15.View ArticlePubMedPubMed CentralGoogle Scholar
- Riem MM, Bakermans-Kranenburg MJ, Pieper S, Tops M, Boksem MA, Vermeiren RR, Van IJzendoorn MH, Rombouts SA. Oxytocin modulates amygdala, insula, and inferior frontal gyrus responses to infant crying: a randomized controlled trial. Biol Psychiatry. 2011;70(3):291–7.View ArticlePubMedGoogle Scholar
- Riem MM, Van IJzendoorn MH, Tops M, Boksem MA, Rombouts SA, Bakermans-Kranenburg MJ. No laughing matter: intranasal oxytocin administration changes functional brain connectivity during exposure to infant laughter. Neuropsychopharmacology. 2012;37(5):1257–66.View ArticlePubMedGoogle Scholar
- Bethlehem RAI, Van Honk J, Auyeung B, Baron-Cohen S. Oxytocin, brain physiology, and functional connectivity: a review of intranasal oxytocin fMRI studies. Psychoneuroendocrinology. 2013;38(7):962–74.View ArticlePubMedGoogle Scholar
- Kirsch P, Esslinger C, Chen Q, Mier D, Lis S, Siddhanti S, Gruppe H, Mattay VS, Gallhofer B, Meyer-Lindenberg A. Oxytocin modulates neural circuitry for social cognition and fear in humans. J Neurosci. 2005;25(49):11489–93.View ArticlePubMedGoogle Scholar
- Sripada CS, Phan KL, Labuschagne I, Welsh R, Nathan PJ, Wood AG. Oxytocin enhances resting-state connectivity between amygdala and medial frontal cortex. Int J Neuropsychopharmacol. 2013;16(02):255–60.View ArticlePubMedGoogle Scholar
- Dodhia S, Hosanagar A, Fitzgerald DA, Labuschagne I, Wood AG, Nathan PJ, Phan KL. Modulation of resting-state amygdala-frontal functional connectivity by oxytocin in generalized social anxiety disorder. Neuropsychopharmacology. 2014;39(9):2061–69.
- Radua J, Mataix-Cols D. Meta-analytic methods for neuroimaging data explained. Biol Mood Anxiety Disord. 2012;2:6.View ArticlePubMedPubMed CentralGoogle Scholar
- Wigton R, Jocham Radua PA, Averbeck B, Meyer-Lindenberg A, McGuire P, Shergill SS, Fusar-Poli P. Neurophysiological effects of acute oxytocin administration: systematic review and meta-analysis of placebo-controlled imaging studies. J Psychiatry Neurosci. 2015;40(1), E1.View ArticlePubMedPubMed CentralGoogle Scholar
- Wager TD. Multilevel Kernel Density Analysis. (version 1.0) University of Colorado; 2008. http://wagerlab.colorado.edu/files/tools/meta-analysis.html.
- Radua J, Mataix-Cols D, Phillips M, El-Hage W, Kronhaus D, Cardoner N, Surguladze S. A new meta-analytic method for neuroimaging studies that combines reported peak coordinates and statistical parametric maps. Eur Psychiatry. 2012;27(8):605–11.View ArticlePubMedGoogle Scholar
- Hedges LV, Olkin I. Statistical methods for meta-analysis. Cambridge: Academic press; 2014.
- Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.View ArticlePubMedGoogle Scholar
- Quintana DS. From pre-registration to publication: a nontechnical primer for conducting a meta-analysis to synthesize correlational data. Front Psychol. 2015;6:1549.View ArticlePubMedPubMed CentralGoogle Scholar
- Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.View ArticlePubMedPubMed CentralGoogle Scholar
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009;151(4):W-65–94.View ArticleGoogle Scholar
- Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, Schünemann HJ. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008.
- Wager TD, Lindquist MA, Nichols TE, Kober H, Van Snellenberg JX. Evaluating the consistency and specificity of neuroimaging data using meta-analysis. Neuroimage. 2009;45(1):S210–21.View ArticlePubMedGoogle Scholar
- Kober H, Wager TD. Meta-analysis of neuroimaging data. Wiley Interdiscip Rev Cogn Sci. 2010;1(2):293–300.PubMedPubMed CentralGoogle Scholar
- Hart H, Radua J, Mataix-Cols D, Rubia K. Meta-analysis of fMRI studies of timing in attention-deficit hyperactivity disorder (ADHD). Neurosci Biobehav Rev. 2012;36(10):2248–56.View ArticlePubMedGoogle Scholar
- Fusar-Poli P. Voxel-wise meta-analysis of fMRI studies in patients at clinical high risk for psychosis. J Psychiatry Neurosci. 2012;37(2):106.View ArticlePubMedPubMed CentralGoogle Scholar
- DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88.View ArticlePubMedGoogle Scholar
- Outhred T, Hawkshead BE, Wager TD, Das P, Malhi GS, Kemp AH. Acute neural effects of selective serotonin reuptake inhibitors versus noradrenaline reuptake inhibitors on emotion processing: implications for differential treatment efficacy. Neurosci Biobehav Rev. 2013;37(8):1786–800.View ArticlePubMedGoogle Scholar
- Lane A, Luminet O, Nave G, Mikolajczak M. Is there a publication bias in behavioral intranasal oxytocin research on humans? Opening the file drawer of one lab. J Neuroendocrinol. 2016;28:4.View ArticleGoogle Scholar
- Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629–34.View ArticlePubMedPubMed CentralGoogle Scholar
- Fusar-Poli P, Bhattacharyya S, Allen P, Crippa J, Borgwardt S, Martin-Santos R, Seal M, O’Carroll C, Atakan Z, Zuardi A. Effect of image analysis software on neurofunctional activation during processing of emotional human faces. J Clin Neurosci. 2010;17(3):311–4.View ArticlePubMedGoogle Scholar
- Sommer IE, Aleman A, Slotema CW, Schutter D. Transcranial stimulation for psychosis: the relationship between effect size and published findings. Am J Psychiatry. 2012;169(11):1211.View ArticlePubMedGoogle Scholar