Equivalence Testing for Psychological Research: A Tutorial

Lakens, Daniël; Scheel, Anne M.; Isager, Peder Mortvedt

doi:10.31234/osf.io/v3zkt

Cited by 215 publications

(288 citation statements)

References 21 publications

(25 reference statements)

Supporting

Mentioning

284

Contrasting

Unclassified

Order By: Relevance

“…Third, the present study employed two different devices to record resting‐state heart rate. The TOST results showed differences in the two sets of HRV data collected [all P ‐values >0.05; Lakens et al, ]. We cannot determine whether this is related to either the HRV devices or differences in the individuals.…”

Section: Discussionmentioning

confidence: 90%

“…There were no interaction effects with group for any indices of HRV by the device and there was no main effect of device variable (see supplementary Tables S1a,b and Table ). The equivalence test used a two‐one sided (TOST) analysis [Lakens, Scheel, & Isager, ] and the equivalence bounds suggested differences between the data acquired by the two different devices or populations. Log 10 SDNN( t (61) = 0.09, P = 0.59,equivalence bound −0.069 and 0.069), log 10 RMSSD, ( t (44) = 0.01, P = 0.49, equivalence bound −0.12 and 0.12), log 10 HF‐HRV ( t (60) = −0.82, P = 0.79, equivalence bound −0.27 and 0.27), and log 10 LF ( t (41) = −0.53, P = 0.70, equivalence bound −0.03 and 0.33) given P ‐value of 0.05.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Reduced heart rate variability in adults with autism spectrum disorder

et al. 2019

View full text Add to dashboard Cite

A growing body of research has suggested heart rate variability (HRV) may be reduced in autism spectrum disorder (ASD) in comparison to neurotypical cohorts. While there have been several studies investigating HRV in children diagnosed with ASD, few studies have been conducted in adults. The objective of the current study was to investigate autonomic nervous system activity as assessed by HRV in adults diagnosed with ASD. We hypothesized that adults with ASD would show a reduction in HRV compared to neurotypical participants. Participants diagnosed with ASD (n = 55) were recruited from the Autism Clinic for Translational Research at the Brain and Mind Centre (University of Sydney) between 2013 and 2017. Neurotypical participants were recruited from advertisements and online media. Resting state heart rate was measured for 5 min while participants sat in an upright position. Results showed there was an overall significant difference in resting-state HRV between adults diagnosed with ASD compared to the neurotypical control group. Logarithmically transformed high frequency (HF) and root mean square of successive differences were particularly decreased in the ASD group, suggesting lower parasympathetic activity. The use of psychotropic medications and comorbidities were associated with reductions in low frequency of HRV. Our data suggest an overall dysregulation in resting autonomic activity in adults with ASD. This may represent an important physiological mechanism leading to potential cardiovascular risk in ASD, which warrants further investigation. Autism Res 2019, 12: 922-930.Lay Summary: ASD is commonly associated with a range of physical and mental health comorbidities. Autonomic disruptions underlying reductions in heart rate variability (HRV) have been linked to a range of mental and physical health conditions. We assessed resting-state HRV in adults diagnosed with ASD in comparison to healthy individuals. Our results showed reduced heart rate variability in people diagnosed with ASD compared to adults without ASD. These findings implicate a role for autonomic activity as a potentially modifiable risk factor for ASD.

show abstract

Section: Discussionmentioning

confidence: 90%

Section: Methodsmentioning

confidence: 99%

Reduced heart rate variability in adults with autism spectrum disorder

et al. 2019

View full text Add to dashboard Cite

show abstract

“…Hypothesis 2 assumed that color‐evasion would be unrelated to cognitive, metacognitive, and behavioral CQ. Since conventional significance tests technically cannot test for the absence of an effect, we used equivalence testing with one‐sided t ‐tests to reject the presence of a smallest effect size of interest (SESOI) (Lakens, Scheel, & Isager, ). As these procedures are not yet available for multilevel regression, we only tested equivalence for the bivariate correlations between color‐evasion with self‐reported cognitive, metacognitive, and behavioral CQ as well as with the SJT score.…”

Section: Resultsmentioning

confidence: 99%

Reaping the benefits of cultural diversity: Classroom cultural diversity climate and students’ intercultural competence

Schwarzenthal

Schachner

Juang

et al. 2019

Euro J Social Psych

View full text Add to dashboard Cite

Culturally diverse schools may constitute natural arenas for training crucial intercultural skills. We hypothesized that a classroom cultural diversity climate fostering contact and cooperation and multiculturalism, but not a climate fostering color‐evasion, would be positively related to adolescents’ intercultural competence. Adolescents in North Rhine‐Westphalia (N = 631, Mage = 13.69 years, 49% of immigrant background) and Berlin (N = 1,335, Mage = 14.69 years, 52% of immigrant background) in Germany reported their perceptions of the classroom cultural diversity climate and completed quantitative and qualitative measures assessing their intercultural competence. Multilevel structural equation models indicate that contact and cooperation, multiculturalism, and, surprisingly, also color‐evasion (as in emphasizing a common humanity), were positively related to the intercultural competence of immigrant and non‐immigrant background students. We conclude that all three aspects of the classroom climate are uniquely related to aspects of adolescents’ intercultural competence and that none of them may be sufficient on their own.

show abstract

“…On the other hand, there are concerns about the limitations of NHST. Importantly, in NHST, nonstatistically significant results are typically inconclusive, so researchers cannot accept a null hypothesis (but see Machery, , and Lakens, Scheel, & Isager, ). And if we cannot accept a null hypothesis, then it is harder to evaluate and publish failed replication attempts.…”

Section: Causes Of the Replicability Crisismentioning

confidence: 99%

Philosophy of science and the replicability crisis

Romero

2019

Philosophy Compass

View full text Add to dashboard Cite

Replicability is widely taken to ground the epistemic authority of science. However, in recent years, important published findings in the social, behavioral, and biomedical sciences have failed to replicate, suggesting that these fields are facing a “replicability crisis.” For philosophers, the crisis should not be taken as bad news but as an opportunity to do work on several fronts, including conceptual analysis, history and philosophy of science, research ethics, and social epistemology. This article introduces philosophers to these discussions. First, I discuss precedents and evidence for the crisis. Second, I discuss methodological, statistical, and social‐structural factors that have contributed to the crisis. Third, I focus on the philosophical issues raised by the crisis. Finally, I discuss several proposals for solutions and highlight the gaps that philosophers could focus on.

show abstract

Equivalence Testing for Psychological Research: A Tutorial

Cited by 215 publications

References 21 publications

Reduced heart rate variability in adults with autism spectrum disorder

Reduced heart rate variability in adults with autism spectrum disorder

Reaping the benefits of cultural diversity: Classroom cultural diversity climate and students’ intercultural competence

Philosophy of science and the replicability crisis

Contact Info

Product

Resources

About