Myths and methodologies: The use of equivalence and non-inferiority tests for interventional studies in exercise physiology and sport science
- PMID: 35041233
- DOI: 10.1113/EP090171
Myths and methodologies: The use of equivalence and non-inferiority tests for interventional studies in exercise physiology and sport science
Abstract
Exercise physiology and sport science have traditionally made use of the null hypothesis of no difference to make decisions about experimental interventions. In this article, we aim to review current statistical approaches typically used by exercise physiologists and sport scientists for the design and analysis of experimental interventions and to highlight the importance of including equivalence and non-inferiority studies, which address different research questions from deciding whether an effect is present. Initially, we briefly describe the most common approaches, along with their rationale, to investigate the effects of different interventions. We then discuss the main steps involved in the design and analysis of equivalence and non-inferiority studies, commonly performed in other research fields, with worked examples from exercise physiology and sport science scenarios. Finally, we provide recommendations to exercise physiologists and sport scientists who would like to apply the different approaches in future research. We hope this work will promote the correct use of equivalence and non-inferiority designs in exercise physiology and sport science whenever the research context, conditions, applications, researchers' interests or reasonable beliefs justify these approaches.
Keywords: intervention efficacy; methodology; statistical review.
© 2022 The Authors. Experimental Physiology © 2022 The Physiological Society.
Comment in
-
Is the intervention as good as (or not substantially worse than) a comparator?Exp Physiol. 2022 Mar;107(3):199-200. doi: 10.1113/EP090321. Epub 2022 Feb 17. Exp Physiol. 2022. PMID: 35114053 No abstract available.
Similar articles
-
Network Physiology of Exercise: Vision and Perspectives.Front Physiol. 2020 Dec 11;11:611550. doi: 10.3389/fphys.2020.611550. eCollection 2020. Front Physiol. 2020. PMID: 33362584 Free PMC article.
-
Methodological Considerations for Studies in Sport and Exercise Science with Women as Participants: A Working Guide for Standards of Practice for Research on Women.Sports Med. 2021 May;51(5):843-861. doi: 10.1007/s40279-021-01435-8. Epub 2021 Mar 16. Sports Med. 2021. PMID: 33725341 Free PMC article.
-
Estimation versus falsification approaches in sport and exercise science.J Sports Sci. 2019 Jan;37(1):3-4. doi: 10.1080/02640414.2018.1479116. Epub 2018 May 22. J Sports Sci. 2019. PMID: 29786469
-
Strengthening the Practice of Exercise and Sport-Science Research.Int J Sports Physiol Perform. 2018 Feb 1;13(2):127-134. doi: 10.1123/ijspp.2017-0322. Epub 2018 Feb 13. Int J Sports Physiol Perform. 2018. PMID: 28787228 Review.
-
Methodological aspects of superiority, equivalence, and non-inferiority trials.Intern Emerg Med. 2020 Sep;15(6):1085-1091. doi: 10.1007/s11739-020-02450-9. Epub 2020 Jul 23. Intern Emerg Med. 2020. PMID: 32705494 Review.
Cited by
-
N of 1: Optimizing Methodology for the Detection of Individual Response Variation in Resistance Training.Sports Med. 2024 Aug;54(8):1979-1990. doi: 10.1007/s40279-024-02050-z. Epub 2024 Jun 15. Sports Med. 2024. PMID: 38878117 Review.
-
Perspective: Is the Response of Human Energy Expenditure to Increased Physical Activity Additive or Constrained?Adv Nutr. 2023 May;14(3):406-419. doi: 10.1016/j.advnut.2023.02.003. Epub 2023 Feb 23. Adv Nutr. 2023. PMID: 36828336 Free PMC article.
-
Effects of 4-Week Low-Load Resistance Training with Blood Flow Restriction on Muscle Strength and Left Ventricular Function in Young Swimmers: A Pilot Randomized Trial.J Hum Kinet. 2023 Jul 15;87:63-76. doi: 10.5114/jhk/163013. eCollection 2023 Jul. J Hum Kinet. 2023. PMID: 37559761 Free PMC article.
-
Methodological considerations on near-infrared spectroscopy derived muscle oxidative capacity.Eur J Appl Physiol. 2024 Jul;124(7):2069-2079. doi: 10.1007/s00421-024-05421-6. Epub 2024 Feb 24. Eur J Appl Physiol. 2024. PMID: 38400931 Free PMC article.
-
Extraordinary Claims in the Literature on High-Intensity Interval Training (HIIT): I. Bonafide Scientific Revolution or a Looming Crisis of Replication and Credibility?Sports Med. 2023 Oct;53(10):1865-1890. doi: 10.1007/s40279-023-01880-7. Epub 2023 Aug 10. Sports Med. 2023. PMID: 37561389 Review.
References
REFERENCES
-
- Aisbett, J., Lakens, D., & Sainani, K. L. (2020). Magnitude based inference in relation to one-sided hypotheses testing procedures. SportRxiv. https://doi.org/10.31236/osf.io/pn9s3
-
- Althunian, T. A., de Boer, A., Groenwold, R. H. H., & Klungel, O. H. (2017). Defining the noninferiority margin and analysing noninferiority: An overview. British Journal of Clinical Pharmacology, 83, 1636-1642. https://doi.org/10.1111/bcp.13280
-
- Althunian, T. A., de Boer, A., Groenwold, R. H. H., & Klungel, O. H. (2018). Using a single noninferiority margin or preserved fraction for an entire pharmacological class was found to be inappropriate. Journal of Clinical Epidemiology, 104, 15-23. https://doi.org/10.1016/j.jclinepi.2018.07.004
-
- Altman, D. G., & Bland, J. M. (1995). Absence of evidence is not evidence of absence. British Medical Journal, 311, 485. https://doi.org/10.1136/bmj.311.7003.485
-
- Bauer, P., & Kieser, M. (1996). A unifying approach for confidence intervals and testing of equivalence and difference. Biometrika, 83, 934-937. https://doi.org/10.1093/biomet/83.4.934
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources