Follow-up by mail in clinical trials: does questionnaire length matter?
- PMID: 14980747
- DOI: 10.1016/j.cct.2003.08.013
Follow-up by mail in clinical trials: does questionnaire length matter?
Abstract
In large clinical trials where outcome assessment is possible using questionnaires, it may be more cost-effective to mail them to patients than to conduct interviews in-person. However, nonresponse to mailed questionnaires reduces the effective sample size and can introduce bias. We conducted a systematic review and meta-analysis of randomized controlled trials evaluating the effect of questionnaire length on response rates. We searched 14 electronic bibliographic databases, the reference lists of relevant trials, and we contacted the authors of eligible trials to ask about unpublished data. For each trial identified, we used logistic regression to estimate the odds ratio for response per one page increase in the number of pages included in the questionnaire. We pooled the regression coefficients in a random effects meta-analysis. Heterogeneity among the coefficients was assessed using a chi-square test at a 5% significance level. We specified a priori that the reduction in the odds of response per one page increase would be greatest among trials comparing relatively short questionnaires. We used meta regression to examine the relationships between the regression coefficients, the length of the questionnaires used in each trial, and other study characteristics. A total of 38 randomized controlled trials were identified where participants were allocated to questionnaires of differing lengths and where the number of pages used was known. There was significant heterogeneity between the regression coefficients estimated from each trial. In meta regression, most of the heterogeneity was explained by variation in the length of the questionnaires used in each trial. Among trials in which the shortest questionnaire was a postcard, the odds of response were more than halved for each additional page used (0.39; 95% CI 0.34 to 0.45). In the remaining trials, pooled effect sizes were much smaller. In trials of one page compared with either two or three pages, the odds of response per one page increase was 1.01 (95% CI 0.82 to 1.24). For one page compared with four or more pages, and for two or more pages compared with longer alternatives, the odds ratios per one page increase were 0.90 (95% CI 0.83 to 0.98) and 0.98 (95% CI 0.96 to 0.99), respectively. There were no statistically significant associations between trial results and other study characteristics. It appears that response can be increased by using a shorter questionnaire. Moderate changes to the length of shorter questionnaires will be more effective than moderate changes to the length of longer questionnaires. If a choice of follow-up questionnaire exists for a clinical trial, the shorter one should be used. If a new follow-up questionnaire is to be designed, it should be made as short as possible without compromising the data collection requirements of the trial.
Similar articles
-
Methods to increase response rates to postal questionnaires.Cochrane Database Syst Rev. 2007 Apr 18;(2):MR000008. doi: 10.1002/14651858.MR000008.pub3. Cochrane Database Syst Rev. 2007. Update in: Cochrane Database Syst Rev. 2009 Jul 08;(3):MR000008. doi: 10.1002/14651858.MR000008.pub4 PMID: 17443629 Updated. Review.
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2009 Jul 8;2009(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. Cochrane Database Syst Rev. 2009. Update in: Cochrane Database Syst Rev. 2023 Nov 30;11:MR000008. doi: 10.1002/14651858.MR000008.pub5 PMID: 19588449 Free PMC article. Updated. Review.
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2023 Nov 30;11(11):MR000008. doi: 10.1002/14651858.MR000008.pub5. Cochrane Database Syst Rev. 2023. PMID: 38032037 Free PMC article. Review.
-
Behavioral and Pharmacotherapy Weight Loss Interventions to Prevent Obesity-Related Morbidity and Mortality in Adults: An Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. PMID: 30354042 Free Books & Documents. Review.
-
Aspirin Use in Adults: Cancer, All-Cause Mortality, and Harms: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. PMID: 26491756 Free Books & Documents. Review.
Cited by
-
What Does a Single-Item Measure of Job Stressfulness Assess?Int J Environ Res Public Health. 2019 Apr 26;16(9):1480. doi: 10.3390/ijerph16091480. Int J Environ Res Public Health. 2019. PMID: 31027356 Free PMC article.
-
"Could I return to my life?" Integrated Narrative Nursing Model in Education (INNE).Acta Biomed. 2018 Mar 28;89(4-S):5-17. doi: 10.23750/abm.v89i4-S.7202. Acta Biomed. 2018. PMID: 29644985 Free PMC article.
-
Reliability of a Rapid Screener for an Intercept Survey about Drug Use.Subst Use Misuse. 2021;56(12):1831-1836. doi: 10.1080/10826084.2021.1954029. Epub 2021 Jul 27. Subst Use Misuse. 2021. PMID: 34313194 Free PMC article.
-
The Barretos short instrument for assessment of quality of life (BSIqol): development and preliminary validation in a cohort of cancer patients undergoing antineoplastic treatment.Health Qual Life Outcomes. 2012 Nov 29;10:144. doi: 10.1186/1477-7525-10-144. Health Qual Life Outcomes. 2012. PMID: 23192011 Free PMC article.
-
Occupational health professionals' knowledge, understanding and use of work ability.Occup Med (Lond). 2013 Sep;63(6):405-9. doi: 10.1093/occmed/kqt070. Epub 2013 Jun 14. Occup Med (Lond). 2013. PMID: 23771875 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources