Follow-up by mail in clinical trials: does questionnaire length matter?
- PMID: 14980747
- DOI: 10.1016/j.cct.2003.08.013
Follow-up by mail in clinical trials: does questionnaire length matter?
Abstract
In large clinical trials where outcome assessment is possible using questionnaires, it may be more cost-effective to mail them to patients than to conduct interviews in-person. However, nonresponse to mailed questionnaires reduces the effective sample size and can introduce bias. We conducted a systematic review and meta-analysis of randomized controlled trials evaluating the effect of questionnaire length on response rates. We searched 14 electronic bibliographic databases, the reference lists of relevant trials, and we contacted the authors of eligible trials to ask about unpublished data. For each trial identified, we used logistic regression to estimate the odds ratio for response per one page increase in the number of pages included in the questionnaire. We pooled the regression coefficients in a random effects meta-analysis. Heterogeneity among the coefficients was assessed using a chi-square test at a 5% significance level. We specified a priori that the reduction in the odds of response per one page increase would be greatest among trials comparing relatively short questionnaires. We used meta regression to examine the relationships between the regression coefficients, the length of the questionnaires used in each trial, and other study characteristics. A total of 38 randomized controlled trials were identified where participants were allocated to questionnaires of differing lengths and where the number of pages used was known. There was significant heterogeneity between the regression coefficients estimated from each trial. In meta regression, most of the heterogeneity was explained by variation in the length of the questionnaires used in each trial. Among trials in which the shortest questionnaire was a postcard, the odds of response were more than halved for each additional page used (0.39; 95% CI 0.34 to 0.45). In the remaining trials, pooled effect sizes were much smaller. In trials of one page compared with either two or three pages, the odds of response per one page increase was 1.01 (95% CI 0.82 to 1.24). For one page compared with four or more pages, and for two or more pages compared with longer alternatives, the odds ratios per one page increase were 0.90 (95% CI 0.83 to 0.98) and 0.98 (95% CI 0.96 to 0.99), respectively. There were no statistically significant associations between trial results and other study characteristics. It appears that response can be increased by using a shorter questionnaire. Moderate changes to the length of shorter questionnaires will be more effective than moderate changes to the length of longer questionnaires. If a choice of follow-up questionnaire exists for a clinical trial, the shorter one should be used. If a new follow-up questionnaire is to be designed, it should be made as short as possible without compromising the data collection requirements of the trial.
Similar articles
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2009 Jul 8;2009(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. Cochrane Database Syst Rev. 2009. Update in: Cochrane Database Syst Rev. 2023 Nov 30;11:MR000008. doi: 10.1002/14651858.MR000008.pub5 PMID: 19588449 Free PMC article. Updated. Review.
-
Methods to increase response rates to postal questionnaires.Cochrane Database Syst Rev. 2007 Apr 18;(2):MR000008. doi: 10.1002/14651858.MR000008.pub3. Cochrane Database Syst Rev. 2007. Update in: Cochrane Database Syst Rev. 2009 Jul 08;(3):MR000008. doi: 10.1002/14651858.MR000008.pub4 PMID: 17443629 Updated. Review.
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2023 Nov 30;11(11):MR000008. doi: 10.1002/14651858.MR000008.pub5. Cochrane Database Syst Rev. 2023. PMID: 38032037 Free PMC article. Review.
-
Behavioral and Pharmacotherapy Weight Loss Interventions to Prevent Obesity-Related Morbidity and Mortality in Adults: An Updated Systematic Review for the U.S. Preventive Services Task Force [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2018 Sep. Report No.: 18-05239-EF-1. PMID: 30354042 Free Books & Documents. Review.
-
Aspirin Use in Adults: Cancer, All-Cause Mortality, and Harms: A Systematic Evidence Review for the U.S. Preventive Services Task Force [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2015 Sep. Report No.: 13-05193-EF-1. PMID: 26491756 Free Books & Documents. Review.
Cited by
-
Methods to increase response to postal and electronic questionnaires.Cochrane Database Syst Rev. 2009 Jul 8;2009(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. Cochrane Database Syst Rev. 2009. Update in: Cochrane Database Syst Rev. 2023 Nov 30;11:MR000008. doi: 10.1002/14651858.MR000008.pub5 PMID: 19588449 Free PMC article. Updated. Review.
-
Adaptive Measurement of Change: A Novel Method to Reduce Respondent Burden and Detect Significant Individual-Level Change in Patient-Reported Outcome Measures.Arch Phys Med Rehabil. 2022 May;103(5S):S43-S52. doi: 10.1016/j.apmr.2021.07.814. Epub 2021 Oct 1. Arch Phys Med Rehabil. 2022. PMID: 34606759 Free PMC article.
-
Imaging-guided lumbar facet injections: is there a difference in outcomes between low back pain patients who remember to return a postal questionnaire and those who do not?Insights Imaging. 2012 Aug;3(4):411-8. doi: 10.1007/s13244-012-0178-8. Epub 2012 Jun 7. Insights Imaging. 2012. PMID: 22695954 Free PMC article.
-
Quick assessment of hopelessness: a cross-sectional study.Health Qual Life Outcomes. 2006 Mar 1;4:13. doi: 10.1186/1477-7525-4-13. Health Qual Life Outcomes. 2006. PMID: 16509984 Free PMC article.
-
Parents' attitudes towards hepatitis B vaccination for their children. A survey comparing paper and web questionnaires, Sweden 2005.BMC Public Health. 2007 May 21;7:86. doi: 10.1186/1471-2458-7-86. BMC Public Health. 2007. PMID: 17511891 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources