Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017 May 23:357:j2099.
doi: 10.1136/bmj.j2099.

Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study

Affiliations

Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study

Julia Hippisley-Cox et al. BMJ. .

Abstract

Objectives To develop and validate updated QRISK3 prediction algorithms to estimate the 10 year risk of cardiovascular disease in women and men accounting for potential new risk factors.Design Prospective open cohort study.Setting General practices in England providing data for the QResearch database.Participants 1309 QResearch general practices in England: 981 practices were used to develop the scores and a separate set of 328 practices were used to validate the scores. 7.89 million patients aged 25-84 years were in the derivation cohort and 2.67 million patients in the validation cohort. Patients were free of cardiovascular disease and not prescribed statins at baseline.Methods Cox proportional hazards models in the derivation cohort to derive separate risk equations in men and women for evaluation at 10 years. Risk factors considered included those already in QRISK2 (age, ethnicity, deprivation, systolic blood pressure, body mass index, total cholesterol: high density lipoprotein cholesterol ratio, smoking, family history of coronary heart disease in a first degree relative aged less than 60 years, type 1 diabetes, type 2 diabetes, treated hypertension, rheumatoid arthritis, atrial fibrillation, chronic kidney disease (stage 4 or 5)) and new risk factors (chronic kidney disease (stage 3, 4, or 5), a measure of systolic blood pressure variability (standard deviation of repeated measures), migraine, corticosteroids, systemic lupus erythematosus (SLE), atypical antipsychotics, severe mental illness, and HIV/AIDs). We also considered erectile dysfunction diagnosis or treatment in men. Measures of calibration and discrimination were determined in the validation cohort for men and women separately and for individual subgroups by age group, ethnicity, and baseline disease status.Main outcome measures Incident cardiovascular disease recorded on any of the following three linked data sources: general practice, mortality, or hospital admission records.Results 363 565 incident cases of cardiovascular disease were identified in the derivation cohort during follow-up arising from 50.8 million person years of observation. All new risk factors considered met the model inclusion criteria except for HIV/AIDS, which was not statistically significant. The models had good calibration and high levels of explained variation and discrimination. In women, the algorithm explained 59.6% of the variation in time to diagnosis of cardiovascular disease (R2, with higher values indicating more variation), and the D statistic was 2.48 and Harrell's C statistic was 0.88 (both measures of discrimination, with higher values indicating better discrimination). The corresponding values for men were 54.8%, 2.26, and 0.86. Overall performance of the updated QRISK3 algorithms was similar to the QRISK2 algorithms.Conclusion Updated QRISK3 risk prediction models were developed and validated. The inclusion of additional clinical variables in QRISK3 (chronic kidney disease, a measure of systolic blood pressure variability (standard deviation of repeated measures), migraine, corticosteroids, SLE, atypical antipsychotics, severe mental illness, and erectile dysfunction) can help enable doctors to identify those at most risk of heart disease and stroke.

PubMed Disclaimer

Conflict of interest statement

Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: JHC is professor of clinical epidemiology at the University of Nottingham and codirector of QResearch a not-for-profit organisation that is a joint partnership between the University of Nottingham and Egton Medical Information Systems (leading commercial supplier of IT for 55% of general practices in the UK). JHC is also a paid director of ClinRisk, which produces open and closed source software to ensure the reliable and updatable implementation of clinical risk algorithms within clinical computer systems to help improve patient care. CC is associate professor of medical statistics at the University of Nottingham and a paid consultant statistician for ClinRisk. PB is partly funded by Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West), Bristol Clinical Commissioning Group and the West of England Academic Health Science Network.. This work and any views expressed within it are solely those of the authors and not of any affiliated bodies or organisations.

Figures

None
Fig 1 Funnel plots of discrimination performance (Harrell’s C statistic) across 328 general practices
None
Fig 2 Predicted and observed 10 year cardiovascular disease risk by 10th of predicted risk
None
Fig 3 10 year risk of 22.5% based on model C for a white man, aged 44, heavy smoker, total cholesterol: high density lipoprotein (HDL) cholesterol ratio of 2, systolic blood pressure of 132 mm Hg, standard deviation of systolic blood pressure of 10 mm Hg, body mass index of 31.22, atrial fibrillation, erectile dysfunction, migraine, and steroid use
None
Fig 4 10 year risk ratio of 7.5% based on model C for white man, aged 44, heavy smoker, total cholesterol: high density lipoprotein cholesterol ratio of 2, systolic blood pressure of 132 mm Hg, standard deviation of systolic blood pressure of 0, body mass index of 31.22, migraine, steroid use, no atrial fibrillation, and no erectile dysfunction

Similar articles

Cited by

References

    1. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ 2007;335:136 10.1136/bmj.39261.471806.55. pmid:17615182. - DOI - PMC - PubMed
    1. Hippisley-Cox J, Coupland C. QRISK2. Annual Update Information 2016;2016:5.
    1. Hippisley-Cox J. Validity and completeness of the NHS Number in primary and secondary care electronic data in England 1991-2013. 2013; 1. Hippisley-Cox J. Validity and completeness of the NHS number in primary and secondary care: electronic data in England 1991-2013 http://eprints.nottingham.ac.uk/3153/1/Validity%26CompletenessNHSNumber.pdf (accessed June 2013).
    1. Hippisley-Cox J, Coupland C, Brindle P. The performance of seven QPrediction risk scores in an independent external sample of patients from general practice: a validation study. BMJ Open 2014;4:e005809 10.1136/bmjopen-2014-005809 pmid:25168040. - DOI - PMC - PubMed
    1. Collins GS, Altman DG. An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study. BMJ 2009;339:b2584 10.1136/bmj.b2584 pmid:19584409. - DOI - PMC - PubMed

Publication types

MeSH terms

Substances

  NODES
twitter 2