Most Read Articles
01 Dec 2020
Tetanus toxoid 5 Lf, diphtheria toxoid 2 Lf, pertussis toxoid 2.5 mcg, filamentous haemagglutinin 5 mcg, fimbriae types 2 and 3 5 mcg, pertactin 3 mcg
Dr. Hsu Li Yang, Dr. Tan Thuan Tong, Dr. Andrea Kwa, 08 Jan 2021
Antimicrobial resistance has become increasingly dire as the rapid emergence of drug resistance, especially gram-negative pathogens, has outpaced the development of new antibiotics. At a recent virtual symposium, Dr Hsu Li Yang, Vice Dean (Global Health) and Programme Leader (Infectious Diseases), NUS Saw Swee Hock School of Public Health, presented epidemiological data on multidrug-resistant (MDR) gram-negative bacteria (GNB) in Asia, while Dr Tan Thuan Tong, Head and Senior Consultant, Department of Infectious Diseases, Singapore General Hospital (SGH), focused on the role of ceftazidime-avibactam in MDR GNB infections. Dr Andrea Kwa, Assistant Director of Research, Department of Pharmacy, SGH, joined the panel in an interactive fireside chat, to discuss challenges, practical considerations, and solutions in MDR gram-negative infections. This Pfizer-sponsored symposium was chaired by Dr Ng Shin Yi, Head and Senior Consultant of Surgical Intensive Care, SGH.
Jairia Dela Cruz, 3 days ago
Spending too much time sitting cannot be good for the body, and rising to one's feet breaks up such a behaviour and yields small, but meaningful, reductions in certain cardiovascular disease (CVD) risk factors, according to the results of a meta-analysis.
3 days ago
Use of thyroid hormone therapy does not seem to protect older adults with subclinical hypothyroidism against mortality, but it appears to confer survival benefits to those aged <65 years, results of a study have shown.

Prediction models for COVID-19: Are they reliable?

Stephen Padilla
20 Apr 2020

Prediction models for the diagnosis and prognosis of the novel coronavirus disease (COVID-19) have sprung up and appear to show excellent discriminative performance. However, a recent study has found that these models are at high risk of bias due to nonrepresentative selection of control patients, exclusion of those who had not experienced the event of interest by end of study, and model overfitting.

“Therefore, their performance estimates are likely to be optimistic and misleading,” the researchers said. “Immediate sharing of well-documented individual participant data from COVID-19 studies is needed for collaborative efforts to develop more rigorous prediction models and validate existing ones.”

In this rapid systematic review and critical appraisal, studies that developed or validated a multivariable COVID-19–related prediction model were searched from PubMed and Embase through Ovid, Arxiv, medRxiv and boRxiv up to 24 March 2020.

Data were independently extracted by at least two researchers using the critical appraisal and data extraction for systematic reviews of prediction modelling studies (CHARMS). Risk of bias was evaluated using the prediction model risk of bias assessment tool (PROBAST)

Of the 2,696 titles screened, 27 studies including 31 prediction models met the eligibility criteria. Three of these models were developed for predicting hospital admission from pneumonia and other events (as proxy outcomes for COVID-19 pneumonia) in the general population. [BMJ 2020;369:m1328]

Eighteen diagnostic models were used to detect COVID-19 infection, of which 13 were machine learning based on computed tomography scans. Ten prognostic models predicted mortality risk, progression to severe disease or length of hospital stay. Of the 27 studies, only one used data from outside of China.

Age, body temperature, and sign and symptoms were some of the most commonly reported predictors for the presence of COVID-19 in patients with suspected disease. For severe prognosis in confirmed cases, the most common predictors reported included age, sex, C-reactive protein, lymphocyte count, lactic dehydrogenase and features derived from computed tomography scans.

In prediction models for the general population, C-index estimates had a range of 0.73–0.81 (reported for all three models). In diagnostic and prognostic models, such estimates ranged from 0.81 to >0.99 (reported for 13 of 18 models) and from 0.85 to 0.98 (reported for six of 10 models), respectively.

“All studies were rated at high risk of bias, mostly because of non-representative selection of control patients, exclusion of patients who had not experienced the event of interest by the end of the study, and high risk of model overfitting,” the researchers said.

Quality of reporting also differed significantly between studies, and most reports failed to include a description of the study population of intended use of the models. In addition, calibration of predictions was not always evaluated.

“When building a new prediction model, we recommend building on previous literature and expert opinion to select predictors, rather than selecting predictors in a purely data driven way,” the researchers noted. “[T]his is especially true for datasets with limited sample size.” [Stat Methods Med Res 2019;28:2455-2474; https://link.springer.com/chapter/10.1007/978-3-030-16399-0_16]

Digital Edition
Asia's trusted medical magazine for healthcare professionals. Get your MIMS Doctor - Malaysia digital copy today!
Sign In To Download
Editor's Recommendations
Most Read Articles
01 Dec 2020
Tetanus toxoid 5 Lf, diphtheria toxoid 2 Lf, pertussis toxoid 2.5 mcg, filamentous haemagglutinin 5 mcg, fimbriae types 2 and 3 5 mcg, pertactin 3 mcg
Dr. Hsu Li Yang, Dr. Tan Thuan Tong, Dr. Andrea Kwa, 08 Jan 2021
Antimicrobial resistance has become increasingly dire as the rapid emergence of drug resistance, especially gram-negative pathogens, has outpaced the development of new antibiotics. At a recent virtual symposium, Dr Hsu Li Yang, Vice Dean (Global Health) and Programme Leader (Infectious Diseases), NUS Saw Swee Hock School of Public Health, presented epidemiological data on multidrug-resistant (MDR) gram-negative bacteria (GNB) in Asia, while Dr Tan Thuan Tong, Head and Senior Consultant, Department of Infectious Diseases, Singapore General Hospital (SGH), focused on the role of ceftazidime-avibactam in MDR GNB infections. Dr Andrea Kwa, Assistant Director of Research, Department of Pharmacy, SGH, joined the panel in an interactive fireside chat, to discuss challenges, practical considerations, and solutions in MDR gram-negative infections. This Pfizer-sponsored symposium was chaired by Dr Ng Shin Yi, Head and Senior Consultant of Surgical Intensive Care, SGH.
Jairia Dela Cruz, 3 days ago
Spending too much time sitting cannot be good for the body, and rising to one's feet breaks up such a behaviour and yields small, but meaningful, reductions in certain cardiovascular disease (CVD) risk factors, according to the results of a meta-analysis.
3 days ago
Use of thyroid hormone therapy does not seem to protect older adults with subclinical hypothyroidism against mortality, but it appears to confer survival benefits to those aged <65 years, results of a study have shown.