You are here

  • Home
  • Online First
  • Standalone performance of artificial intelligence for upper GI neoplasia: a meta-analysis

Article Text

Article menu

other Versions

Download PDFPDF
Endoscopy
Original research
Standalone performance of artificial intelligence for upper GI neoplasia: a meta-analysis
  1. Julia Arribas1,
  2. Giulio Antonelli2,3,
  3. Leonardo Frazzoni4,
  4. Lorenzo Fuccio4,
  5. Alanna Ebigbo5,
  6. Fons van der Sommen6,
  7. Noha Ghatwary7,
  8. Christoph Palm8,9,
  9. Miguel Coimbra10,
  10. Francesco Renna11,
  11. J J G H M Bergman12,
  12. Prateek Sharma13,
  13. Helmut Messmann5,
  14. Cesare Hassan2,
  15. Mario J Dinis-Ribeiro1
  1. 1CIDES/CINTESIS, Faculty of Medicine, University of Porto, Porto, Portugal
  2. 2Digestive Endoscopy Unit, Nuovo Regina Margherita Hospital, Rome, Italy
  3. 3Department of Translational and Precision Medicine, Sapienza University of Rome, Rome, Italy
  4. 4Department of Medical and Surgical Sciences, S.Orsola-Malpighi Hospital, University of Bologna, Bologna, BO, Italy
  5. 5III Medizinische Klinik, UniversitatsKlinikum Augsburg, Augsburg, Germany
  6. 6Department of Electrical Engineering, VCA group, Eindhoven University of Technology, Eindhoven, Netherlands
  7. 7Department of Computer Engineering, Arab Academy for Science and Technology, Alexandria, Egypt
  8. 8Regensburg Medical Image Computing (ReMIC), Ostbayerische Technische Hochschule Regensburg, Regensburg, Germany
  9. 9Regensburg Center of Health Sciences and Technology (RCHST), OTH Regensburg, Regensburg, Germany
  10. 10INESC TEC, Faculdade de Ciências, University of Porto, Porto, Portugal
  11. 11Instituto de Telecomunicações, Faculdade de Ciencias, University of Porto, Porto, Portugal
  12. 12Dept of Gastroenterology, Academic Medical Center, Amsterdam, The Netherlands
  13. 13Department of Gastroenterology and Hepatology, University of Kansas Medical Center, Kansas City, Kansas, USA
  1. Correspondence to Dr Mario J Dinis-Ribeiro, CIDES/CINTESIS, Faculty of Medicine, University of Porto, Porto 4200-072, Portugal; mario{at}med.up.pt

Abstract

Objective Artificial intelligence (AI) may reduce underdiagnosed or overlooked upper GI (UGI) neoplastic and preneoplastic conditions, due to subtle appearance and low disease prevalence. Only disease-specific AI performances have been reported, generating uncertainty on its clinical value.

Design We searched PubMed, Embase and Scopus until July 2020, for studies on the diagnostic performance of AI in detection and characterisation of UGI lesions. Primary outcomes were pooled diagnostic accuracy, sensitivity and specificity of AI. Secondary outcomes were pooled positive (PPV) and negative (NPV) predictive values. We calculated pooled proportion rates (%), designed summary receiving operating characteristic curves with respective area under the curves (AUCs) and performed metaregression and sensitivity analysis.

Results Overall, 19 studies on detection of oesophageal squamous cell neoplasia (ESCN) or Barrett's esophagus-related neoplasia (BERN) or gastric adenocarcinoma (GCA) were included with 218, 445, 453 patients and 7976, 2340, 13 562 images, respectively. AI-sensitivity/specificity/PPV/NPV/positive likelihood ratio/negative likelihood ratio for UGI neoplasia detection were 90% (CI 85% to 94%)/89% (CI 85% to 92%)/87% (CI 83% to 91%)/91% (CI 87% to 94%)/8.2 (CI 5.7 to 11.7)/0.111 (CI 0.071 to 0.175), respectively, with an overall AUC of 0.95 (CI 0.93 to 0.97). No difference in AI performance across ESCN, BERN and GCA was found, AUC being 0.94 (CI 0.52 to 0.99), 0.96 (CI 0.95 to 0.98), 0.93 (CI 0.83 to 0.99), respectively. Overall, study quality was low, with high risk of selection bias. No significant publication bias was found.

Conclusion We found a high overall AI accuracy for the diagnosis of any neoplastic lesion of the UGI tract that was independent of the underlying condition. This may be expected to substantially reduce the miss rate of precancerous lesions and early cancer when implemented in clinical practice.

  • diagnostic and therapeutic endoscopy
  • gastrointesinal endoscopy
  • gastric pre-cancer
  • Barrett's oesophagus
  • oesophageal lesions

https://doi.org/10.1136/gutjnl-2020-321922

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    View Full Text

    Footnotes

    • JA and GA are joint first authors.

    • CH and MJD-R are joint senior authors.

    • Twitter @fvdsommen, @ReMIC_OTH

    • JA and GA contributed equally.

    • CH and MJD-R contributed equally.

    • Contributors JA, GA, MJD-R and CH: conception and design. JA, GA, CH and MJD-R: data extraction and interpretation; drafting of the article. LFr and LF: statistical analysis. AE, FvdS, CP, MC, FR, HM, NG, LF, LFr, JJGHMB and PS: critical revision of the article for important intellectual content. All authors read and approved the final version of the manuscript. JA and GA, first authors, equally contributed to this manuscriot. CH and MJD-R, senior authors, equally contributed to this manuscript.

    • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

    • Competing interests JB reports grants and personal fees from Olympus, Fujifilm, Pentax Endoscopy outside the submitted work; PS reports personal fees from Olympus and Boston Scientific, grants from CDx, US Endoscopy, Medtronic, Ironwood, Erbe, Fujifilm, outside the submitted work; CH reports personal fees from Medtronic, Fujifilm, Olympus, outside the submitted work; MJD-R reports grants from Olympus, Fujifulm, outside the submitted work. JA, GA, LF, LFr, AE, FVDS, NG, CP, MC, FR, HM have no COI to declare.

    • Patient consent for publication Not required.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement Data are available upon reasonable request. Complete dataset used for meta-analysis available with the corresponding author upon request.

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.