Objective <p>We evaluated a commercial artificial intelligence (AI) system as a concurrent decision-support tool for clinically significant prostate cancer (csPCa) detection.</p> Materials and methods <p>In our retrospective study, consecutive patients underwent multiparametric MRI for clinical suspicion of PCa. All scans were reviewed by six readers with varying expertise (two expert radiologists, &gt; 1,000 cases; two basic radiologists, 400‒1,000 cases; and two residents), with and without AI assistance. Intra-/inter-reader agreements and the impact of AI-assistance on patient-level csPCa scores and diagnostic performance, as well as benefit-to-harm ratios, were assessed.</p> Results <p>The population consisted of 100 patients with a 26% prevalence of csPCa. There was no improvement in inter-reader agreement with AI-assistance <i>versus</i> without (Fleiss κ 0.573 and 0.584, respectively). Residents were most likely to change PI-RADS scores on AI-assisted readings compared to basic and expert radiologists (19, 9, and 7 changes, respectively). Overall, there was no significant difference in area under the receiving operating characteristic curve between AI-assisted and AI-unassisted readings (0.87 <i>versus</i> 0.86; <i>p</i> = 0.734). At a PI-RADS ≥ 3 threshold, sensitivity was slightly lower with AI (0.87 <i>versus</i> 0.89), while specificity (0.73), positive predictive value (0.53–0.54), and negative predictive value (0.94–0.95) remained similar. Subgroup analyses showed no significant differences in diagnostic performance. A slight increase in grade selectivity and selective biopsy avoidance rate was observed among experts and residents, respectively, with AI-assisted readings when applying a PI-RADS cutoff of 3 or PSA density ≥ 0.15 ng/mL/mL.</p> Conclusions <p>AI did not significantly improve diagnostic accuracy across readers of varying expertise, with minor impacts on benefit-to-harm ratios.</p> Relevance statement <p>We found that AI support in prostate MRI did not significantly improve diagnostic accuracy across readers of varying experience, highlighting the need for further research to optimize AI integration and define its most clinically meaningful roles in prostate cancer detection.</p> Key points <p><UnorderedList Mark="Bullet"> <ItemContent> <p>Residents were most prone to PI-RADS score modifications after AI-assisted readings compared to AI-unassisted and expert readers.</p> </ItemContent> <ItemContent> <p>There was no significant difference in diagnostic performance metrics between AI-assisted and unassisted readings.</p> </ItemContent> <ItemContent> <p>A slight improvement in grade selectivity among experts and in selective biopsy avoidance among residents was observed during AI-assisted readings for biopsy recommendations.</p> </ItemContent> </UnorderedList></p> Graphical Abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Concurrent AI-human interaction in prostate cancer MRI interpretation: More hype than help?

  • Andrea Ponsiglione,
  • Giuseppe Di Costanzo,
  • Alfonso Maria Ponsiglione,
  • Ciro Riccio,
  • Andrea Rinaldo,
  • Anna Giacoma Tucci,
  • Lorenzo Pinto,
  • Luigi Palumbo,
  • Francesca Angelone,
  • Francesco Amato,
  • Arnaldo Stanzione,
  • Renato Cuocolo,
  • Rossano Girometti,
  • Anwar R. Padhani,
  • Massimo Imbriaco

摘要

Objective

We evaluated a commercial artificial intelligence (AI) system as a concurrent decision-support tool for clinically significant prostate cancer (csPCa) detection.

Materials and methods

In our retrospective study, consecutive patients underwent multiparametric MRI for clinical suspicion of PCa. All scans were reviewed by six readers with varying expertise (two expert radiologists, > 1,000 cases; two basic radiologists, 400‒1,000 cases; and two residents), with and without AI assistance. Intra-/inter-reader agreements and the impact of AI-assistance on patient-level csPCa scores and diagnostic performance, as well as benefit-to-harm ratios, were assessed.

Results

The population consisted of 100 patients with a 26% prevalence of csPCa. There was no improvement in inter-reader agreement with AI-assistance versus without (Fleiss κ 0.573 and 0.584, respectively). Residents were most likely to change PI-RADS scores on AI-assisted readings compared to basic and expert radiologists (19, 9, and 7 changes, respectively). Overall, there was no significant difference in area under the receiving operating characteristic curve between AI-assisted and AI-unassisted readings (0.87 versus 0.86; p = 0.734). At a PI-RADS ≥ 3 threshold, sensitivity was slightly lower with AI (0.87 versus 0.89), while specificity (0.73), positive predictive value (0.53–0.54), and negative predictive value (0.94–0.95) remained similar. Subgroup analyses showed no significant differences in diagnostic performance. A slight increase in grade selectivity and selective biopsy avoidance rate was observed among experts and residents, respectively, with AI-assisted readings when applying a PI-RADS cutoff of 3 or PSA density ≥ 0.15 ng/mL/mL.

Conclusions

AI did not significantly improve diagnostic accuracy across readers of varying expertise, with minor impacts on benefit-to-harm ratios.

Relevance statement

We found that AI support in prostate MRI did not significantly improve diagnostic accuracy across readers of varying experience, highlighting the need for further research to optimize AI integration and define its most clinically meaningful roles in prostate cancer detection.

Key points

Residents were most prone to PI-RADS score modifications after AI-assisted readings compared to AI-unassisted and expert readers.

There was no significant difference in diagnostic performance metrics between AI-assisted and unassisted readings.

A slight improvement in grade selectivity among experts and in selective biopsy avoidance among residents was observed during AI-assisted readings for biopsy recommendations.

Graphical Abstract