Inter-reader agreement of the BI-RADS CEM lexicon

Purpose

The purpose of this study was to assess the inter-reader agreement of the breast imaging reporting and data system (BI-RADS) contrast-enhanced mammography (CEM) lexicon.

Materials and methods

In this IRB-approved, single-center, retrospective study, three breast radiologists, each with different levels of experience, reviewed 462 lesions in 421 routine clinical CEM according to the fifth edition of the BI-RADS lexicon for mammography and to the first version of the BI-RADS lexicon for CEM. Readers were blinded to patient outcomes and evaluated breast and lesion features on low-energy (LE) images (breast density, type of lesion, associated architectural distortion), lesion features on recombined (RC) images (type of enhancement, characteristic of mass enhancement, non-mass enhancement or enhancing asymmetry), and provided a final BI-RADS assessment. The inter-reader agreement was calculated for each evaluated feature using Fleiss’ kappa coefficient. Sensitivity and specificity were calculated.

Results

The inter-reader agreement was moderate to substantial for breast density (ĸ = 0.569), type of lesion on LE images (ĸ = 0.654), and type of enhancement (ĸ = 0.664). There was a moderate to substantial agreement on CEM mass enhancement descriptors. The agreement was fair to moderate for non-mass enhancement and enhancing asymmetry descriptors. Inter-reader agreement for LE and LE with RC BI-RADS assessment was moderate (ĸ = 0.421) and fair (ĸ = 0.364). Diagnostic performance was good and comparable for all readers.

Conclusion

Inter-reader agreement of the CEM lexicon was moderate to substantial for most features. There was a low agreement for some RC descriptors, such as non-mass enhancement and enhancing asymmetry, and BI-RADS assessment, but this did not impact the diagnostic performance.

Key Points

Question Data on the reproducibility and inter-reader agreement for the first version of the BI-RADS lexicon dedicated to CEM are missing.

Finding The inter-reader agreement for the lexicon was overall substantial to moderate, but it was lower for the descriptors for non-mass enhancement and enhancing asymmetry.

Clinical relevance A common lexicon simplifies communication between specialists in clinical practice. The good inter-reader agreement confirms the effectiveness of the CEM-BIRADS in ensuring consistent communication. Detailed definitions of some descriptors (non-mass, enhancing asymmetry) are needed to ensure higher agreements.