10 AI as a Bridge: Can ChatGPT Help Patients Understand Their Breast Radiology Reports?

News
Article
Miami Breast Cancer Conference® Abstracts Supplement42nd Annual Miami Breast Cancer Conference® - Abstracts
Volume 39
Issue 4
Pages: 62

10 AI as a Bridge: Can ChatGPT Help Patients Understand Their Breast Radiology Reports?

10 AI as a Bridge: Can ChatGPT Help Patients Understand Their Breast Radiology Reports?

Background/Significance

Large language models such as ChatGPT are increasingly used by patients to understand radiology reports. Studies have demonstrated that most patients have an 8th grade reading comprehension level. Readability metrics can assess whether radiology reports are close to a patient’s level of understanding. Our study aimed to evaluate whether ChatGPT model 4 could improve readability of breast imaging reporting and data system (BI-RADS) categories 3, 4, and 5 reports while maintaining accuracy.

Materials and Methods

Fifteen consecutive BI-RADS 3, BI-RADS 4, and BI-RADS 5 source reports were retrieved from the radiology database. ChatGPT prompts were given as follows: “please put the report into layperson terms” and “please provide recommendations for the patient.” ChatGPT prompts generated layperson reports and recommendations for all 45 source reports.

Readability of source reports, layperson reports, and layperson recommendations were analyzed for each BI-RADS category using Flesch-Kincaid readability score in grade level and word counts. Flesch-Kincaid score is an established tool used to assess health literacy. Grade level scores define the reading comprehension grade level. High word count is associated poorer readability. A radiologist evaluated the accuracy of ChatGPT-generated outputs by identifying inaccurate/misleading information and whether the layperson reports contained beneficial supplementary information not found in the original report. Statistical analysis was performed using 2-sided unpaired, equal-variance t-tests.

Results

Statistically significant decrease in mean grade level was identified for BI-RADS 3 source vs layperson reports (mean grade level, 10.9; SD = 1.8; vs mean grade level, 8.8; SD = 1.0; P = .003), and for BI-RADS 5 source vs layperson reports (mean grade level, 12.2; SD, 3.0; vs mean grade level, 9.6; SD = 0.8; P = .003). No statistical difference was seen in grade level between source reports and ChatGPT-generated recommendations for all 3 BI-RADS categories (Table 1).

Table 1. Mean Grade Level Scores With Accompanying Standard Deviations in Parentheses of Source Reports, ChatGPT-Generated Layperson Reports, and Recommendations for Each BI-RADS Category

Table 1. Mean Grade Level Scores With Accompanying Standard Deviations in Parentheses of Source Reports, ChatGPT-Generated Layperson Reports, and Recommendations for Each BI-RADS Category

There was a statistically significant decreased word count for BI-RADS 3 and BI-RADS 4 source vs ChatGPT-generated recommendations (P = .001 and P = .02, respectively). No statistically significant difference was observed between word count of source and layperson reports for all 3 BI-RADS categories.

ChatGPT-generated reports did not contain inaccurate or misleading information; however, the reports did offer beneficial supplementary information, particularly in terms of biopsy recommendations, compared with source reports.

Conclusion

ChatGPT improved readability (grade level) for BI-RADS 3 and 5 reports, and produced less wordy recommendations for BI-RADS 3 and 4 reports. ChatGPT-generated reports did not contain inaccurate information that would affect patient management. ChatGPT could be used to generate patient-friendly reports, which could potentially lessen patient anxiety surrounding breast imaging.

Articles in this issue

2 Preventive Care and Screening Adherence Among Women Surviving Breast Cancer
2 Preventive Care and Screening Adherence Among Women Surviving Breast Cancer
3 Intraoperative Radiotherapy: Alive and Well in the Bronx
3 Intraoperative Radiotherapy: Alive and Well in the Bronx
4 Evaluating AI-Driven Responses in Breast Reconstruction: A Comparative Study of Response Formats
4 Evaluating AI-Driven Responses in Breast Reconstruction: A Comparative Study of Response Formats
5 Correlation Between Visual Impairment and Breast Cancer: A Cross-Sectional Study Based on the National Health Interview Surveys
5 Correlation Between Visual Impairment and Breast Cancer: A Cross-Sectional Study Based on the National Health Interview Surveys
6 Peer Support Programming Among Women At-Risk for Surviving Breast Cancer: Facilitators and Barriers to Community-Based Patient Navigation and the Role of Quality of Life
6 Peer Support Programming Among Women At-Risk for Surviving Breast Cancer: Facilitators and Barriers to Community-Based Patient Navigation and the Role of Quality of Life
7 Metaplastic Breast Cancer: A Retrospective Chart Review of Clinical Features
7 Metaplastic Breast Cancer: A Retrospective Chart Review of Clinical Features
8 A Case Series Exploring Characteristics and Outcomes of Metachronous Primary Breast and Lung Cancer in a Diverse Cohort
8 A Case Series Exploring Characteristics and Outcomes of Metachronous Primary Breast and Lung Cancer in a Diverse Cohort
9 Body Mass Index, Cancer Risk Behaviors, and Readiness for Dietary Change Among Women Surviving With Breast Cancer
9 Body Mass Index, Cancer Risk Behaviors, and Readiness for Dietary Change Among Women Surviving With Breast Cancer
10 AI as a Bridge: Can ChatGPT Help Patients Understand Their Breast Radiology Reports?
10 AI as a Bridge: Can ChatGPT Help Patients Understand Their Breast Radiology Reports?
12 Gut Microbiome Composition and Pathological Complete Response After Chemotherapy in Breast Cancer: Insights From a Pilot Study
12 Gut Microbiome Composition and Pathological Complete Response After Chemotherapy in Breast Cancer: Insights From a Pilot Study
13 Preliminary Analysis of Change During Treatment of Financial Toxicity and Quality of Life in Breast Cancer Patients
13 Preliminary Analysis of Change During Treatment of Financial Toxicity and Quality of Life in Breast Cancer Patients
15 Utilizing Circulating Tumor Cells to Guide HER2-Directed Therapy in IHC/FISH-Negative HER2+ Metastatic Breast Cancer
15 Utilizing Circulating Tumor Cells to Guide HER2-Directed Therapy in IHC/FISH-Negative HER2+ Metastatic Breast Cancer
16 A Miami Hospital’s Infrastructure to Help Decrease Late-Stage Breast Cancer Diagnosis and Improve Health Equity
16 A Miami Hospital’s Infrastructure to Help Decrease Late-Stage Breast Cancer Diagnosis and Improve Health Equity
17 Salmonella and the Breast: A Literature Review of Salmonella-Induced Breast Abscesses
17 Salmonella and the Breast: A Literature Review of Salmonella-Induced Breast Abscesses
18 Tolerability of First-Line Treatment With Ribociclib for Metastatic Breast Cancer Using 2 Large US Data Sources
18 Tolerability of First-Line Treatment With Ribociclib for Metastatic Breast Cancer Using 2 Large US Data Sources
Recent Videos
Leading experts in the breast cancer field highlight the use of CDK4/6 inhibitors, antibody-drug conjugates, and other treatment modalities.
Patients with node-negative disease who are older and have comorbidities may not be suitable to receive CDK4/6 inhibitors.
An observed carryover effect with CDK4/6 inhibitors may reduce the risk of recurrence years after a patient stops treatment.
Breast oncologist Jade E. Jones, MD, says she tries to send patients with BRCA-mutant HR-positive TNBC to clinical trials that use PARP inhibitors.
Related Content