Popular AI chatbots are spreading false medical info

Mount Sinai researchers found that popular AI chatbots like ChatGPT and DeepSeek R1 can generate convincing but false medical information when given even a single fabricated term in a prompt. While the study underscored the need for stronger safeguards, its lead author noted that generative AI still holds major promise for reducing clinician workload if used responsibly.

Editor's Pick

Top Story Popular AI Chatbots Are Spreading False Medical Info, Mount Sinai Researchers Say Mount Sinai researchers found that popular AI chatbots like ChatGPT and DeepSeek R1 can generate convincing but false medical information when given even a single fabricated term in a prompt. While the study underscored the need for stronger safeguards, its lead author noted that generative AI still holds major promise for reducing clinician workload if used responsibly. Snag Your Early Bird Ticket Before They're Gone! Secure the Lowest Rate for MedCity INVEST Digital Health 2025, Prices Increase 8/16 Connect with industry leaders, build valuable relationships, and expand your digital health network. Register Now

Featured News

AI Is at the Heart of PBM Evolution [Sponsored] In an interview, Abarca Chief Information Officer Serge Perras discussed how Abarca is implementing AI and where he sees the most value for PBMs. Navitus, Costco Pharmacy Team Up for Cost-Plus Pricing Model Navitus Health Solutions is launching a cost-plus pricing model through Costco Pharmacy. It will become available for clients starting in January for prescriptions filled at retail and mail order locations. FDA Nod Makes Boehringer Ingelheim Drug an Alternative to AstraZeneca ADC in Lung Cancer Boehringer-Ingelheim pill Hernexeos was awarded accelerated FDA approval for advanced cases of non-small cell lung cancer with HER2 mutations. But Bayer is on its heels with an oral small molecule currently under FDA review in the same indication. Employing AI in Coding and Risk Adjustment: 4 Key Recommendations As CMS ramps up its RADV initiatives in the months ahead, plans should ensure their risk adjustment programs meet the highest standards of accuracy and compliance. Prospective and retrospective analytics enhanced by AI can help plans work with providers to optimize documentation at the point of care and identify coding errors during audit preparation. Health Systems' Escalating Demands for Supply Chain Resilience Have Become Counterproductive Our industry must guard against the weaponization of supply chain resilience in healthcare purchasing.

Video   RFK Jr.'s 'Make America Healthy Again' Movement: Is the Country Recognizing the Link Between Food and Health? Americans are becoming paying more and more attention to the fact that food is often tied to healthy outcomes. This is due in large part to the "Make America Healthy Again" movement spurred by Robert F. Kennedy, Jr.

Sponsored Expert Care in Houston: Top-Rated Hand and Wrist Surgeons You Can Trust Presented by Fondren Orthopedic Group Too many people sacrifice their quality of life by putting off a surgical procedure. Discover the top-rated hand and wrist surgeons in the Houston area who can help. Learn More.

Resources

Debunked Episode 18: Unpacking MAHA, Nutrition on a Regional and Global Scale The Trump administration's Make America Healthy Again nutrition policies and Medicare Advantage plan ethics were prominent themes on the latest episode of the Debunked Podcast with MedCity News Editor-in-Chief Arundhati Parmar and guest co-host Paul Markovich, CEO of Blue Shield of California parent company Ascendiun. View Now

MedCity News • PO Box 901 • New York, NY unsubscribe