In a significant move, Google has scaled back parts of its AI-powered “AI Overviews” feature after it was found to be providing misleading health-related information to users.
AI Health Advice Sparks Concern
The decision comes after investigations revealed that AI-generated summaries in Google Search were offering inaccurate and potentially harmful medical advice. In some cases, the feature displayed incorrect data about critical health topics like liver function tests, which experts warned could mislead users about their actual health condition.
Health professionals flagged these responses as “dangerous” because they lacked proper context such as age, gender, or medical history—factors essential for accurate diagnosis.
Feature Removed for Certain Queries
Following the backlash, Google removed AI Overviews for several sensitive health-related search queries. Users searching for specific medical information will now no longer see AI-generated summaries in those cases, as the company works to improve accuracy.
However, reports suggest that variations of the same queries may still trigger AI responses, indicating that the issue is not fully resolved yet.
Criticism Over Wrong Medical Advice
The controversy deepened after instances surfaced where the AI gave questionable health guidance. For example, it reportedly suggested incorrect dietary advice for serious conditions like pancreatic cancer, contradicting expert recommendations.
Such errors raised serious concerns, especially since millions of users rely on Google Search for quick health information.
Another AI Health Feature Also Dropped
In a related development, Google has also discontinued another AI-based feature that aggregated health advice from online discussions. The tool, which showed suggestions from non-experts, was removed amid growing scrutiny over the reliability of AI-driven medical content.
Focus Shifts to Safer AI
While Google maintains that AI Overviews are designed to provide helpful and reliable information, the company has acknowledged the need for continuous improvements. The rollback signals a more cautious approach toward AI in sensitive areas like healthcare.
The move highlights a broader challenge for tech companies: balancing innovation in AI with the responsibility of delivering accurate and trustworthy information—especially when it comes to people’s health.
