Skip to content
Chimera readability score 0.5751 out of 100, reading level.

Follow ZDNET: Add us as a preferred source on Google.
ZDNET's key takeaways
- People are turning to AI for health advice.
- It can get lots wrong.
- One doctor offers her advice on using AI.
You can find health advice anywhere these days, regardless of credibility or medical expertise.
This increased information availability has changed how people interact with medical professionals -- or whether they trust them in the first place. This broader access to health-related guidance also arrives amid historically low levels of trust in the healthcare system. A new poll from the Annenberg Public Policy Center finds that public trust in federal agencies like the Centers for Disease Control, the Food and Drug Administration, and the National Institutes of Health decreased by 5-7% over the past year.
Whether or not the tech world is capitalizing on this declining trust, it's certainly making medical alternatives more convenient. The reality is that people are turning to this often free, always available, and quick-to-use technology for answers that a doctor or medical professional would once provide. A recent survey found that 63% of respondents find AI-generated health information reliable, according to Annenberg.
Also: Oura built a women's health AI using clinical research - how to try it
Google, OpenAI, and Anthropic, three of the major AI players, have built health-oriented large language models (LLMs) for healthcare professionals. On Thursday, Microsoft unveiled Copilot Health, a secure medical AI tool that combines health records, wearable data, and health history, and it comes on the heels of Microsoft's "Copilot for health" feature it debuted last year. Rumors are circulating that Apple could be developing its own health AI, and Oura just launched an experimental custom women's health LLM.
For Dr. Alexa Mieses Malchuk, the technology has changed how her patients interact with her -- and how this family physician does her job.
AI can give users thorough explanations and answers to every health query under the sun. But it can also get lots wrong. In an interview with ZDNET, Mieses Malchuk discussed the usefulness and pitfalls of health AI, and how patients should approach the technology.
How she uses AI
Mieses Malchuk isn't AI-intolerant. In fact, she uses it to streamline administrative work, such as triaging patient messages and creating anticipatory guidance before a visit. AI companies continue to build more software for doctors and medical professionals. Just last week, Amazon and Google announced their own healthcare software products for scheduling doctors' appointments, clinical documentation, and medical coding. Administrative burdens in medicine have historically been an issue for doctors, who report spending more time completing paperwork than serving patients face-to-face.
Also: OpenAI, Anthropic, and Google all have new AI healthcare tools - here's how they work
"There are really neat and cool things like that happening all over healthcare that have kind of streamlined the work of a primary care physician," Mieses Malchuk explained. Still, she's aware of the technology's limitations.
AI as a springboard
For medical nonprofessionals, she recommends using AI as a springboard, not as the end-all, be-all for medical advice. It can be satisfying to immediately receive an answer from one of these chatbots, and sometimes the AI's response can provide a sense of certainty that assuages worries, but she reminds users that these tools cannot diagnose conditions -- and that most patients sifting through these responses aren't medically trained to know wrong from right.
AI chatbot users may be omitting important information about their medical situations, leading to a fundamentally different diagnosis or treatment, Mieses Malchuk said. "Their responses are only as good as the questions we ask."
"It's not that people without medical training shouldn't have access to AI. They should be partnering with their primary care physician to help sift through what they're finding online."
Also: The Apple Watch missed my hypertension - but this blood pressure wearable caught it immediately
As these AI health tools have grown in popularity, she's seen patients come to her less willing to share that they've done their own research using these tools -- but more certain about what they believe their diagnosis to be.
"Even in medicine, there's not always 100% certainty about anything. On one hand, it's great that we live in this day and age where we have access to information literally at our fingertips, but there are some real downsides to that," she noted.
Mieses Malchuk fears AI tools like ChatGPT could give people a false sense of security, telling people they don't have to go to the doctor or get a condition examined. "That could be a missed opportunity to diagnose something early," she said.
Among gold-standard emergencies, a recent study in Nature found that ChatGPT undertriaged over half of cases and directed patients to a 24-48-hour evaluation rather than the emergency department. "Our findings reveal missed high-risk emergencies and inconsistent activation of crisis safeguards, raising safety concerns that warrant prospective validation before consumer-scale deployment of artificial intelligence triage systems," the authors write.
How AI can help patients
Mieses Malchuk recommends using AI health tools for recommendations on general wellness advice. Maybe a patient was recently diagnosed with celiac disease and wants to know which foods they should and shouldn't eat. AI can create a meal plan, generate ideas, and provide helpful recommendations. It's also great for workout planning, and it's quite easy to create a customized workout regimen with the help of an AI tool.
Also: Are AI health coach subscriptions a scam? My verdict after testing Fitbit's for a month
All in all, it's a great wellness tool for those without medical training. But leave the diagnostics and treatments to the professionals.
"Mistrust in the medical system is growing, which is really a travesty. We take this oath to first do no harm, so the idea that these other resources are giving patients this false sense of confidence and making them think they can completely bypass seeing a physician -- it's an unfortunate step point," Mieses Malchuk said.

Facts Only

63% of survey respondents find AI-generated health information reliable.
Public trust in federal health agencies (CDC, FDA, NIH) decreased by 5-7% over the past year.
Google, OpenAI, and Anthropic have developed health-oriented large language models (LLMs) for healthcare professionals.
Microsoft launched Copilot Health, a secure medical AI tool combining health records, wearable data, and health history.
Apple is rumored to be developing its own health AI.
Oura released an experimental women's health LLM.
Dr. Alexa Mieses Malchuk uses AI for administrative tasks like triaging patient messages.
A *Nature* study found ChatGPT undertriaged over half of emergency cases, directing patients to delayed evaluations.
Mieses Malchuk recommends AI for general wellness advice, such as meal planning or workout regimens.
She warns against using AI for diagnostics or treatments.
Patients are increasingly certain about self-diagnoses from AI but less willing to disclose their research to doctors.

Executive Summary

People are increasingly turning to AI for health advice, with 63% of respondents in a recent survey finding AI-generated health information reliable. This shift comes amid declining trust in federal health agencies like the CDC and FDA, which saw a 5-7% drop in public trust over the past year. Major tech companies, including Google, OpenAI, and Anthropic, are developing health-oriented AI tools, while Microsoft recently unveiled Copilot Health, integrating health records and wearable data. Dr. Alexa Mieses Malchuk, a family physician, acknowledges AI's utility in streamlining administrative tasks but warns against relying on it for diagnostics. She notes that AI can provide general wellness advice, such as meal planning for conditions like celiac disease, but emphasizes that it lacks the ability to diagnose or treat medical conditions accurately. Studies, including one in *Nature*, highlight risks like undertriage in emergencies, where AI may delay critical care. Mieses Malchuk advocates for AI as a supplementary tool, urging patients to collaborate with healthcare professionals rather than replace them.

Full Take

The narrative presents a tension between the convenience of AI health tools and their limitations, framed by declining trust in traditional healthcare systems. The strongest version of this argument acknowledges AI's potential to democratize health information while highlighting its risks—misdiagnosis, false reassurance, and delayed care. However, the piece leans into a pattern of **ARC-0024 Ambiguity**, where the line between AI as a supplementary tool and a replacement for professional care is blurred. The emphasis on AI's reliability (63% of respondents) contrasts with studies showing its failures in emergencies, creating a false equivalence between user perception and clinical reality.
Root causes include systemic distrust in healthcare institutions, exacerbated by tech companies positioning AI as a "liberation" from bureaucratic inefficiencies. The paradigm assumes that accessibility equals accuracy, ignoring the nuance of medical expertise. Implications for human agency are stark: patients may forgo critical care due to AI's false confidence, while doctors face eroding authority. The cost is borne by those who misplace trust in unproven tools, while tech giants benefit from data monetization and user dependency.
Bridge questions: How might AI tools be designed to explicitly defer to human judgment rather than compete with it? What safeguards could prevent AI from reinforcing confirmation bias in self-diagnosis? Would transparency about AI's error rates shift public trust?
Counterstrike scan: A coordinated influence campaign would amplify AI's benefits while downplaying risks, using **ARC-0043 Motte-and-Bailey** ("AI is just a tool" vs. "AI can replace doctors"). The article avoids this trap by citing both user trust and clinical studies, though it could better emphasize AI's role as an adjunct, not a substitute. No structural alignment with manipulation detected.
Patterns detected: ARC-0024 Ambiguity, ARC-0043 Motte-and-Bailey (potential, not fully realized)

Sentinel — Human

Confidence

The article shows strong human signals, including expert commentary, stylistic quirks, and specific sourcing, with minimal stylometric red flags.

Signals Detected
low severity: Moderate sentence length variance with some erratic phrasing, but occasional uniform transitions ('Also:', 'Still,')
low severity: Balanced framing but includes idiosyncratic emphasis (e.g., 'false sense of security') and personal voice (doctor's direct quotes)
low severity: Some vague attributions ('a recent survey') but includes specific sources (Annenberg, Nature study) and unique doctor commentary
Human Indicators
Direct quotes from Dr. Mieses Malchuk with personal anecdotes and professional opinions
Idiosyncratic phrasing ('travesty', 'unfortunate step point')
Structural digressions (e.g., Apple Watch tangent)
Specific study citations with methodological context