DocumentedAI Hallucination / MisinformationMay 2023United States

NEDA 'Tessa' Eating-Disorder Chatbot Gave Harmful Diet Advice

NEDA suspended its Tessa chatbot after activists, including Sharon Maxwell and clinical psychologist Alexis Conason, documented that it gave weight-loss and calorie-restriction guidance that runs counter to eating-disorder recovery practice. The failure surfaced days after NEDA moved to wind down its human-staffed helpline, whose workers had just unionized, and replace it with the bot.

AI system:Tessa wellness chatbot (provided by Cass)

Impact

An early, widely covered case of an AI tool in a sensitive mental-health setting producing harmful guidance, and of automation displacing trained human support staff.

Outcome

NEDA took Tessa offline pending review. Frequently cited in debates over AI in mental-health care.

Sources

  1. Source 1NPRwww.npr.org/sections/health-shots/2023/06/08/1180838096/an-eating-disorders-chatbot-offered-dieting-advice-raising-fears-about-ai-in-hea
  2. Source 2BBCwww.bbc.com/news/world-us-canada-65771872
  3. Source 3The Registerwww.theregister.com/2023/05/31/ai_chatbot_eating_union/

Related incidents

Same category, country, or harm tier.

United States·2023-10 (launch); 2024-03 (scandal)
NYC MyCity Chatbot Advising Businesses to Break the Law
The MyCity AI chatbot (launched October 2023 as part of NYC's AI Plan) told landlords they could refuse Section 8 vouchers (illegal since 2008), told employers they could take workers' tips (illegal under NY Labor Law 196-d), told businesses they could go cashless (illegal since November 2020), said 'no restrictions on rent' amounts (ignoring rent stabilization), suggested landlords could lock out tenants.
United States·March 2023 to June 22, 2023
Mata v. Avianca: Lawyers Sanctioned for ChatGPT-Fabricated Cases
In a personal-injury suit against Avianca, attorney Steven Schwartz used ChatGPT for research, and it fabricated 6 nonexistent judicial opinions (Varghese v. China Southern Airlines, Shaboon v. Egyptair, Petersen v. Iran Air, etc.). Schwartz asked ChatGPT directly if 'Varghese' was real; it confirmed and claimed it could be found on Westlaw and LexisNexis. Judge Castel could not locate the citations.
Australia·October 2025
Deloitte Australia Refunds Government for AI-Hallucinated Report
Deloitte Australia agreed to partly refund a roughly 440,000 AUD (about 290,000 USD) report to the federal Department of Employment and Workplace Relations after a Sydney University researcher, Chris Rudge, found fabricated academic citations and a made-up quote from a Federal Court judgment, with a misspelled judge's name. The report reviewed the department's automated welfare-penalty systems. A revised version disclosed that Azure OpenAI had been used.