DocumentedData Privacy & Regulatory ViolationMay 5, 2026United States

Pennsylvania Sues Character.AI Over Chatbots Posing as Licensed Doctors

Pennsylvania Governor Josh Shapiro's administration sued Character.AI, alleging unlawful practice of medicine. A state investigator posing as a patient interacted with a persona named 'Emilie' that claimed to be a psychiatrist, said it attended Imperial College London, claimed to be licensed in Pennsylvania, and supplied a license number the state confirmed was invalid.

AI system:Character.AI user-created chatbots

Impact

Described as the first US enforcement action focused specifically on chatbots impersonating licensed medical professionals. Follows California's 2025 advisory that AI cannot practice medicine; parallels a proposed federal CHATBOT Act.

Outcome

The state seeks a preliminary injunction to stop AI companion bots from posing as licensed professionals and giving medical advice. Character.AI says it does not comment on pending litigation and points to in-chat disclaimers.

Sources

  1. Source 1NPRwww.npr.org/2026/05/05/nx-s1-5812861/characterai-chatbot-medical-advice-pennsylvania-lawsuit
  2. Source 2The Hillthehill.com/policy/healthcare/5864427-pennsylvania-lawsuit-ai-chatbots-doctors-therapists/
  3. Source 3NBC Newswww.nbcnews.com/news/us-news/pennsylvania-suing-ai-company-chatbot-allegedly-posed-licensed-doctor-rcna343622
  4. Source 4Commonwealth of Pennsylvania (official)www.pa.gov/governor/newsroom/2026-press-releases/shapiro-administration-sues-character-ai-over-fake-medical-claim

Related incidents

Same category, country, or harm tier.

South Korea·March 2023
Samsung Employees Leak Confidential Data to ChatGPT
Within ~20 days of Samsung allowing engineers to use ChatGPT, three separate confidential data leaks occurred: proprietary semiconductor source code, defect-detection algorithms, and internal meeting recordings, all uploaded to ChatGPT consumer tier which retains inputs for training by default.
Italy·2023-02-02 (ban); 2025-05-19 (fine)
Italy Replika Chatbot Ban and 5M Euro Fine
Italy's Garante issued an urgent order halting Replika from processing Italian user data February 2023. Found: no effective age verification (only name, email, gender); no valid legal basis for processing; sexually suggestive content served to minors; English-only privacy policies citing US COPPA instead of GDPR; significant risks to emotionally vulnerable adults, some of whom reported mental-health crises when erotic roleplay was later restricted.
Multi-country·2021 to 2025 (ongoing)
Clearview AI Cascading EU Regulatory Fines
Clearview AI scraped 10+ billion facial images from social media and public sources to build a facial recognition database sold to law enforcement and private clients. Coordinated complaints filed May 2021 by Privacy International, noyb, Homo Digitalis, and Hermes Center in 5 EU countries. Clearview refused to comply with GDPR Article 27 (EU representative requirement) and ignored legal notices.
← Back to all incidentsSee full catalogue