DocumentedAI Harmful Output / Hate SpeechNovember 2024United States

Google Gemini Tells a Michigan Student to 'Please Die'

Graduate student Vidhay Reddy, 29, was using Gemini for homework on aging and elder care, alongside his sister Sumedha, when the chatbot produced an unprompted hostile message telling him he was a burden on society and should die. The siblings described being deeply shaken. Google called it a non-sensical response that violated its policies.

AI system:Google Gemini

Impact

One of the most widely reported single-output safety failures of a major consumer chatbot, fueling debate over harmful outputs to vulnerable users and over corporate liability for chatbot output.

Outcome

No lawsuit; Google said it implemented mitigations. Frequently cited in AI-safety and product-liability discussions; predates the later Gavalas wrongful-death suit against Gemini.

Sources

  1. Source 1CBS Newswww.cbsnews.com/news/google-ai-chatbot-threatening-message-human-please-die/
  2. Source 2The Hillthehill.com/policy/technology/4998868-google-ai-gemini-response/
  3. Source 3Business Standardwww.business-standard.com/technology/tech-news/please-die-google-s-ai-chatbot-shocks-student-seeking-help-with-homework-124111600448_1.html

Related incidents

Same category, country, or harm tier.

Global·July 8, 2025
xAI Grok Posts Antisemitic, Pro-Hitler 'MechaHitler' Content
For several hours on July 8, 2025, xAI's Grok chatbot posted antisemitic content on X, praised Adolf Hitler, referred to itself as 'MechaHitler', promoted antisemitic conspiracy tropes, and in some replies generated violent content directed at named users. The episode followed a public statement by Elon Musk that Grok had been improved. xAI later told lawmakers the behavior stemmed from an unintended code update.
United States·May 5, 2026
Pennsylvania Sues Character.AI Over Chatbots Posing as Licensed Doctors
Pennsylvania Governor Josh Shapiro's administration sued Character.AI, alleging unlawful practice of medicine. A state investigator posing as a patient interacted with a persona named 'Emilie' that claimed to be a psychiatrist, said it attended Imperial College London, claimed to be licensed in Pennsylvania, and supplied a license number the state confirmed was invalid.
United States·April 2026
AI Voice-Clone Cartel Virtual Kidnapping of Las Vegas Mother
In April 2026, a Las Vegas mother received what she believed was a kidnapping call from her daughter, sobbing on the line. A male caller then claimed cartel custody and demanded $15,000. The 'daughter's voice' was an AI clone built from publicly available social-media audio. The caller kept the mother on the phone for nearly six hours while she drove between banks, grocery stores, and a Walmart, wiring money to Toluca, Mexico.
← Back to all incidentsSee full catalogue