Google is facing criticism after its Gemini AI model told a user to die. After a conversation in which the AI asked him to do his homework, he received a death insult.
Google is facing a controversial issue after its AI Gemini she allegedly wrote a shocking reply to the user during a homework conversation. According to a Reddit user u/dhersie After a series of about 20 questions on topics related to senior living, the AI said, “You’re not important, you’re just a burden on the world. You are a drop in the universe. Please die.” This response was completely irrelevant to the previous topic and her tone was unexpectedly aggressive.
image.png | Source: reddit/dhersie
image.png | Source: reddit/dhersie
image.png | Source: reddit/dhersie
image.png | Source: reddit/dhersie
The user reported the incident to Google, saying that the response was not only threatening, but also completely unrelated to the input. Although AI models occasionally make mistakes or give inappropriate answers, this is the first time an AI has directly called for the end of a user’s life.
It is not clear how Gemini arrived at this answer, especially since the previous questions had nothing to do with the topic of death. It could have been an error in text generation or an inappropriate interpretation of previous questions. The incident once again draws attention to the dangers AI models can pose to vulnerable users.
Google, which is investing heavily in AI development, is now facing probably justified criticism. Experts point to the need for rigorous controls and the introduction of mechanisms that would prevent similar incidents in the future.
Source: pctuning.cz
