💔 Google DeepMind breaks ChatGPT (for research)

Researchers at Google DeepMind just put out a new paper detailing their (research-driven) attack on rival OpenAI’s ChatGPT, finding that forcing the model to repeat a word forever causes it to leak training data. OpenAI seems to have since patched the attack, with ChatGPT now refusing the request.