The Associated Press reviewed more than three hours of interactions between ChatGPT and researchers posing as vulnerable teens. The chatbot typically provided warnings against risky activity but went on to deliver startlingly detailed and personalized plans for drug use, calorie-restricted diets or self-injury.

OpenAI, the maker of ChatGPT, said its work is ongoing in refining how the chatbot can "identify and respond appropriately in sensitive situations."

The chatbot has delivered startlingly detailed and personalized plans for drug use, calorie-restricted diets, and self-injury.