New York limits children's use of AI chatbots

New York Governor Kathy Hochul signed a law on October 28 requiring operators of AI chatbots to verify users' ages and restrict companion-style features for users under 18.

The law applies to chatbot operators such as OpenAI's ChatGPT. If a user is a minor, covered chatbots cannot produce content that could lead the user to believe the system is human, alive or capable of human emotions. They also cannot generate outputs that frame the chatbot as having a personal, professional or authority relationship with the user, or present content as a personal opinion.

Hochul said minors would no longer have access to chatbots that pretend to be their friends, boyfriends or girlfriends. She also said chatbots would no longer be able to keep sensitive information about a minor's emotional and physical health.

Tech:NYC, a technology industry advocacy group, criticised what it called the law's “vague language” and said online safety should not cut children off from tools that help them learn and prepare for careers.

Common Sense Media praised the law, calling it “the strongest kids' AI safety bill in the country.” Its chief executive, Jim Steyer, said dangerous chatbot features for children and teenagers would be outlawed in New York.

OpenAI and Anthropic did not respond to AFP requests for comment.