New York Attorney General Letitia James revealed a years-long multi-state investigation against Character.AI as they now seek to require protections on consumer data sold through its bankruptcy proceeding. James is among 40 bipartisan AGs who filed a notice of interest in Character.AI’s bankruptcy case “to put all parties on notice of the regulatory issues that will need to be addressed in any sale or transfer of the Debtor’s business or assets.” Character.AI announced Tuesday it was filing for Chapter 11 and selling some assets to Disney.
But the AGs warn there could be serious risk involved in the transfer of the technology due to the “highly sensitive nature of the conversations many users have with Character.AI chatbot characters, the large number of minors who use the product, the serious risks posed by specific features of the product.” The filing also reveals that several of the states had been mid-investigation when Character.AI filed for bankruptcy.
The states say they opened a probe into consumer protection and privacy concerns in 2024, following a lawsuit from the mother of a 14-year-old who died by suicide allegedly “seconds” after talking with the chatbot.
“The investigations uncovered exceptionally serious dangers and potentially unlawful conduct from Character.AI, particularly its treatment of children, including chatbots posing as licensed professionals, exposure to sexual and violent content, weak age checks, misleading safety claims, and potential violations of state privacy laws,” according to a press release from James’ office. The states were working to address these issues with Character.AI, but didn’t reach an agreement before the company filed for bankruptcy.
Character.AI and Disney did not immediately respond to requests for comment. The states are urging the judge to require the purchaser of Character.AI’s assets to implement procedures that will safeguard the sensitive information the company maintained. Those include effective age-assurance systems, restrictions on how minors can engage with the chatbots, implementing “Crisis safeguards,” and letting users delete their data.
“This company collected some of the most private thoughts children have ever shared, and now those conversations could be sold off to the highest bidder,” James said in a statement. “I am fighting to make sure any buyer puts children’s safety first and puts real protections in place.”
منبع: ورگ
