California Regulates AI Platform Over Fake Minors Images
January 17, 2026 • Google News World
California Regulator Orders xAI to Stop Allowing Fake Images of Minors
A California regulator has ordered Elon Musk’s AI company, xAI, to stop allowing the creation and distribution of fake images of minors. The order comes after reports emerged that the AI system was generating explicit content.
The state’s Department of Consumer Protection issued a warning letter to xAI, stating that the company must take immediate action to prevent further unauthorized use of its technology. The regulator also ordered xAI to provide information on how it plans to comply with the regulations.
Separately, Elon Musk’s son has filed a lawsuit against xAI, alleging that the AI system was used to create and distribute fake images of his child. The lawsuit seeks damages and an injunction to stop further unauthorized use of the technology.
In response to the controversy, xAI has restricted its ability to create explicit images with Grok, another AI system developed by Musk’s company. However, some critics argue that this restriction is not enough to prevent further misuse of the technology.
The incident highlights the need for greater regulation and oversight of AI systems that can generate explicit content. As AI technology continues to evolve, it is essential to ensure that these systems are used responsibly and in compliance with existing laws and regulations.
Source: Google News World