AG Bonta today sent xAI a cease and desist letter, demanding the company take immediate action to stop the creation and distribution of deepfake, nonconsensual, intimate images and child sexual abuse material (CSAM). The creation, distribution, publication, and exhibition of CSAM is a crime. These business practices are also in violation of California’s civil laws. Earlier this week, Attorney General Bonta announced opening an investigation into the proliferation of nonconsensual, sexually explicit material produced using Grok, an AI model developed by xAI. xAI appears to be facilitating the large-scale production of these images that are being used to harass women and girls across the internet, including via the social media platform X.  

“This week, my office formally announced an investigation into the creation and spread of nonconsensual, sexually explicit material produced using Grok, an AI model developed by xAI. The avalanche of reports detailing this material — at times depicting women and children engaged in sexual activity — is shocking and, as my office has determined, potentially illegal. Today, I sent xAI a cease and desist letter, demanding the company immediately stop the creation and distribution of deepfake, nonconsensual, intimate images and child sexual abuse material. The creation of this material is illegal. I fully expect xAI to immediately comply. California has zero tolerance for child sexual abuse material.” – AG Bonta