French and Malaysian authorities investigating Grok for generating sexualized deepfakes

In recent days, France and Malaysia have joined India in condemning Grok for creating sexualized deepfakes of women and minors.

The chatbot, built by Elon Musk’s AI startup xAI and featured on its social media platform posted an apology on his account earlier this week, writing: “I deeply regret an incident that occurred on December 28, 2025, in which I generated and shared an AI image of two young girls (estimated to be between 12 and 16 years old) in sexualized attire based on a user’s prompt.

The statement continued: “This violated ethical standards and potentially U.S. laws on [child sexual abuse material]. This is a failure of warranties and I am sorry for any harm caused. xAI is currently reviewing to avoid future issues.

It’s unclear who is apologizing or accepting responsibility in the above statement. Albert Burneko of the defector noted that Grok “doesn’t look like an ‘I’ in any way,” which, in his opinion, makes the apology “totally devoid of substance,” because “Groc cannot be held meaningfully accountable for turning Twitter into an on-demand CSAM factory.”

Futurism discovered that in addition to generating non-consensual pornographic images, Grok was also used to generate images of women being sexually assaulted and abused.

“Anyone who uses Grok to create illegal content will face the same consequences as if they downloaded illegal content,” Musk posted on Saturday.

Some governments have taken note, with Indian IT Ministry issues order on Friday saying that The order states that X must respond within 72 hours or risk losing “safe harbor” protections that shield it from legal liability for user-generated content.

French authorities also said they were taking action, with the Paris prosecutor’s office telling Politico they would do so. investigate the proliferation of sexually explicit deepfakes on X. France’s digital ministry said three government ministers had reported “manifestly illegal content” to the prosecution and a government online monitoring platform “to obtain its immediate removal.”

The Malaysian Communications and Multimedia Commission issued a statement stating that it had “taken note with serious concern of public complaints regarding the misuse of artificial intelligence (AI) tools on the X Platform, in particular the digital manipulation of images of women and minors to produce indecent, grossly offensive and otherwise harmful content.”

The commission added that it was “currently investigating online harm in X”.