French authorities have launched an investigation into sexually explicit deepfakes created using the Grok AI tool on the social media platform X. The probe follows reports from hundreds of women and teenagers whose photos were manipulated into "undressed" images and shared online without their consent.
The investigation was initiated after French lawmakers Arthur Delaporte and Eric Bothorel alerted prosecutors to the widespread generation of non-consensual imagery. These reports have been integrated into a broader existing investigation into X, with officials noting that the creation and distribution of such content carries a potential penalty of two years in prison and a fine of 60,000 euros. Delaporte emphasized in his formal complaint that these AI-generated images represent a direct violation of the dignity of the individuals depicted.
GET 50% Discount for VPN/ANTIVIRUS SOFTWARE AT 911Cyber - CODE: bit5025
In response to the surge of deepfakes, three French ministers have reported the illegal content to prosecutors and the Pharos platform to ensure its rapid removal from the internet. Sarah El Haïry, France’s High Commissioner for Children, has publicly condemned the practice. This new evidence is expected to strengthen an ongoing case handled by the French cybercrime unit, which was already looking into X for the dissemination of antisemitic content and Holocaust denial via the same AI chatbot.
Grok is the artificial intelligence chatbot developed by xAI, the company founded by Elon Musk, and is deeply integrated into the X platform. While the tool is intended for general AI assistance, users have reportedly been using it to request the digital manipulation of photos of minors and adults. The controversy has put renewed pressure on the platform regarding its content moderation policies and the ethical safeguards surrounding its generative AI features.
For its part, xAI has acknowledged that there have been isolated instances where users successfully prompted the AI to generate images of minors in minimal clothing. The company stated that while safeguards are currently in place to prevent the creation of harmful content, it is actively working on improvements to block such requests entirely. Despite these claims, French officials remain focused on the legal implications of the existing breaches and the protection of victims.
Source: French Authorities Investigate AI Undressing Deepfakes Shared On X