French prosecutors have opened a criminal investigation into Elon Musk and X (formerly Twitter) over the platform’s handling of AI-generated deepfake content. The probe follows complaints alleging that X failed to adequately moderate or remove manipulated media, including non-consensual deepfake pornography and politically targeted disinformation.
Overview
The investigation was initiated by Paris prosecutors under France’s laws against digital harassment, defamation, and the dissemination of false information. While the specific charges have not been disclosed, the case centers on X’s role in hosting and amplifying AI-generated content that violates French regulations. French authorities have previously taken a hard line against tech platforms over content moderation, with fines and legal action against companies like Meta and Google for similar violations.
Legal Context
France’s legal framework for digital content includes:
- Loi Avia (2020): Requires platforms to remove hate speech and illegal content within 24 hours or face fines up to 1.25 million euros.
- Non-consensual deepfake laws: Criminalizes the creation and distribution of sexually explicit deepfakes without consent, punishable by up to two years in prison and fines of 60,000 euros.
- Disinformation laws: Mandates transparency in political advertising and penalizes the spread of false information during elections.
The probe into X marks one of the first high-profile cases targeting a social media platform’s handling of AI-generated deepfakes under these laws.
X’s Response and Platform Policies
X has not publicly commented on the investigation. The platform’s current policies prohibit non-consensual nudity and manipulated media, but enforcement has been inconsistent. Since Musk’s acquisition of Twitter in 2022, X has reduced its content moderation teams and reinstated previously banned accounts, leading to criticism over increased misinformation and harmful content.
Key changes under Musk’s leadership include:
- Reduced moderation staff: Layoffs and resignations have significantly cut the teams responsible for reviewing content.
- Paid verification (X Premium): Critics argue that the subscription model incentivizes the spread of viral (and often misleading) content, as verified users gain greater visibility.
- Algorithm changes: X’s