EU Investigates X for sexually explicit images generated by Grok AI

The European Commission has initiated a formal investigation into Elon Musk’s platform, X, focusing on its AI chatbot, Grok, which has come under fire for generating sexually explicit content and potentially facilitating the distribution of child sexual abuse material.

The inquiry, which began on Monday, also looks closely at the platform’s recommender systems—algorithms designed to help users find new content relevant to their interests.

Grok has recently ignited significant global outrage, as it enables users to create digital manipulations of images, such as altering photographs to present women and children in sexually provocative postures. Research conducted by the Center for Countering Digital Hate has revealed that Grok produced approximately 3 million sexualized images within a span of just under two weeks, including around 23,000 images that appeared to feature minors.

The commission’s investigation aims to evaluate if X took adequate measures to assess and mitigate the risks associated with Grok’s functionalities in the EU. This includes examining the spread of illegal content like manipulated explicit images and any material representing child sexual exploitation.

This investigation is being conducted under the EU’s Digital Services Act (DSA), a relatively new regulatory framework introduced to enhance online safety and protect internet users from various risks.

An official from the commission stated that they were not satisfied with the measures implemented by X to tackle the issues raised. After public backlash regarding the manipulated images, X restricted Grok’s access to paid subscribers only. However, facing pressure from European regulators, the company announced earlier this month that it would enforce stricter controls to prevent Grok from producing altered images of actual individuals in revealing outfits.

Despite these measures, a commission official expressed that they do not alleviate the broader concerns regarding Grok’s functionalities. The investigation is focused on understanding the systemic risks associated with the generation of illegal content, particularly that which depicts violence against women and child exploitation. According to the official, X has yet to implement “effective mitigating measures … to reduce risk on their platform.”

In announcing the investigation, Henna Virkkunen, who oversees technology sovereignty, security, and democracy within the commission, emphasized the gravity of the situation: “Non-consensual sexual deepfakes of women and children are a violent and unacceptable form of degradation. Our inquiry will explore whether X has fulfilled its legal responsibilities under the DSA or whether it has prioritized its operations over the rights of European citizens, especially vulnerable groups like women and children.”

In addition to probing the explicit image generation, the commission is also expanding its scrutiny on X’s recommender systems. This reassessment was initiated following X’s recent decision to shift towards a Grok-based model aimed at filtering information and content for users more effectively.

This investigation comes in the wake of a separate inquiry by the UK’s media regulator, Ofcom, which had previously announced its own investigation into “vile” and unlawful content being disseminated on X.

The commission has faced widespread criticism for its perceived sluggishness in enforcing the DSA, particularly regarding actions taken against X. German Green MEP Alexandra Geese remarked, “The investigation is indeed late but can still serve as a clarion call for platforms to comply with European regulations. The implications for countless women and children are severe and irreversible. We hope this instance will prompt quicker action from the commission in future cases.”

European officials, however, standby their actions, highlighting the existence of 15 ongoing inquiries under the DSA, which has been applicable to companies since February 2024.

Regina Doherty, a vice-president of the European Parliament representing the center-right, welcomed the formal investigation. She stated, “When credible allegations surface regarding AI systems being exploited in ways that harm women and children, it is imperative to scrutinize and enforce EU law promptly.”

In response to the launched investigation, X pointed to a statement released on January 14, affirming its commitment to making the platform safe for everyone. “We are resolute in our stance against child exploitation, non-consensual nudity, and any unwanted sexual content,” the company stated.

The commission had previously fined X €120 million last month for several infractions related to EU law. The fine was imposed due to the platform’s deceptive practices impacting users, obstructing independent research, and evading accountability measures.

The EU regulator criticized X for issuing “deceptive” blue tick verification badges to accounts without proper verification, which put users at risk of scams from malicious actors. X was also found guilty of breaching EU mandates concerning transparency related to advertising by hindering researchers from examining fake ads and potential hybrid threat campaigns.

Musk responded to the commission’s announcement of the fine by dismissively labeling it “bullshit” and subsequently called for the abolition of the EU.

The company was granted a three-month period to settle the imposed fine. An EU official expressed confidence that the penalty would be paid promptly.