The European Commission has launched an investigation into the platform X amid public outrage over the use of the built-in chatbot Grok to create sexualized images of real people, including minors.
Source: Bukvy
The review is intended to determine whether the platform took sufficient measures to prevent the creation and dissemination of such content. Regulators paid particular attention to Grok’s image editing feature, which was widely used for so-called “virtual undressing” of women and girls without their consent.
The investigation is being conducted under the Digital Services Act (DSA). If X is found guilty of violating EU legislation, the company could face a fine of up to 6% of its global annual turnover.
The European Commission’s concerns intensified after the launch of a paid Grok feature called Spicy Mode, which allowed the creation of explicit content based on text prompts. Following a wave of criticism, X owner Elon Musk publicly mocked the outrage on social media.
Earlier this month, a European Commission spokesperson strongly condemned the chatbot’s capabilities, emphasizing that this was not about “spicy” content but about illegal and unacceptable actions for Europe.
After that, X announced the introduction of restrictions banning Grok from editing images of real people to create explicit or sexualized scenes. The company said these rules apply to all users, including paid subscribers.
The platform also reported the removal of sexualized images of children and the blocking of accounts involved in their creation. In the X Safety account, the company stated that it is cooperating with law enforcement and taking action against illegal content, including child sexual abuse material.
This is not the first time Grok’s activities have raised concerns among regulators. In November last year, the chatbot generated content denying the Holocaust. Investigations into its operation are ongoing in France, the United Kingdom, Germany, and Australia, while in Indonesia and Malaysia the use of Grok is completely banned.
The European Commission said it has sent an official request for information to platform X in accordance with DSA requirements and continues to analyze the responses received.