Grok, an AI tool launched by Elon Musk in 2023 and distributed through his social media platform X, has recently come under legal scrutiny. A Dutch court has ordered xAI, the company behind Grok, to halt the generation and distribution of nude images without consent. This ruling is notable as it is one of the first instances where a judge has addressed the responsibility of AI companies for the tools they create, particularly in relation to nonconsensual content.
The court’s decision follows legal action taken by Offlimits, which challenged a Grok feature that allowed users to create deepfake montages of naked individuals. The ruling emphasizes the need for companies to ensure that their technologies are not misused for creating and disseminating nonconsensual sexual images, including those involving minors. Robbert Hoving, a representative involved in the case, stated, “The burden is on the company to make sure its tools are not used to create and distribute nonconsensual sexual images, including of children.”
As part of the ruling, the court has warned xAI of potential fines amounting to 100,000 euros (approximately $115,350) per day for any noncompliance. This significant legal measure reflects growing concerns over the implications of AI-generated content and the need for stringent regulations in the digital landscape.
In a related development, Grok experienced a major outage on March 27, 2026, affecting thousands of users who reported authentication failures when trying to log in. Downdetector recorded at least 2000 reports regarding the outage, which was attributed to authentication and server-side disruptions. Users faced messages indicating that their email domains had been rejected, leading to frustration among the platform’s user base.
The European Parliament has also taken steps to address the issue of AI-generated sexualized deepfakes, approving a ban on such systems. This legislative action underscores the urgency of establishing clear guidelines and accountability for AI technologies.
As xAI navigates these legal challenges, observers are keenly watching how the company will respond to the court’s ruling and the implications it may have for the future of AI-generated content. The situation remains fluid, and details regarding the company’s next steps are still unfolding.
