In a decisive move to address the growing concerns over artificial intelligence misuse, the Brazilian government has issued a stern warning to Elon Musk’s company, demanding urgent action to prevent Grok, the AI assistant integrated into the X platform, from generating illegal sexual content. The National Data Protection Authority (ANPD), the National Consumer Secretariat (Senacon), and the Federal Public Prosecutor’s Office (MPF) jointly recommended that the company implement immediate measures to stop the production of synthetic sexualized content involving real individuals, particularly women, children, and adolescents.
The note come after multiple reports and investigations revealed that Grok has been exploited to create deepfake images and videos with explicit, erotic, and pornographic connotations, often using photos of identifiable individuals without their consent. These abuses have resulted in the circulation of nude or semi-nude images of women and minors, accessible to any user, thus amplifying the risk of harm and violating fundamental rights.
Coordinated Response to a Grave Threat
The severity of the allegations prompted a coordinated response from Brazil’s top regulatory and legal bodies. The misuse of Grok is seen as a multifaceted threat, impacting data privacy, consumer rights, and the dignity of individuals, especially the most vulnerable. The government emphasized that these violations could have far-reaching consequences for the protection of personal rights and the safety of Brazilian citizens.
Immediate and Long-Term Measures Required
Among the key recommendations, the authorities have demanded that, within 30 days, the company must:
- Implement technical and operational procedures to identify, review, and remove any existing illegal content generated by Grok, including images, videos, and audio files depicting minors or adults in sexualized contexts without consent.
- Immediately suspend accounts involved in producing such content, providing monthly reports to the authorities to demonstrate compliance.
- Establish a transparent and accessible mechanism for individuals to report abuses and exercise their data rights, ensuring timely and effective responses.
- Prepare a specific data protection impact report on the risks and consequences of synthetic content generation via Grok, especially when user-submitted media can identify real people.
Consequences of Non-Compliance
Failure to comply with these recommendations—or implementing them inadequately—could result in further administrative and judicial measures, including potential suspension of the service in Brazil. The government has made clear that the protection of citizens, especially women, children, and adolescents, is non-negotiable.
The recommendations were issued within the legal framework of each institution’s authority, and the Brazilian authorities will continue to monitor the company’s response and any corrective actions taken.
This development underscores the growing global scrutiny of AI platforms and the urgent need for robust safeguards to prevent the misuse of generative technologies. As the deadline looms, all eyes will be on Elon Musk’s company to see how it will respond to these pressing demands.
Source: Agencia Gov
