The European Union may soon ban nudify apps after Elon Musk's chatbot Grok emerged as a prime example of the dangers of an AI platform failing to block outputs that sexualized images of real people, including children.

In a joint press release, the European Parliament's Internal Market and Civil Liberties committees confirmed that lawmakers voted 101–9 (with 8 abstentions) to simplify the Artificial Intelligence Act and "propose bans on AI 'nudifier' systems."

The vote came after the European Commission concluded earlier this year that the AI Act does not prohibit "AI systems that generate child sexual abuse material (CSAM) or sexually explicit deepfake nudes." At that time, the Commission signaled that Parliament members were already proposing ways to amend the law to strengthen protections against such harmful content.

Note: The proliferation of AI models capable of generating explicit content raises important ethical and security concerns. The ability to create realistic images of people in non-consensual contexts highlights the need for stringent regulations and effective control mechanisms to prevent abuse and protect individual privacy.