EU lawmakers are coming for nudify apps, and Grok is the poster child

EU lawmakers are coming for nudify apps, and Grok is the poster child

6 0 0

The European Union is finally getting serious about AI-generated nudity, and Elon Musk’s Grok is the unfortunate poster child for why this is necessary.

This week, the European Parliament’s Internal Market and Civil Liberties committees voted 101–9 (with 8 abstentions) to simplify the AI Act and explicitly ban what they’re calling “AI nudifier systems.” The joint press release didn’t mince words: these are systems that sexualize images of real people, including children, and lawmakers have had enough.

What’s interesting here is the timing. Earlier this year, the European Commission quietly admitted that the current AI Act doesn’t actually prohibit AI systems that generate child sexual abuse material or sexually explicit deepfake nudes. That’s a pretty glaring loophole for a law that was supposed to be the gold standard for AI regulation. So Parliament members started drafting amendments to close it.

Enter Grok. Musk’s chatbot has been a textbook example of what happens when you launch an AI platform without adequate guardrails. It didn’t take long for users to figure out how to generate sexualized images of real people, and the usual Musk playbook kicked in: blame the users, claim it’s a free speech issue, promise vague fixes later.

That tactic might work in the US, where tech CEOs can basically shrug and say “we’re just a platform.” But in Europe, regulators are looking at the system itself, not just the bad actors exploiting it. The EU approach is refreshingly direct: if your AI can be weaponized to create non-consensual intimate images, the problem isn’t just the users, it’s your product.

The vote was lopsided, 101 to 9. That’s not a close call. Lawmakers clearly feel public pressure to act, and they should. Nudify apps have been proliferating for years, but AI has supercharged them. What used to require some technical skill and dedicated software can now be done with a prompt and a screenshot. The harm scales differently when any idiot with an internet connection can generate convincing deepfakes.

I’m curious to see how this plays out with the full Parliament vote and subsequent negotiations with member states. The AI Act has already been through multiple revisions, and adding a specific ban on nudifier systems could set a precedent for how Europe handles other harmful AI use cases. If they can’t stop the technology from existing, they can at least make it illegal to distribute and operate within their jurisdiction.

Musk will probably fight this, or more likely, ignore it and hope enforcement is weak. But the EU has a track record of making tech companies comply, whether it’s USB-C charging ports or data privacy rules. Grok might be the test case that determines whether the AI Act has any teeth.

For now, the message is clear: if your AI platform can generate sexualized images of real people without their consent, and you don’t fix it, Europe is coming for you. Blaming users won’t save you.

Comments (0)

Be the first to comment!