Minnesota Battles xAI Over ‘Marketplace for Digital Sexual Violence’ in First-of-Its-Kind AI Law Fight

Minnesota’s First-of-Its-Kind AI Regulation Faces Constitutional Challenge

Minnesota has locked horns with Elon Musk’s artificial intelligence company xAI over enforcement of the state’s groundbreaking law regulating AI-generated sexual imagery. The dispute centers on whether legislation targeting deepfake pornography amounts to unconstitutional restrictions on free speech or a reasonable regulation of harmful technology.

According to Minnesota Attorney General Keith Ellison’s court filings, as reported by Decrypt, the state is defending HF-1606, a statute enacted in April that took effect August 1. The law prohibits platforms and software developers from allowing users to create realistic sexual images of identifiable individuals where intimate body parts were not present in the original photograph. Violators face penalties reaching $500,000 per generated image.

xAI’s First Amendment Defense Versus Minnesota’s Technology Regulation Argument

xAI challenged the law in July, arguing it violates constitutional protections for free speech and could sweep in protected content such as photographs of shirtless individuals, swimmers, or political satire. The company contended in its complaint that liability attaches regardless of whether the depicted person consented to the image’s creation or intended its distribution.

Minnesota’s response centers on a different premise: the state is regulating a tool, not restricting speech. In court filings, Ellison characterized xAI’s Grok Imagine feature as creating “an unparalleled marketplace for digital sexual violence that poses virtually no barrier to entry.” The state argues the law directly targets the technological capability enabling sexual victimization rather than suppressing any particular message or viewpoint.

Real-World Harms and Regulatory Precedent

Minnesota’s legislative record documents the urgency driving the measure. Lawmakers heard testimony about individuals using social media photographs to generate non-consensual sexual imagery of more than 80 women. The legislation passed with overwhelming support—132-1 in the state House and 65-0 in the Senate.

Senator Maye Quade, who championed the bill, emphasized the state’s role in protecting citizens from emerging technological harms. The law also follows public scrutiny of Grok’s capabilities; a watchdog organization estimated in January that Grok generated over 23,000 sexualized images of children within an 11-day period, triggering investigations across multiple states.

A federal judge is scheduled to hear arguments in the case on Wednesday as both sides prepare their constitutional arguments. The outcome could set a precedent for how states regulate artificial intelligence tools that create synthetic content, balancing free expression against protection from technological abuse.

Regulatory approaches to emerging AI capabilities establish precedents for how governments approach technological innovation—a framework that could shape future oversight of blockchain and digital assets.

Source: State of Minnesota, via Decrypt. Not financial advice.