xAI sues user for CSAM deepfakes, demands he cover its legal bills

xAI is taking an unusual legal swing at one of its own users, filing a federal lawsuit against a South Carolina man it accuses of weaponizing Grok to manufacture child sexual abuse material. The complaint, first reported by Reuters, alleges Terry Wayne Harwood “knowingly and intentionally used Grok to circumvent safeguards” and convert non-sexual photographs into explicit imagery without consent. It’s the first time Elon Musk’s AI outfit has pursued a user in court over deepfakes, and the demands are aggressive.

Harwood was already in serious trouble before xAI came knocking. He was arrested in February and now faces eight felony charges for possessing and distributing CSAM. The lawsuit tightens the connection between his alleged crimes and xAI’s technology, asserting that “at least some” of the images tied to the criminal case were either generated or altered using Grok. The filing paints a picture of someone who deliberately bypassed the chatbot’s guardrails, not someone who stumbled into a loophole. xAI wants a judge to permanently ban Harwood from creating an account or touching Grok again.

The timing is awkward for xAI. The company spent much of 2024 rolling out progressively looser content restrictions, including a “spicy” mode for Grok and image-editing capabilities that immediately triggered a flood of sexualized deepfakes. Some of those fakes involved minors, and a separate class-action lawsuit filed by a group of teens in March alleged Grok generated sexualized images of them as children. Musk responded at the time with a characteristic warning: “Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content.” This lawsuit is apparently what those consequences look like.

What makes this case genuinely novel is the money. xAI isn’t just asking for reputational damages and a ban. The company wants Harwood to cover “reasonable expenses incurred defending itself in any legal action filed by a victim of Defendant’s conduct.” That’s a remarkable ask. If a judge grants it, xAI would essentially be indemnifying itself against lawsuits from the very victims its tool helped create. Whether that argument survives judicial scrutiny is an open question, but the message to other Grok users is clear: if you abuse the tool, the company will come after you for the cleanup costs, too.