OpenAI has published the system card for DALL·E 3, offering a candid look under the hood of its latest text-to-image model. The document confirms what many in the security community have long suspected: DALL·E 3 can be jailbroken. Researchers found that by feeding the model nonsensical, long strings of words, they could bypass safety guardrails and trick it into generating harmful images. It’s a blunt, unglamorous exploit that highlights how far the industry still has to go in aligning generative models.
The company didn’t just drop a paper and walk away. Before shipping DALL·E 3, OpenAI assembled a red team of external experts to stress-test the model. That team probed for the usual suspects — sexual content, graphic violence, and hateful imagery. The system card also details specific mitigations the company put in place, including an image output classifier and a specialized prompt transformer. This transformer rewrites user prompts before they hit the core model, a sort of pre-processing step that’s becoming standard practice for reigning in unpredictable outputs.
In a notable shift, OpenAI gave content creators an opt-out mechanism. Artists and rights holders can now submit images they want excluded from future model training. It’s a direct response to the mounting legal pressure and public criticism over training data provenance. The company is also explicitly avoiding the style of living artists when a name is included in a prompt, a guardrail clearly aimed at reducing the risk of deepfakes and forgeries.
What’s striking is the transparency. OpenAI is openly acknowledging that its model isn’t impenetrable, sharing specific evaluation results on bias and representation. They tested how DALL·E 3 depicts people across professions and found it’s more diverse than its predecessor, but still imperfect. The system card reads less like a victory lap and more like a sober engineering log. For anyone tracking the slow, messy march toward safer AI, that’s a document worth reading.