Topic: iGPT

GPT-2 trained on pixels rivals top CNNs without labels

OpenAI Blog · Jul 19, 2026 · 2 min read

Here's a sentence I didn't expect to write: a raw GPT-2 language model, fed nothing but pixel sequences and told to pre...