OpenAI Launches Embeddings API with 20% Better Code Search
Curated by the Inblix editorial team
OpenAI just dropped a new API endpoint that turns text and code into numerical embeddings, and the early benchmarks suggest it’s not playing around. The launch gives developers direct access to models that map concepts into high-dimensional vectors, essentially translating semantic meaning into math that machines can easily compare. The standout stat: a 20% relative improvement in code search performance over existing top models.
Three distinct model families are available, each optimized differently. Text similarity models handle clustering and classification, already hitting new state-of-the-art results on the SentEval linear probe benchmark. Text search models tackle large-scale document retrieval, outperforming previous methods on the BEIR search evaluation suite by capturing meaning rather than just matching keywords. The code search models, evaluated on the CodeSearchNet benchmark, connect natural language queries with relevant code blocks.
The practical applications are already showing up outside of OpenAI’s labs. JetBrains Research’s Astroparticle Physics Lab is using the embeddings to parse messy astronomical reports from sources like The Astronomer’s Telegram and NASA’s GCN Circulars—text that traditional algorithms choke on. They’re now searching for events like “crab pulsar bursts” across databases and hitting 99.85% accuracy on source classification through k-means clustering.
FineTune Learning, a company building adaptive learning tools, also saw a meaningful leap: the embeddings significantly improved their ability to match textbook content to specific learning objectives. What makes the endpoint particularly useful is that embeddings can be pre-computed, after which cosine similarity comparisons become extremely fast. For anyone building semantic search, recommendation engines, or any system that needs to understand relationships between chunks of text or code, this lowers the barrier considerably.
💡 Key Takeaways
- OpenAI's new embeddings models deliver a 20% relative improvement in code search, setting a new performance bar on the CodeSearchNet benchmark.
- Three separate model families are available, each tuned for a distinct task: text similarity, document search, and code search.
- Early adopters like JetBrains Research are already using the embeddings to parse unstructured astronomical data with 99.85% classification accuracy.
- Pre-computed embeddings enable extremely fast dot product comparisons, making semantic search practical at scale without repeated API calls.
Keep reading: See related articles below for more coverage on this topic.
Get smarter about AI
The sharpest AI news, curated daily. Delivered free to your inbox.