We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but a...

We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be ap...

We’ve trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural l...

It’s been a year of dramatic change and growth at OpenAI.

OpenAI has agreed to license GPT-3 to Microsoft for their own products and services.

We’ve applied reinforcement learning from human feedback to train language models that are better at summarization.

Our third class of OpenAI Scholars presented their final projects at virtual Demo Day, showcasing their research results from over the pa...

We’re excited to announce that OpenAI is co-organizing two NeurIPS 2020 competitions with AIcrowd, Carnegie Mellon University, and DeepMi...

We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel seq...

We’re releasing an API for accessing new AI models developed by OpenAI.

We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNe...

We’re introducing Jukebox, a neural net that generates music, including rudimentary singing, as raw audio in a variety of genres and arti...

We’ve contributed to a multi-stakeholder report by 58 co-authors at 30 organizations, including the Centre for the Future of Intelligence...

We’re introducing OpenAI Microscope, a collection of visualizations of every significant layer and neuron of eight vision “model organism...

We are standardizing OpenAI’s deep learning framework on PyTorch.

We show that the double descent phenomenon occurs in CNNs, ResNets, and transformers: performance first improves, then gets worse, and th...

We’re releasing Procgen Benchmark, 16 simple-to-use procedurally-generated environments which provide a direct measure of how quickly a r...

We’re releasing Safety Gym, a suite of environments and tools for measuring progress towards reinforcement learning agents that respect s...

As the final model release of GPT-2’s staged release, we’re releasing the largest version (1.5B parameters) of GPT-2 along with code and ...