GPT-3

What happened

OpenAI unveiled GPT-3, a language model with 175 billion parameters. Trained simply to predict the next word across enormous amounts of text, it could perform many tasks — translation, question-answering, even basic coding — from a few examples given in the prompt, without task-specific training.

Why it matters

GPT-3 demonstrated that scale alone could produce surprisingly general abilities, setting the stage for the generative AI boom.

Sources

• Brown et al., arXiv. Language Models are Few-Shot Learners (2020) · Peer-reviewed