2020 ⟶ OpenAI Introduces GPT-3
OpenAI introduces GPT-3, a state-of-the-art autoregressive l...
Year
2017
2020
2022
2023
2024
📝 Invention of the Transformer Architecture
Transformer architecture was invented, which led to new kinds of large language models such as BERT by Google, followed by the Generative pre-trained transformer type of model introduced by OpenAI.⟶
TransformerNatural Language ProcessingBERTLarge Language ModelsDeep LearningGenerative ModelsMachine TranslationOpenAI
🗣️ OpenAI Introduces GPT-3
OpenAI introduces GPT-3, a state-of-the-art autoregressive language model that uses Deep learning to produce a variety of computer codes, poetry and other language tasks exceptionally similar, and almost indistinguishable from those written by humans. Its capacity was ten times greater than that of the T-NLG. It was introduced in May 2020, and was in beta testing in June 2020.⟶
GPT-3OpenAILarge language modelDeep learningNatural language processingGenerative AI
United States🗣️ Microsoft Introduces Turing Natural Language Generation (T-NLG)
In February 2020, Microsoft introduces its Turing Natural Language Generation (T-NLG), which is the "largest language model ever published at 17 billion parameters".⟶
MicrosoftTuring-NLGLanguage ModelNatural Language GenerationLarge Language ModelDeep Learning
United States💬 ChatGPT's Public Debut and Societal Discussion
ChatGPT, an AI Chatbot developed by OpenAI, debuts in November 2022. It is initially built on top of the GPT-3.5 Large language model. While it gains considerable praise for the breadth of its knowledge base, deductive abilities, and the human-like fluidity of its natural language responses, it also garners criticism for, among other things, its tendency to "hallucinate", a phenomenon in which an AI responds with factually incorrect answers with high confidence. The release triggers widespread public discussion on artificial intelligence and its potential impact on society.⟶
ChatGPTOpenAILarge language modelGenerative AIPublic discourseSocietal impactHallucinations
United States🚀 OpenAI Releases GPT-4
OpenAI's GPT-4 model is released in March 2023 and is regarded as an impressive improvement over GPT-3.5, with the caveat that GPT-4 retains many of the same problems of the earlier iteration. Unlike previous iterations, GPT-4 is multimodal, allowing image input as well as text. GPT-4 is integrated into ChatGPT as a subscriber service. OpenAI claims that in their own testing the model received a score of 1410 on the SAT (94th percentile), 163 on the LSAT (88th percentile), and 298 on the Uniform Bar Exam (90th percentile).⟶
GPT-4OpenAILarge language modelMultimodalGenerative AISATLSATUniform Bar Exam
United States