2017 ⟶ Invention of the Transformer Architecture
Transformer architecture was invented, which led to new kind...
Year
2017
2020
2023
📝 Invention of the Transformer Architecture
Transformer architecture was invented, which led to new kinds of large language models such as BERT by Google, followed by the Generative pre-trained transformer type of model introduced by OpenAI.⟶
TransformerNatural Language ProcessingBERTLarge Language ModelsDeep LearningGenerative ModelsMachine TranslationOpenAI
🗣️ OpenAI Introduces GPT-3
OpenAI introduces GPT-3, a state-of-the-art autoregressive language model that uses Deep learning to produce a variety of computer codes, poetry and other language tasks exceptionally similar, and almost indistinguishable from those written by humans. Its capacity was ten times greater than that of the T-NLG. It was introduced in May 2020, and was in beta testing in June 2020.⟶
GPT-3OpenAILarge language modelDeep learningNatural language processingGenerative AI
United States📝 Nature Biomedical Engineering Publishes Article on indistinguishability of human-written text and LLM-generated text
On March 7, 2023, Nature Biomedical Engineering writes that "it is no longer possible to accurately distinguish" human-written text from text created by large language models, and that "It is all but certain that general-purpose large language models will rapidly proliferate... It is a rather safe bet that they will change many industries over time."⟶
Large language modelsText generationNatural language processingBiomedical EngineeringGenerative AIImpact
🎤 Sarah Silverman Files Copyright Lawsuit Against Meta and OpenAI
On July 9, 2023, Sarah Silverman files a class action lawsuit against Meta and OpenAI for copyright infringement for training their large language models on millions of authors' copyrighted works without permission.⟶
Copyright infringementSarah SilvermanMetaOpenAILarge language modelsLegal challenges
United States