Skip to content

Instantly share code, notes, and snippets.

@shahbazsyed
Last active May 8, 2023 09:36
Show Gist options
  • Save shahbazsyed/8374e0a0e0fca341fce0a47f210ace8d to your computer and use it in GitHub Desktop.
Save shahbazsyed/8374e0a0e0fca341fce0a47f210ace8d to your computer and use it in GitHub Desktop.
Ongoing list of LLMs

Influential LLMs and methods ordered by time (arXiv v1 release date)

Model Link Date Org
T5 https://arxiv.org/abs/1910.10683 23.10.2019 Google
GPT-3 https://arxiv.org/abs/2005.14165 28.05.2020 OpenAI
Switch Transformer https://arxiv.org/abs/2101.03961 11.01.2021 Google
LoRA https://arxiv.org/abs/2106.09685 17.06.2021 Microsoft
FLAN https://arxiv.org/abs/2109.01652 03.09.2021 Google
T0pp https://arxiv.org/abs/2110.08207 15.10.2021 HuggingFace
Gopher https://arxiv.org/abs/2112.11446 08.12.2021 DeepMind
GLAM https://arxiv.org/abs/2112.06905 13.12.2021 Google
GPT-NeoX https://arxiv.org/abs/2204.06745 14.01.2022 EleutherAI
LaMDA https://arxiv.org/abs/2201.08239 20.01.2022 Google
MT-NLG https://arxiv.org/abs/2201.11990 28.01.2022 Microsoft
InstructGPT https://arxiv.org/abs/2203.02155 04.03.2022 OpenAI
Chinchilla https://arxiv.org/abs/2203.15556 29.03.2022 DeepMind
PaLM https://arxiv.org/abs/2204.02311 05.04.2022 Google
Claude https://arxiv.org/abs/2204.05862 12.04.2022 Anthropic
OPT https://arxiv.org/abs/2205.01068 02.05.2022 Meta AI
UL2 https://arxiv.org/abs/2205.05131 10.05.2022 Google
FLAN-T5 https://arxiv.org/abs/2210.11416 20.10.2022 Google
OPT-IML https://arxiv.org/abs/2212.12017 22.10.2022 Meta AI
BLOOM https://arxiv.org/abs/2211.05100 09.11.2022 HuggingFace
Galactica https://arxiv.org/abs/2211.09085 16.11.2022 Meta AI
Self-Instruct https://arxiv.org/abs/2212.10560 10.12.2022 Academia
Alpaca https://crfm.stanford.edu/2023/03/13/alpaca.html 13.03.2023 Academia
GPT-4 https://arxiv.org/abs/2303.08774 15.03.2023 OpenAI
LLaMA https://arxiv.org/abs/2302.13971 27.03.2023 Meta AI
Vicuna https://lmsys.org/blog/2023-03-30-vicuna/ 30.03.2023 Academia
Koala https://bair.berkeley.edu/blog/2023/04/03/koala/ 03.04.2023 Academia
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment