Links from LLM presentation for Cartier (week 2).

cartier_session2_links

Summaries and Overviews:
- Modern LLMs: https://cameronrwolfe.substack.com/p/modern-llms-mt-nlg-chinchilla-gopher
- Specialized LLMs: https://cameronrwolfe.substack.com/p/specialized-llms-chatgpt-lamda-galactica
- Practical Prompt Engineering: https://cameronrwolfe.substack.com/p/practical-prompt-engineering-part
- Advanced Prompt Engineering: https://cameronrwolfe.substack.com/p/advanced-prompt-engineering
- LLM Training and Inference: https://cameronrwolfe.substack.com/p/language-model-training-and-inference
- Understanding SFT: https://cameronrwolfe.substack.com/p/understanding-and-using-supervised
- RLHF and Alternatives: https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives
- Data is the foundation of language models: https://cameronrwolfe.substack.com/p/data-is-the-foundation-of-language
- RLAIF: https://cameronrwolfe.substack.com/p/rlaif-reinforcement-learning-from
- Why does ChatGPT work?: https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/
- Open-Source LLM History (Part One): https://cameronrwolfe.substack.com/p/the-history-of-open-source-llms-early
- Open-Source LLM History (Part Two): https://cameronrwolfe.substack.com/p/the-history-of-open-source-llms-better
- Open-Source LLM History (Part Three): https://cameronrwolfe.substack.com/p/the-history-of-open-source-llms-imitation

Papers:
- Codex: https://arxiv.org/abs/2107.03374
- LaMDA: https://arxiv.org/abs/2201.08239
- InstructGPT: https://arxiv.org/abs/2203.02155
- Sparrow: https://arxiv.org/abs/2209.14375
- Galactica: https://arxiv.org/abs/2211.09085
- Dramatron: https://arxiv.org/abs/2209.14958
- LIMA: https://arxiv.org/abs/2305.11206
- The False Promise of Imitating Proprietary LLMs: https://arxiv.org/abs/2305.15717

Other links:
- TRL package: https://huggingface.co/docs/trl/index
- Open LLM Leaderboard: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard