veekaybee

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

mchiang0610

codeup:13b
codeup:13b-llama2
codeup:13b-llama2-chat
codeup:13b-llama2-chat-q2_K
codeup:13b-llama2-chat-q3_K_L
codeup:13b-llama2-chat-q3_K_M
codeup:13b-llama2-chat-q3_K_S
codeup:13b-llama2-chat-q4_0
codeup:13b-llama2-chat-q4_1
codeup:13b-llama2-chat-q4_K_M

matrixik

ISO Time on focus on github.com

A userscript that allow you to see ISO date when you focus on dates on github.com

Install from gist.

Hellisotherpeople

You probably don't know how to do Prompt Engineering

(This post could also be titled "Features missing from most LLM front-ends that should exist")

Apologies for the snarky title, but there has been a huge amount of discussion around so called "Prompt Engineering" these past few months on all kinds of platforms. Much of it is coming from individuals who are peddling around an awful lot of "Prompting" and very little "Engineering".

Most of these discussions are little more than users finding that writing more creative and complicated prompts can help them solve a task that a more simple prompt was unable to help with. I claim this is not Prompt Engineering. This is not to say that crafting good prompts is not a difficult task, but it does not involve doing any kind of sophisticated modifications to general "template" of a prompt.

Others, who I think do deserve to call themselves "Prompt Engineers" (and an awful lot more than that), have been writing about and utilizing the rich new eco-system

VictorTaelin

Notes on this tweet.

• The screenshots were taken on different sessions.

• The entire sessions are included on the screenshots.

• I lost the original prompts, so I had to reconstruct them, and still managed to reproduce.

• The "compressed" version is actually longer! Emojis and abbreviations use more tokens than common words.

kuang-da

Introduction

This gist is a note about install nvidia-docker in Pop!_OS 20.10. nvidia-docker is used to help docker containers compute on GPU.

The basic installcation is in Nvidia's offical documentation. But there are a few tweaks to make it work on Pop!_OS 20.10.

Setting up Docker

No surprise. Follow the offical documentaion should work.

Setting up NVIDIA Container Toolkit

olets

Instructions for installing zsh plugins, for a variety of plugin managers

• antibody: Add <owner>/<repo> to your plugins file. If you use static loading update the sh.

• Antigen: Add antigen bundle <owner>/<repo> to your .zshrc.

• Oh-My-Zsh:

  • Clone to OMZ's plugins' directory:

tanhaa

Instructions for a mac on how to play with pyenv and poetry

Why both? Pyenv to manage multiple python versions. You can make virtualenvs with pyenv of course, but using poetry will simplify that process

# Install pyenv.
brew install pyenv

# Add pyenv initializer to shell startup script.
echo -e '\nif command -v pyenv 1>/dev/null 2>&1; then

medakk

#!/bin/bash
# where-is-my-domain-blacklisted.sh

# Copyright 2020 medakk
# Released under MIT License

if [ -z $1 ] ; then
    echo "Usage: $0 <domain to search for>"
    echo "Make sure you have jq and wget installed"
    exit 1

brunoamaral

<!-- 

I use a lot of photos from unsplash as headers. This shortcode works in two ways to make that easier:

1. Standard use
	{{< copyright name="Malte Wingen" href="https://unsplash.com/@maltewingen?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText" >}}

2. Automatic parsing of filename
	{{< copyright >}}