paulsmith

Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.

Avoid being a link dump. Try to provide only valuable well tuned information.

Prelude

Neural network links before starting with transformers.

paulsmith

/**
 * 8x8 monochrome bitmap fonts for rendering
 * Author: Daniel Hepper <daniel@hepper.net>
 *
 * License: Public Domain
 *
 * Based on:
 * // Summary: font8x8.h
 * // 8x8 monochrome bitmap fonts for rendering
 * //

paulsmith

enum Kind {
    File,
    Directory,
}

struct Entry {
    name: String,
    kind: Kind,
    size: usize,
    parent: Option<usize>,

paulsmith

When to use generics

aka generic guidelines

It's late 2021, and Go is about to add "generics" (i.e., type parameters for types and functions) to upcoming release version 1.18.

Here is some guidance for Go programmers, cribbed from a talk by Ian Lance Taylor.

First, write Go programs by writing code, not by defining types.

paulsmith

The quick brown fox jumps over the lazy dog.

paulsmith

paul@pumpkin:/tmp/SQLite-cf538e27$ python3.7 -c 'import sqlite3; print(sqlite3.connect(":memory").execute("select sqlite_version()").fetchone())'
('3.27.2',)
paul@pumpkin:/tmp/SQLite-cf538e27$ ldd /usr/lib/python3.7/lib-dynload/_sqlite3.cpython-37m-x86_64-linux-gnu.so
	linux-vdso.so.1 (0x00007ffff752e000)
	libsqlite3.so.0 => /usr/lib/x86_64-linux-gnu/libsqlite3.so.0 (0x00007f89e005b000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f89e003a000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f89dfe79000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f89dfcf6000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f89dfcf1000)
	/lib64/ld-linux-x86-64.so.2 (0x00007f89e01da000)

paulsmith

/* decodes next unicode code point in utf-8-encoded buffer. returns number of bytes                                                                          
   read so stream can be advanced, -1 if invalid utf-8 sequence. */
size_t decode_next_utf8(const unsigned char *str, size_t len, int *cp)
{
  *cp = 0;
  if (*str <= 0x7f) {
    *cp = (int)*str;
    return 1;
  } else if (((*str & 0xe0) == 0xc0) && len > 1) {
    if ((*(str+1) & 0xc0) != 0x80) {

paulsmith

• Intel 4004, first microprocessor: http://www.computerhistory.org/collections/catalog/102658187
• Intel 8008: http://www.computerhistory.org/collections/catalog/102657982
• Intel 8080: http://www.computerhistory.org/collections/catalog/102658123
• Z80: http://www.computerhistory.org/collections/catalog/102658073
• Federico Faggin, SGT inventor, chip designer for 4004, Z80: http://www.computerhistory.org/collections/catalog/102658025
• Bill Mensch, chip designer on 6800/6502/65C02/65816: http://www.computerhistory.org/collections/catalog/102739969
• Motorolla 68000: http://www.computerhistory.org/collections/catalog/102658109
• 3dfx, Voodoo, the seminal GPU: http://www.computerhistory.org/collections/catalog/102746834
• LSI Logic, EDA/fabless innovator: http://www.computerhistory.org/collections/catalog/102746194
• VLSI Technologies, EDA/fabless innovator: http://www.computerhistory.org/collections/catalog/102746456

paulsmith

My family attended a Quaker meeting in Frederick, Maryland when I was growing up, and many of its members were closely associated with a food co-op there. We would volunteer to run the register or stock shelves and do other admin jobs. I remember the strange smell of bulk food items like spices and grains mixing together. I remember the "weird" items that were like items you'd get in regular grocery stores, but were weird because instead of chocolate the candy bars were made with carob. I remember that the co-op was a strong component of the identity of the people who worked, volunteered, and shopped there, including the Quakers and my family.

paulsmith

Adapt this recipe to make it vegetarian and in a rice cooker:

• Ignore the chicken part (unless you want to make chicken)
• In a rice cooker (at least 6c), in this order add:
  • Sliced butter (or non-dairy fat)
  • Turmeric and cumin
  • We also add Aleppo pepper and urfa biber for extra seasoning
  • Broth and rice (we use brown), salt and pepper
  • I add a can of chick peas
• Cook like you would rice (just turn it on)