veekaybee

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

rain-1

Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.

Avoid being a link dump. Try to provide only valuable well tuned information.

Prelude

Neural network links before starting with transformers.

ValRCS

Because cross-compiling binaries for Windows is easier than building natively

I want Microsoft to do better, want Windows to be a decent development platform-and yet, I constantly see Microsoft playing the open source game: advertising how open-source and developer friendly they are - only to crush developers under the heel of the corporate behemoth's boot.

The people who work at Microsoft are amazing, kind, talented individuals. This is aimed at the company's leadership, who I feel has on many occassions crushed myself and other developers under. It's a plea for help.

The source of truth for the 'open source' C#, C++, Rust, and other Windows SDKs is proprietary

You probably haven't heard of it before, but if you've ever used win32 API bindings in C#, C++, Rust, or other languages, odds are they were generated from a repository called microsoft/win32metadata.

derhuerst

Geekbench 6

product	notes	price (incl. VAT)	dedic.?	cores	RAM	SSD	Yabs	Geekbench ST	Geekbench MT	Geekbench version	operating system	date of benchmark
Hetzner CPX11		4,58€/m	no	2	2GB	40GB	-	1476/1496	2714/2732	Geekbench 6.3.0 Build 603408 (rosedale-main-build bca065a7d9)	Ubuntu 22.04	2024-07-02
Hetzner CPX21		8,39€/m	no	3	4GB	80GB	-	1484/1474	3862/3792	Geekbench 6.3.0 Build 603408 (rosedale-main-build bca065a7d9)	Ubuntu 22.04	2024-07-02
Hetzner CPX22	no IPv4

dantler

# Download all of Analog Dialogue
# Generates a lot of 404 errors, but ultimately gets the job done quickly
# without producing any extra cruft on your HDD.

import os
volumes = range(1,54)
numbers = range(1,4)

url_base = "https://www.analog.com/media/en/analog-dialogue/"
url_list = []

erikig

nadya-p

from tika import parser
import os


def extract_text_from_pdfs_recursively(dir):
    for root, dirs, files in os.walk(dir):
        for file in files:
            path_to_pdf = os.path.join(root, file)
            [stem, ext] = os.path.splitext(path_to_pdf)
            if ext == '.pdf':

ValRCS

# -*- coding: utf-8 -*-
from mpl_finance import candlestick_ohlc
import numpy as np
from matplotlib import pyplot
import pandas as pd
from bs4 import BeautifulSoup
import urllib.request
import re

willurd

Each of these commands will run an ad hoc http static server in your current (or specified) directory, available at http://localhost:8000. Use this power wisely.

Discussion on reddit.

Python 2.x

$ python -m SimpleHTTPServer 8000