Skip to content

Instantly share code, notes, and snippets.

View greydoubt's full-sized avatar
💭
in the studio or the datacenter

-- greydoubt

💭
in the studio or the datacenter
131 followers · 769 following
View GitHub Profile
@rain-1
rain-1 / llama-home.md
Last active June 24, 2025 11:12
How to run Llama 13B with a 6GB graphics card

This worked on 14/May/23. The instructions will probably require updating in the future.

llama is a text prediction model similar to GPT-2, and the version of GPT-3 that has not been fine tuned yet. It is also possible to run fine tuned versions (like alpaca or vicuna with this. I think. Those versions are more focused on answering questions)

Note: I have been told that this does not support multiple GPUs. It can only use a single GPU.

It is possible to run LLama 13B with a 6GB graphics card now! (e.g. a RTX 2060). Thanks to the amazing work involved in llama.cpp. The latest change is CUDA/cuBLAS which allows you pick an arbitrary number of the transformer layers to be run on the GPU. This is perfect for low VRAM.

  • Clone llama.cpp from git, I am on commit 08737ef720f0510c7ec2aa84d7f70c691073c35d.
@todbot
todbot / synthio_midi_synth.py
Last active March 26, 2025 18:58
pretty usable MIDI-controlled synth using synthio in CircuitPython
# synthio_midi_synth.py - pretty usable MIDI-controlled synth using synthio in CircuitPython
# 11 May 2023 - @todbot / Tod Kurt
# Uses cheapie PCM5102 DAC on QTPY RP2040
# Video demo: https://www.youtube.com/watch?v=N-PbbWWDE6k
# Features:
# - midi velocity controls attack rate (gentle press = slow, hard press = fast)
# - notes have small random detune on all oscillators to reduce phase stacking
# - adjustable number of detuned oscillators per note 1-5 (midi controller 83)
# - five selectable waveforms: saw, squ, sin, noisy sin, noise (midi controller 82)
# - vibrato depth on mod wheel (midi controller 1)
@kconner
kconner / macOS Internals.md
Last active November 6, 2025 09:43
macOS Internals

macOS Internals

Understand your Mac and iPhone more deeply by tracing the evolution of Mac OS X from prelease to Swift. John Siracusa delivers the details.

Starting Points

How to use this gist

You've got two main options:

@elsonLee
elsonLee / lego_tit01_at3
Created April 17, 2014 15:54
audio file
This file has been truncated, but you can view the full file.
0000000: 5249 4646 0ce0 0d00 5741 5645 666d 7420 RIFF....WAVEfmt
0000010: 3400 0000 feff 0200 44ac 0000 953e 0000 4.......D....>..
0000020: e802 0000 2200 0008 0300 0000 bfaa 23e9 ....".........#.
0000030: 58cb 7144 a119 fffa 01e4 ce62 0100 285c X.qD.......b..(\
0000040: 0000 0000 0000 0000 6661 6374 0800 0000 ........fact....
0000050: 0025 2600 9009 0000 736d 706c 3c00 0000 .%&.....smpl<...
0000060: 0000 0000 0000 0000 9458 0000 3c00 0000 .........X..<...
0000070: 0000 0000 0000 0000 0000 0000 0100 0000 ................
0000080: 1800 0000 0000 0000 0000 0000 9009 0000 ................
0000090: 8f2e 2600 0000 0000 0000 0000 6461 7461 ..&.........data