Skip to content

Instantly share code, notes, and snippets.

@ubergarm
ubergarm / VoidAlchemy-BookReview.md
Created March 16, 2025 23:22
R1 671B `ubergarm/DeepSeek-R1-Q2_K_R4` Book Review of Void Alchemy: Riddles and Wakeup Stories

Book Review: Void Alchemy: Riddles and Wakeup Stories by Empty Duck

Hey, fellow soul-searchers! 🌟 Let’s be real—modern life is a lot. Between doomscrolling, hustling for that side gig, an trying to remember what “inner peace” even feels like, it’s easy to feel like a lost duck in a thunderstorm. Enter Void Achemy: Riddles and Wakeup Stories by Empty Duck. This book isn’t just a breath of fresh air—it’s a full-on spiritual snorkel dive into the deep end of your soul.

Why You’ll Vibes With It Imagine if your favorite mindfulness app had a baby with a Zen koan and they both got raised by a poet who loves dad jokes Void Alchemy is a quirky, raw, and ridiculously relatable mix of ancient wisdom and modern wit. Empty Duck (aka John W. Leimgruber III) serves up bite-sized verses that feel like late-night texts from your wisest friend—the one who’s equal parts mystic and meme lord.

For When Life Feels Like a Glitch The book’s 128 micro-poems (or “wakeup stories”) are perfect for anyone who’s to

@ubergarm
ubergarm / void-alchemy-bot-review.md
Created March 13, 2025 17:13
I ask DeepSeek-R1 671B `UD-Q2_K_XL` what it thinks about the book Void Alchemy: Riddles and Wakeup Stories by emptyduck.

>>> User:

Give a conversational yet technical discussion of the following book of verse in terms of what is known about channeling, spiritual and mystical traditions, chan and zen poetry, the rig veda, and other ancient mystical texts.

(paste in the pdf2text of free e-book from https://emptyduck.com)

>>> Assistant:

<think>

@ubergarm
ubergarm / DeepSeek-R1-Quantized-GGUF-Gaming-Rig-Inferencing-Fast-NVMe-SSD.md
Last active March 18, 2025 10:45
Run DeepSeek R1 671B unsloth GGUF locally with ktransformers or llama.cpp on high end gaming rig!

tl;dr;

UPDATE Mon Mar 10 10:51:31 AM EDT 2025 Check out the newer ktransformers guide for how to get it running faster! About 3.5 tok/sec on this same gaming rig. Big thanks to Supreeth Koundinya with analyticsindiamag.com for the article!

You can run the real deal big boi R1 671B locally off a fast NVMe SSD even without enough RAM+VRAM to hold the 212GB dynamically quantized weights. No it is not swap and won't kill your SSD's read/write cycle lifetime. No this is not a distill model. It works fairly well despite quantization (check the unsloth blog for details on how they did that).

The basic idea is that most of the model itself is not loaded into RAM on startup, but mmap'd. Then kv cache will take up some RAM. Most of your system RAM is left available to serve as disk cache for whatever experts/weights are currently most u

@ubergarm
ubergarm / kokoro-tts-benchmark-text.md
Last active February 10, 2025 18:01
Benchmarking text for kokoro-tts PyTorch vs ONNX comparison.

Text for benchmarking kokoro-tts. Copy paste this into your main.py test app e.g.

TEXT = """
1. Who am I ?
The gross body which is composed of the seven humours (dhatus), I am not; the five cognitive sense organs, viz. the senses of hearing, touch, sight, taste, and smell, which apprehend their respective objects, viz. sound, touch, colour, taste, and odour, I am not; the five cognitive sense- organs, viz. the organs of speech, locomotion, grasping, excretion, and procreation, which have as their respective functions speaking, moving, grasping, excreting, and enjoying, I am not; the five vital airs, prana, etc., which perform respectively the five functions of in-breathing, etc., I am not; even the mind which thinks, I am not; the nescience too, which is endowed only with the residual impressions of objects, and in which there are no objects and no functioning’s, I am not.

2. If I am none of these, then who am I?
After negating all of the above-mentioned as ‘not this’, ‘not this’, that Awareness whi
@ubergarm
ubergarm / search.md
Last active December 8, 2024 16:30
Spiritual Search YT Channels
@ubergarm
ubergarm / ai-summary-jpa-dissertation.md
Last active July 25, 2024 18:09
AI Summary of J.P. Ascher's Draft Ph.D. Dissertation

AI Summary of J.P. Ascher's Ph.D. Dissertation

To test long context LLM understanding of academic materials running locally on <= 24GB VRAM.

tl;dr;

I downloaded a complex ~450 page Ph.D. dissertation PDF, converted it to text, and prompted two LLMs to generate some summaries. Exact versions of llama.cpp and GGUFs used for inference are listed below. All tests performed locally on 3090TI w/ 24GB VRAM. Both models support ~128k context in their respective tokenization formats.

  • Mistral-Nemo-12B-Instruct-2407
    • Tokenizes document into 51617 tokens
  • Not really full support for explicit system prompt.
@ubergarm
ubergarm / rimworld-rimlog.csv
Last active June 12, 2024 16:18
RimWorld RimLog Mod v0.0.1 example output log csv txt file.
We can make this file beautiful and searchable if this error is corrected: No commas found in this CSV file in line 0.
#Example RimLog Header and CSV data file
#This example still has a dupe issue with LoadSave patch firing twice.
#You can use `miller` or Python Pandas to parse this and generate AI Story Prompts
#Example AI Generated Game Story: https://rentry.co/bzvb43mo
# Definition of each of the columns:
#timestamp in ticks - easy to convert: https://rimworldwiki.com/wiki/Time
#type by logging function
#defName if available or colony/pawn for quests
#text description from POV of pawn or simple ShortDescription string
# YY-MM-dd HH:mm:ss
@ubergarm
ubergarm / rimworld-save-file-story-mradermacher-llama-3-70B-Instruct-abliterated-i1-GGUF-llama-3-70B-Instruct-abliterated.i1-IQ3_XXS.gguf.md
Last active May 23, 2024 04:11
Parsed out RimWorld `world` save file with `xq '.results.result.savegame.game.history.archive.archivables.li[] | "\(.startingTime) \(.title) \(.text)"'` and passed into 8k context LLM for story.

Life on the Rim

As the shuttle crash-landed on the rim world planet, Wagner, Chad, and Gramps were thrown from their seats. The impact was intense, and the three baseliner xenotypes struggled to free themselves from the wreckage.

The first thing they noticed was the eerie silence. There were no birds chirping, no rustling of leaves, just an unsettling quiet. As they assessed their situation, they saw that they were in a dense forest, surrounded by towering trees that seemed to stretch up to the sky.

Wagner, ever the pragmatist, quickly took charge. "We need to assess our injuries and find shelter," he said, his voice calm and authoritative. Chad, the policeman, nodded in agreement, while Gramps, the herbalist, began to examine their surroundings, searching for any signs of danger or useful resources.

As they tended to their wounds, they realized that they were not alone on this planet. Strange creatures lurked just out of sight, their eyes glowing in the darkness. The three baseliners knew they had to

@ubergarm
ubergarm / rimworld-1.5-zetrith-multiplayer-common-mods.txt
Created May 12, 2024 01:00
Most common mods between above 9 RimWorld 1.5 Zetrith's Multiplayer Modpacks
https://steamcommunity.com/sharedfiles/filedetails/?id=3225433074" # Rimworld Multiplayer 1.5
https://steamcommunity.com/sharedfiles/filedetails/?id=3222890125" # 1.5 Multiplayer Pack
https://steamcommunity.com/sharedfiles/filedetails/?id=3219845807" # Hail's Rim Multiplayer 1.5
https://steamcommunity.com/sharedfiles/filedetails/?id=3233104905" # Multiplayer :3
https://steamcommunity.com/sharedfiles/filedetails/?id=3232085004" # RimWorld Multiplayer
https://steamcommunity.com/sharedfiles/filedetails/?id=3233792240" # Multiplayer w/ Rygiic
https://steamcommunity.com/sharedfiles/filedetails/?id=3235546043" # Multiplayer Collection
https://steamcommunity.com/sharedfiles/filedetails/?id=3241807816" # Multiplayer DokiDokiSquad
https://steamcommunity.com/sharedfiles/filedetails/?id=3220302481" # Itchys Multiplayer Pain
=== Most common mods between above 9 RimWorld 1.5 Zetrith's Multiplayer Modpacks ===