Skip to content

Instantly share code, notes, and snippets.

@moonlockwood
moonlockwood / README.md
Created December 17, 2024 12:01
Toy Byte Latent Transformer

* warning * This is non rigorous and probably wrong

Simplest framework needed to mess around with a BLT

o1 says:

Below is a self-contained, minimal example showing how you might implement and train a very simplified Byte Latent Transformer (BLT)-style model on a single machine with 1-2 GPUs. This is a toy implementation for experimentation and does not replicate the scale or exact performance of the official implementation. It focuses on the main architectural concepts: a local byte encoder, a global latent transformer operating on patches, and a local decoder. The code uses a simple fixed-stride patching scheme and trains on a dummy dataset of random bytes. You can adapt it to use your own dataset and incorporate entropy-based patching later.

What this example does:

@streslab
streslab / Headless_Ethereum_Ubuntu_16.04.md
Last active April 4, 2022 23:45
Headless NVIDIA overclock setup under Ubuntu Server 16.04 for ethereum mining

Headless Ethereum Miner Setup - NVIDIA

Reed Slaby, March 2018

Having grown tired of wasting a perfectly good monitor on my ethereum mining rig, I finally decided to replace the Ubuntu Desktop 16.04 installation with Ubuntu Server 16.04. Many of the gtutorials available at the time of this writing range from unecessarily complicated to flat-out wrong. This guide is intended to address many of those shortfalls.

Prerequisites

To complete this guide, you should already have:

  • Basic knowledge of Linux
  • An Ethereum wallet
@wilon
wilon / vim-surround使用指南.MD
Last active March 11, 2025 04:30
vim-surround使用指南,vim-surround如何使用

普通模式

命令 说明 + 示例
ds 删除括号
ds " "Hello world!" =>
Hello world!
cs 替换括号
cs "( "Hello world!" =>
(Hello world!)
cS 替换括号,括号内文本做新一行
cS "{ "Hello world!" => {     Hello world! }
@kevin-smets
kevin-smets / iterm2-solarized.md
Last active July 11, 2025 18:12
iTerm2 + Oh My Zsh + Solarized color scheme + Source Code Pro Powerline + Font Awesome + [Powerlevel10k] - (macOS)

Default

Default

Powerlevel10k

Powerlevel10k