Skip to content

Instantly share code, notes, and snippets.

Starting LocalAI using 4 threads, with models path: /Users/soleblaze/models
12:29PM DBG Model: 7B (config: {OpenAIRequest:{Model:ggml-model-q4_0.bin File: Language: ResponseFormat: Size: Prompt:<nil> Instruction: Input:<nil> Stop:<nil> Messages:[] Stream:false Echo:false TopP:0 TopK:0 Temperature:0 Maxtokens:0 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 Seed:0 Mode:0 Step:0} Name:7B StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:0 F16:false Threads:0 Debug:false Roles:map[] Embeddings:false Backend: TemplateConfig:{Completion: Chat: Edit:} MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:1 ImageGenerationAssets: PromptCachePath: PromptCacheAll:false PromptStrings:[] InputStrings:[] InputToken:[]})
12:29PM DBG GPT4ALL_IMPLEMENTATIONS_PATH: /tmp/localai/backend_data/backend-assets/gpt4all
┌───────────────────────────────────────────────────┐
│ Fiber v2.46.0 │
@soleblaze
soleblaze / gist:5300bea5ebb8236d54368b1940a1d653
Created June 6, 2023 16:06
llama cpp output using metal on commit 5220a99
llama.cpp (5220a99)
❯ pwd
/Users/soleblaze/git/thirdparty/localai/go-llama/llama.cpp
❯ LLAMA_METAL=1 make
I llama.cpp build info:
I UNAME_S: Darwin
I UNAME_P: arm
I UNAME_M: arm64
I CFLAGS: -I. -O3 -std=c11 -fPIC -DNDEBUG -Wall -Wextra -Wpedantic -Wcast-qual -Wdouble-promotion -Wshadow -Wstrict-prototypes -Wpointer-arith -pthread -DGG
@soleblaze
soleblaze / dejavumononf.css
Last active November 13, 2019 21:25
DejaVu Sans Mono Nerd Font
@font-face {
font-family: "DejaVuSansMono NF";
font-style: normal;
font-weight: normal;
src: url(https://github.com/ryanoasis/nerd-fonts/raw/master/patched-fonts/DejaVuSansMono/Regular/complete/DejaVu%20Sans%20Mono%20Nerd%20Font%20Complete.ttf);
}
@soleblaze
soleblaze / gist:3f21e78b321cc613cf30d2c41036463c
Last active January 9, 2019 15:00
chrome secure shell cobalt2 colors
Original:
{"0":"#000000","1":"#FF0900","2":"#38DE21","3":"#FFDD00","4":"#0088FF","5":"#FF628C","6":"#80FFC2","7":"#FFFFFF","8":"#555555","9":"#FF9D00","10":"#3BD01D","11":"#EDC809","12":"#5555FF","13":"#FF55FF","14":"#6AE3FA","15":"#FFFFFF"}
Hyper:
{"0":"#000000","1":"#ff2600","2":"#3ad900","3":"#FFc600","4":"#1478db","5":"#ff2c70","6":"#00c5c7","7":"#c7c7c7","8":"#808080","9":"#FF0000","10":"#33ff00","11":"#ff0000","12":"#1478db","13":"#cc00ff","14":"#00ffff","15":"#FFFFFF"}
Background: #193549
Foreground: #c7c7c7
Cursor: #ffc600
@soleblaze
soleblaze / cobalt2-hyper.js
Last active January 9, 2019 15:03
Cobalt2 Blink Shell Color Scheme based on cobalt2 hyper version
t.prefs_.set('color-palette-overrides',["#000000", "#ff2600", "#3ad900", "#ffc600", "#1478db", "#ff2c70", "#00c5c7", "#c7c7c7", "#808080", "#ff0000", "#33ff00", "#ffff00", "#1478DB", "#cc00ff", "#00ffff", "#FFFFFF"]);
t.prefs_.set('foreground-color', "#c7c7c7");
t.prefs_.set('background-color', "#193549");
t.prefs_.set('cursor-color', '#ffc600');
@soleblaze
soleblaze / cobalt2.js
Last active November 1, 2018 01:15
Cobalt 2 Blink Shell Theme
t.prefs_.set('color-palette-overrides',["#000000", "#FF0900", "#38DE21", "#FFDD00", "#0088FF", "#FF628C", "#80FFC2", "#BBBBBB", "#555555", "#FF9D00", "#3BD01D", "#EDC809", "#5555FF", "#FF55FF", "#6AE3FA", "#FFFFFF"]);
t.prefs_.set('foreground-color', "#FFFFFF");
t.prefs_.set('background-color', "#193549");
t.prefs_.set('cursor-color', 'rgba(240,204,9,0.5)');
@soleblaze
soleblaze / gist:975bc2b0e5e69137fd08
Last active August 21, 2017 18:21
/etc/X11/xorg.conf.d/50-synaptics.conf
Section "InputClass"
Identifier "touchpad"
Driver "synaptics"
MatchIsTouchpad "on"
# Enables Palm Detection to prevent bad clicks
# This seems to work on PS/2, but not on i2c
Option "PalmDetect" "1"
Option "PalmMinWidth" "8"
Option "PalmMinZ" "100"
# Enable clickpad support
@soleblaze
soleblaze / keybase.md
Last active September 20, 2015 05:02
keybase.md

Keybase proof

I hereby claim:

  • I am soleblaze on github.
  • I am soleblaze (https://keybase.io/soleblaze) on keybase.
  • I have a public key whose fingerprint is 0118 1B61 1EDB DBE2 3E5E AA55 D5EC 0FAC BA96 37BE

To claim this, I am signing this object: