Brendan Freakin
adrienbrault
/ llama2-mac-gpu.sh
Last active
April 8, 2025 13:49
Run Llama-2-13B-chat locally on your M1/M2 Mac with GPU inference. Uses 10GB RAM. UPDATE: see https://twitter.com/simonw/status/1691495807319674880?s=20
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Clone llama.cpp | |
| git clone https://github.com/ggerganov/llama.cpp.git | |
| cd llama.cpp | |
| # Build it | |
| make clean | |
| LLAMA_METAL=1 make | |
| # Download model | |
| export MODEL=llama-2-13b-chat.ggmlv3.q4_0.bin |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| import ( | |
| "bufio" | |
| "fmt" | |
| "os" | |
| "sort" | |
| "strings" | |
| "syscall" |
montanaflynn
/ context.go
Last active
October 15, 2024 11:01
An example of using context to cancel goroutines between server handlers
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| package main | |
| import ( | |
| "context" | |
| "fmt" | |
| "log" | |
| "net/http" | |
| "sync" | |
| "time" | |
| ) |
jgilmour
/ install-cpuminer-centos-rhel.sh
Created
March 9, 2013 23:02
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/sh | |
| yum -y groupinstall "Development Tools" | |
| wget http://dl.fedoraproject.org/pub/epel/5/x86_64/epel-release-5-4.noarch.rpm | |
| wget http://rpms.famillecollet.com/enterprise/remi-release-5.rpm | |
| rpm -Uvh epel-release-5*.rpm | |
| rpm -Uvh remi-release-5*.rpm | |
| yum -y install python-devel screen | |
| yum --enablerepo=remi install libcurl-devel -y | |
| mkdir /opt/miner | |
| cd /opt/miner |