Skip to content

Instantly share code, notes, and snippets.

View epappas's full-sized avatar
👨‍💻
I'm Building Something Interesting :)

Evangelos Pappas epappas

👨‍💻
I'm Building Something Interesting :)
View GitHub Profile
@epappas
epappas / llama-home.md
Created May 14, 2023 19:48 — forked from rain-1/llama-home.md
How to run Llama 13B with a 6GB graphics card

This worked on 14/May/23. The instructions will probably require updating in the future.

llama is a text prediction model similar to GPT-2, and the version of GPT-3 that has not been fine tuned yet. It is also possible to run fine tuned versions (like alpaca or vicuna with this. I think. Those versions are more focused on answering questions)

Note: I have been told that this does not support multiple GPUs. It can only use a single GPU.

It is possible to run LLama 13B with a 6GB graphics card now! (e.g. a RTX 2060). Thanks to the amazing work involved in llama.cpp. The latest change is CUDA/cuBLAS which allows you pick an arbitrary number of the transformer layers to be run on the GPU. This is perfect for low VRAM.

  • Clone llama.cpp from git, I am on commit 08737ef720f0510c7ec2aa84d7f70c691073c35d.
@epappas
epappas / ecs2compose
Created May 6, 2021 17:26
A simple script to convert ecs tasks to docker-compose for better understanding.
#!/usr/bin/env bash
#
# This is a free to use, free to restribute,
# free to fork and free to edit software.
#
# No responsibility is granted for its use
#
# Contributors:
# - Evangelos Pappas <epappas@evalonlabs.com>
#

Keybase proof

I hereby claim:

  • I am epappas on github.
  • I am epappas (https://keybase.io/epappas) on keybase.
  • I have a public key ASDRqsNfcxHKaAWKffT5erIJYTq3Dunv0oP_aZEPpnTOFwo

To claim this, I am signing this object:

@epappas
epappas / epappas.pgp.asc
Created April 21, 2016 06:46
pgp Evangelos Pappas <epappas@evalonlabs.com>
-----BEGIN PGP PUBLIC KEY BLOCK-----
Version: GnuPG v1
mQINBFbj6j4BEACwnopZCfZCRFDMBwxFIU3BgybBMu4rxoqhztrE/L/3mbhqmbPR
zwPbn02Z2I8eTfagVeldRSZdOXWwUSNThLBHN34NyO9h82gX5Vo2/EXVHBwObnwT
uGiaHfU00gOHiIsUlRjQzDPAPhV+OxvVmyjNJEFsiN8hIJ8Ft2x4FrxPiEQN29JN
TGXGoUyBM0wzcNy0VBG9/X6AF0TV69saLPl4NGQ3kFPyJmst+U7q+q+ohOzF4QCI
0byFDfE+RsjGBk2bRtEy81oVjDczJYYEaZJhP7jYSxWBb59z3hKMfWGL2Vhbq9Yn
1aknQ8ahXX8Zfk3tX88xF2r7jiMzmvQ4tRmeWTV5s8h94UfO8JMzAFQAGxyBo3dv
nbu378VyhuSxXOaoaEmbiMyTVn2Ppi9Hg6CJ+QsWe8cfSjM2Enn2G7pPmtFI94oh
@epappas
epappas / evancrypt.sh
Last active December 8, 2015 23:34
Encrypt files & folders for Mac & Linux
#!/bin/sh
#
# This is a free to use, free to restribute,
# free to fork and free to edit software.
#
# No responsibility is granted for its use
#
# Contributors:
# - Evangelos Pappas <epappas@evalonlabs.com>
#
@epappas
epappas / trusted_useless_channel.sh
Created December 5, 2015 14:34
trusted useless channel
#server
while true; do nc -lp 4445 | openssl aes-256-cbc -d -salt -k proxyPass | openssl aes-256-cbc -d -salt -k realPass | base64 --decode | cat; done
#proxy
while true; do nc -lp 4444 | openssl aes-256-cbc -salt -k proxyPass | nc localhost 4445; done
#client
while true; do cat /dev/urandom | head -c 10 | base64 | openssl aes-256-cbc -salt -k realPass | nc localhost 4444; done
@epappas
epappas / domains.js
Created May 13, 2015 10:04
Domains in express
function __domains(req, res, next) {
var d = domain.create();
d.id = crypto.randomBytes(32).toString('base64');
d.add(req);
d.add(res);
d.run(function() {
next();
});
@epappas
epappas / couchDBInstall.sh
Created May 5, 2015 15:05
install couchdb
#! /usr/bin/env bash
apt-get update
apt-get install -y build-essential
apt-get install -y build-essential
apt-get install -y erlang-base erlang-dev erlang-nox erlang-eunit
apt-get install -y libmozjs185-dev libicu-dev libcurl4-gnutls-dev libtool
apt-get install -y curl
cd /usr/local/src
curl -O http://apache.mirrors.tds.net/couchdb/source/1.6.1/apache-couchdb-1.6.1.tar.gz
@epappas
epappas / gist:7f83004640ba3a83bb4a
Last active August 29, 2015 14:20
Binary clock
perl -e 'for(;;sleep 1){printf"\r"."%.4b "x6,split"",`date +%H%M%S`}'
perl -e 'for(;;){@d=split("",`date +%H%M%S`);print"\r";for(0..5){printf"%.4b ",$d[$_]}sleep 1}'
@epappas
epappas / gist:bf1f763e06561cf26054
Last active August 29, 2015 14:19
Start-up co-offices & contracting
[London]
https://www.bathtub2boardroom.com/
https://www.wework.com/london-workspace
http://ministryofstartups.co.uk/
[contracting]
https://www.ipse.co.uk/advice/articles/starting-out
https://news.ycombinator.com/item?id=9726182
http://www.contractoruk.com/first_timers/
https://github.com/tadast/switching-to-contracting-uk