rain-1

This worked on 14/May/23. The instructions will probably require updating in the future.

llama is a text prediction model similar to GPT-2, and the version of GPT-3 that has not been fine tuned yet. It is also possible to run fine tuned versions (like alpaca or vicuna with this. I think. Those versions are more focused on answering questions)

Note: I have been told that this does not support multiple GPUs. It can only use a single GPU.

It is possible to run LLama 13B with a 6GB graphics card now! (e.g. a RTX 2060). Thanks to the amazing work involved in llama.cpp. The latest change is CUDA/cuBLAS which allows you pick an arbitrary number of the transformer layers to be run on the GPU. This is perfect for low VRAM.

• Clone llama.cpp from git, I am on commit 08737ef720f0510c7ec2aa84d7f70c691073c35d.

stettix

Things I believe

This is a collection of the things I believe about software development. I have worked for years building backend and data processing systems, so read the below within that context.

Agree? Disagree? Feel free to let me know at @JanStette. See also my blog at www.janvsmachine.net.

Fundamentals

Keep it simple, stupid. You ain't gonna need it.

arno01

WORK IN PROGRESS

Docker on Android

Setup:

Samsung Galaxy Tab S5e SM-T720
Android Pie on Linux 4.9.112 (not rooted)
Termux

caongocthai

package main

// The string values of the 2 classes
// They can be "positive" >< "negative" as in this example
// They can also be "ham" >< "spam", i.e.
const (
	positive = "positive"
	negative = "negative"
)

davecheney

name                   old time/op    new time/op     delta
BinaryTree17              5.44s ± 2%      3.27s ± 2%   -39.90%  (p=0.000 n=20+19)
Fannkuch11                4.95s ± 2%      2.68s ± 2%   -45.87%  (p=0.000 n=20+20)
FmtFprintfEmpty           142ns ± 2%       49ns ± 3%   -65.39%  (p=0.000 n=20+18)
FmtFprintfFloat           765ns ± 2%      260ns ± 2%   -66.02%  (p=0.000 n=20+20)
FmtFprintfInt             341ns ± 2%       95ns ± 2%   -72.08%  (p=0.000 n=19+20)
FmtFprintfIntInt          554ns ± 2%      150ns ± 1%   -72.95%  (p=0.000 n=20+19)
FmtFprintfPrefixedInt     497ns ± 3%      178ns ± 3%   -64.12%  (p=0.000 n=20+20)
FmtFprintfString          466ns ± 2%       86ns ± 3%   -81.54%  (p=0.000 n=20+20)
FmtManyArgs              2.23µs ± 2%     0.59µs ± 1%   -73.46%  (p=0.000 n=20+17)

claudiofahey

//
// Companion code to https://medium.com/statuscode/pipeline-patterns-in-go-a37bb3a7e61d
//
// To run:
//   go get github.com/pkg/errors
//   go run -race pipeline_demo.go
//

package main

tabrindle

#!/bin/bash

PARAMS=('-m 6 -q 70 -mt -af -progress')

if [ $# -ne 0 ]; then
	PARAMS=$@;
fi

cd $(pwd)