Skip to content

Instantly share code, notes, and snippets.

View neelakanta's full-sized avatar

Mahesh Neelakanta neelakanta

View GitHub Profile
@rain-1
rain-1 / llama-home.md
Last active June 24, 2025 11:12
How to run Llama 13B with a 6GB graphics card

This worked on 14/May/23. The instructions will probably require updating in the future.

llama is a text prediction model similar to GPT-2, and the version of GPT-3 that has not been fine tuned yet. It is also possible to run fine tuned versions (like alpaca or vicuna with this. I think. Those versions are more focused on answering questions)

Note: I have been told that this does not support multiple GPUs. It can only use a single GPU.

It is possible to run LLama 13B with a 6GB graphics card now! (e.g. a RTX 2060). Thanks to the amazing work involved in llama.cpp. The latest change is CUDA/cuBLAS which allows you pick an arbitrary number of the transformer layers to be run on the GPU. This is perfect for low VRAM.

  • Clone llama.cpp from git, I am on commit 08737ef720f0510c7ec2aa84d7f70c691073c35d.
@marco79cgn
marco79cgn / adele-30-countdown.js
Last active April 21, 2022 04:07
A scriptable widget that counts down the days until the new Adele album "30" is released and plays her latest single until then
// Once you tap the widget, it plays her new single "Easy on me" on YouTube (default).
// You can configure "apple" or "spotify" as widget parameter
// to open the song in the corresponding app
const PARAM = args.widgetParameter
const DATE = "2021-11-19T08:00:00Z"
const BG_IMG_URL = "https://i.imgur.com/CycspeY.jpg"
const YOUTUBE_LINK = "https://www.youtube.com/watch?v=U3ASj1L6_sY"
const SPOTIFY_SONG_LINK = "https://open.spotify.com/track/0gplL1WMoJ6iYaPgMCL0gX?si=ea4b8de949d042dc"
const APPLE_ALBUM_LINK = "https://music.apple.com/de/album/30/1590035691"
@hypothete
hypothete / wifi-test.ino
Created August 14, 2019 14:32
ESP32 WiFi test
#include <WiFi.h>
#include "SSD1306Wire.h"
#include "secrets.h"
int counter = 0;
SSD1306Wire display(0x3c, 5, 4);
void setupDisplay() {
display.init();
display.setContrast(255);
@stevenringo
stevenringo / reinvent-2017-youtube.md
Created December 3, 2017 23:01
Links to YouTube recordings of AWS re:Invent 2017 sessions

| Title | Description

@leonardofed
leonardofed / README.md
Last active September 22, 2025 13:50
A curated list of AWS resources to prepare for the AWS Certifications


A curated list of AWS resources to prepare for the AWS Certifications

A curated list of awesome AWS resources you need to prepare for the all 5 AWS Certifications. This gist will include: open source repos, blogs & blogposts, ebooks, PDF, whitepapers, video courses, free lecture, slides, sample test and many other resources.