Skip to content

Instantly share code, notes, and snippets.

View python273's full-sized avatar

Kirill R. python273

223 followers · 0 following
View GitHub Profile
@python273
python273 / tglang.c
Last active April 8, 2024 16:41
#include "tglang.h"
#include "weights.h"
#include <stdlib.h>
#include <string.h>
#include <stdint.h>
#include <stdio.h>
#include <math.h>
@python273
python273 / README.md
Last active April 21, 2023 13:53
Transformers LLaMA 
conda create -n llama
conda activate llama

conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
conda install cudatoolkit==11.8.0 -c conda-forge
python -s -m pip install bitsandbytes accelerate sentencepiece
python -s -m pip install git+https://github.com/huggingface/transformers
@python273
python273 / app.py
Last active April 19, 2024 11:05
Flask Streaming Langchain Example
import os
os.environ["OPENAI_API_KEY"] = ""
from flask import Flask, Response, request
import threading
import queue
from langchain.chat_models import ChatOpenAI
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler
from langchain.schema import AIMessage, HumanMessage, SystemMessage
@python273
python273 / app.py
Created March 25, 2023 04:36
Flask SSE demo
from flask import Flask, Response
import time
import json
app = Flask(__name__)
@app.route('/')
def index():
return Response('''
<!DOCTYPE html>
@python273
python273 / benchmark_ram_to_vram.py
Created March 24, 2023 13:08
import time
import numpy as np
import pyopencl as cl
def main():
bytes_size = 10*1024*1024*1024
num_of_floats = bytes_size // 4
devices = sum([x.get_devices(device_type=cl.device_type.GPU) for x in cl.get_platforms()], [])
device = devices[0]
@python273
python273 / yt-0-fix-one-channel-audio.js
Last active April 26, 2023 12:40
Youtube: fix one channel audio
(function (){
var context = new AudioContext();
source = context.createMediaElementSource(document.querySelector('video'));
splitter = context.createChannelSplitter();
merger = context.createChannelMerger();
source.connect(splitter);
splitter.connect(merger, 0, 0); // first 0 is input channel
splitter.connect(merger, 0, 1);
merger.connect(context.destination);
})();
@python273
python273 / dumpmem.py
Created October 19, 2021 17:22
Stop a process and dump memory segments. Based on https://shafiqvinales.wordpress.com/2017/09/14/dump-a-linux-processs-memory-to-file/
from pathlib import Path
import os
import ctypes, re, sys
from pprint import pprint
import traceback
c_ptrace = ctypes.CDLL("libc.so.6").ptrace
c_pid_t = ctypes.c_int32
c_ptrace.argtypes = [ctypes.c_int, c_pid_t, ctypes.c_void_p, ctypes.c_void_p]
@python273
python273 / README.md
Created May 12, 2021 18:03
JavaScript: how to find screen coordinates of a substring in an element OR how to hightlight words

JavaScript: how to find screen coordinates of a substring in an element OR how to hightlight words

Firefox's Reader mode highlights words when using text-to-speech. Here is related code:

const h = new Highlighter(window, document.getElementById('your-el'));
// highlight(startOffset, length)
h.highlight(8, 12);
@python273
python273 / README.md
Created May 5, 2021 18:11
Rust piping fix (e.g. when piping into less or head) 
thread 'main' panicked at 'failed printing to stdout: Broken pipe (os error 32)', library/std/src/io/stdio.rs:940:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

use std::error;
use std::io::Write;
@python273
python273 / midi_tempo_convert.py
Created January 21, 2020 00:06
import time
from mido import MidiFile
from mido import bpm2tempo, tempo2bpm
mid = MidiFile('some.midi')
new_tempo = 75
# track numbers are hardcoded, might be different
old_tempo = tempo2bpm(mid.tracks[0][2].tempo)