Skip to content

Instantly share code, notes, and snippets.

View python273's full-sized avatar

Kirill R. python273

232 followers · 0 following
View GitHub Profile
@python273
python273 / jitvis.py
Last active July 25, 2024 22:56
TinyJit vis WIP
from tinygrad import Tensor, TinyJit, nn
from tinygrad.helpers import JIT
from tinygrad.nn.optim import SGD
from tinygrad.nn.state import get_parameters
class TinyNet:
def __init__(self):
self.l1 = nn.Linear(784, 128, bias=False)
self.l2 = nn.Linear(128, 10, bias=False)
@python273
python273 / tglang.c
Last active October 12, 2024 23:02
https://contest.com/docs/ML-Competition-2023-r2 https://contest.com/ml2023-r2 https://t.me/contest/353
#include "tglang.h"
#include "weights.h"
#include <stdlib.h>
#include <string.h>
#include <stdint.h>
#include <stdio.h>
#include <math.h>
@python273
python273 / README.md
Last active April 21, 2023 13:53
Transformers LLaMA 
conda create -n llama
conda activate llama

conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
conda install cudatoolkit==11.8.0 -c conda-forge
python -s -m pip install bitsandbytes accelerate sentencepiece
python -s -m pip install git+https://github.com/huggingface/transformers
@python273
python273 / app.py
Last active November 16, 2024 20:35
Flask Streaming Langchain Example
import os
os.environ["OPENAI_API_KEY"] = ""
from flask import Flask, Response, request
import threading
import queue
from langchain.chat_models import ChatOpenAI
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler
from langchain.schema import AIMessage, HumanMessage, SystemMessage
@python273
python273 / app.py
Created March 25, 2023 04:36
Flask SSE demo
from flask import Flask, Response
import time
import json
app = Flask(__name__)
@app.route('/')
def index():
return Response('''
<!DOCTYPE html>
@python273
python273 / benchmark_ram_to_vram.py
Created March 24, 2023 13:08
import time
import numpy as np
import pyopencl as cl
def main():
bytes_size = 10*1024*1024*1024
num_of_floats = bytes_size // 4
devices = sum([x.get_devices(device_type=cl.device_type.GPU) for x in cl.get_platforms()], [])
device = devices[0]
@python273
python273 / yt-0-fix-one-channel-audio.js
Last active August 6, 2024 18:52
Youtube: fix one channel audio
(function (){
var context = new AudioContext();
source = context.createMediaElementSource(document.querySelector('video'));
splitter = context.createChannelSplitter();
merger = context.createChannelMerger();
source.connect(splitter);
splitter.connect(merger, 0, 0); // first 0 is input channel
splitter.connect(merger, 0, 1);
merger.connect(context.destination);
})();
@python273
python273 / dumpmem.py
Created October 19, 2021 17:22
Stop a process and dump memory segments. Based on https://shafiqvinales.wordpress.com/2017/09/14/dump-a-linux-processs-memory-to-file/
from pathlib import Path
import os
import ctypes, re, sys
from pprint import pprint
import traceback
c_ptrace = ctypes.CDLL("libc.so.6").ptrace
c_pid_t = ctypes.c_int32
c_ptrace.argtypes = [ctypes.c_int, c_pid_t, ctypes.c_void_p, ctypes.c_void_p]
@python273
python273 / README.md
Created May 12, 2021 18:03
JavaScript: how to find screen coordinates of a substring in an element OR how to hightlight words

JavaScript: how to find screen coordinates of a substring in an element OR how to hightlight words

Firefox's Reader mode highlights words when using text-to-speech. Here is related code:

const h = new Highlighter(window, document.getElementById('your-el'));
// highlight(startOffset, length)
h.highlight(8, 12);
@python273
python273 / README.md
Created May 5, 2021 18:11
Rust piping fix (e.g. when piping into less or head) 
thread 'main' panicked at 'failed printing to stdout: Broken pipe (os error 32)', library/std/src/io/stdio.rs:940:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

use std::error;
use std::io::Write;