Skip to content

Instantly share code, notes, and snippets.

View shijie-wu's full-sized avatar

Shijie Wu shijie-wu

111 followers · 14 following
View GitHub Profile
@ArthurZucker
ArthurZucker / static_kv_cache.py
Last active October 21, 2024 02:08
simple static kv cache script
from transformers import AutoModelForCausalLM, AutoTokenizer, StaticCache
import torch
from typing import Optional
device = "cuda"
# Copied from the gpt-fast repo
def multinomial_sample_one_no_sync(probs_sort): # Does multinomial sampling without a cuda synchronization
q = torch.empty_like(probs_sort).exponential_(1)
return torch.argmax(probs_sort / q, dim=-1, keepdim=True).to(dtype=torch.int)
@JoostvDoorn
JoostvDoorn / encoderdecodercoupling.lua
Last active November 30, 2016 05:21
cuDNN R5 RNN test
--[[
Example of "coupled" separate encoder and decoder networks using cudnn, e.g. for sequence-to-sequence networks.
]]--
require 'rnn'
require 'cunn'
require 'cudnn'
@nl5887
nl5887 / transfer.fish
Last active July 30, 2024 09:21
Bash and zsh alias for transfer.sh. Transfers files and directories to transfer.sh.
function transfer
if test (count $argv) -eq 0
echo "No arguments specified. Usage:\necho transfer /tmp/test.md\ncat /tmp/test.md | transfer test.md"
return 1
end
## get temporarily filename, output is written to this file show progress can be showed
set tmpfile ( mktemp -t transferXXX )
## upload stdin or file
@beeftornado
beeftornado / rmtree.rb
Created July 16, 2014 22:41
Homebrew external command to remove a formula and its dependencies that are no longer used. Warning: Not all formulas declare all their dependencies.
# Install to /usr/local/Library/Homebrew/cmd/rmtree.rb
require 'keg'
require 'formula'
require 'shellwords'
module Homebrew
def rmtree
raise KegUnspecifiedError if ARGV.named.empty?
@mcandre
mcandre / mac-app-fix-path.md
Last active April 12, 2021 18:43

How to inform Eclipse and other Mac applications of the command line PATH

  1. Update Mac OS X's notion of PATH.
$ defaults write ~/.MacOSX/environment PATH "`echo $PATH`"
$ echo "setenv PATH $PATH" | sudo tee /etc/launchd.conf
  1. Restart Mac OS X.
@cjgiridhar
cjgiridhar / sqliteform.html
Created August 25, 2012 16:39
Tornado - SQLite DB
<html>
<title>
SQLite Example
</title>
<body>
<FORM ACTION="/create" METHOD=POST>
Name: <input type="text" name="name">
Marks: <input type="text" name="marks">
@MohamedAlaa
MohamedAlaa / tmux-cheatsheet.markdown
Last active October 21, 2025 16:41
tmux shortcuts & cheatsheet

tmux shortcuts & cheatsheet

start new:

tmux

start new with session name:

tmux new -s myname