Skip to content

Instantly share code, notes, and snippets.

View mattdf's full-sized avatar
😶

Matthew Di Ferrante mattdf

😶
View GitHub Profile
@mattdf
mattdf / alpaca-lora-65b.py
Created April 20, 2023 15:46
Alpaca-Lora-65B Multi GPU
import torch
from peft import PeftModel, get_peft_model, LoraConfig, set_peft_model_state_dict
import transformers
import gradio as gr
import json
assert (
"LlamaTokenizer" in transformers._import_structure["models.llama"]
), "LLaMA is now in HuggingFace's main branch.\nPlease reinstall it: pip uninstall transformers && pip install git+https://github.com/huggingface/transformers.git"
from transformers import LlamaTokenizer, LlamaForCausalLM, GenerationConfig
===== BEGIN SOLIDSTAMP VERIFICATION =====
nw4ovvfs4ehvwqyli213i4bltcf9czqd
===== END SOLIDSTAMP VERIFICATION =====
===== BEGIN SOLIDSTAMP VERIFICATION =====
nfvkwmcm5f2anhyvct3yndd1pbmjrqta
===== END SOLIDSTAMP VERIFICATION =====
@mattdf
mattdf / keybase.md
Created September 5, 2016 17:15
Keybase verification

Keybase proof

I hereby claim:

  • I am mattdf on github.
  • I am mattdf (https://keybase.io/mattdf) on keybase.
  • I have a public key whose fingerprint is 108E 9D50 36C1 E855 7EFA EDC9 7DD5 678E DDA7 4DE9

To claim this, I am signing this object: