Skip to content

Instantly share code, notes, and snippets.

View lts-rad's full-sized avatar

Alex Rad lts-rad

View GitHub Profile
@moyix
moyix / codegen_gptj_convert.py
Created July 22, 2022 19:33
Convert a SalesForce CodeGen model's weights to plain GPT-J
#!/usr/bin/env python
import argparse
import torch
from transformers import GPTJForCausalLM, GPTJConfig
# Note: these need the git version of Transformers as of 7/22/2022
from transformers import CodeGenTokenizer, CodeGenForCausalLM
from transformers import CODEGEN_PRETRAINED_MODEL_ARCHIVE_LIST
parser = argparse.ArgumentParser('Convert SalesForce CodeGen model to GPT-J')
@aut0
aut0 / howto_crosscompile_ubuntu_kernel.md
Last active March 21, 2022 04:41
Cross-compile Ubuntu arm64 mainline kernel v5.7.6