Skip to content

Instantly share code, notes, and snippets.

View pacman100's full-sized avatar

Sourab Mangrulkar pacman100

View GitHub Profile
#checking if conversion is correct
code:
import sys
import torch
from megatron import get_args, get_tokenizer, initialize_megatron, mpu
from megatron.model import GPTModel
from megatron.training import get_model
from megatron.checkpointing import load_checkpoint