visualDust

Download and convert llama-7b model to huggingface format

This is a refined version of huggingface/LLaMA2 Usage tips.

Go to somewhere you want to put the original llama2 7b model weights, maybe in the download folder. Create a folder called LLaMA:

cd ~/downloads (or maybe somewhere else)
mkdir LLaMA
cd LLaMA

visualDust

import time
import torch
import torch.nn as nn
import torch.nn.functional as F
import torchvision.datasets as datasets
import neetbox
from torchvision import transforms
from torch.utils.data import DataLoader
from neetbox import logger

visualDust

def one_hot_encode(
    mask: torch.Tensor,
    num_classes: int,
    ignored_label: Union[str, int] = "negative",
):
    """Convert the mask to a one-hot encoded representation by @visualDust

    Args:
        mask (torch.Tensor): indexed label image. Should types int
        num_classes (int): number of classes

visualDust

LaTeX      33 hrs 5 mins  ██████████████▎░░░░░░  68.1%
Other      9 hrs 36 mins  ████▏░░░░░░░░░░░░░░░░  19.8%
Markdown   3 hrs 54 mins  █▋░░░░░░░░░░░░░░░░░░░   8.1%
Python     1 hr 23 mins   ▌░░░░░░░░░░░░░░░░░░░░   2.9%
Java       14 mins        ░░░░░░░░░░░░░░░░░░░░░   0.5%