Skip to content

Instantly share code, notes, and snippets.

View TejaGollapudi's full-sized avatar

Teja Gollapudi TejaGollapudi

View GitHub Profile
@TejaGollapudi
TejaGollapudi / Demo.ipynb
Created June 30, 2022 04:16
BERT pretraining demo notebook
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@karpathy
karpathy / min-char-rnn.py
Last active July 16, 2024 17:48
Minimal character-level language model with a Vanilla Recurrent Neural Network, in Python/numpy
"""
Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy)
BSD License
"""
import numpy as np
# data I/O
data = open('input.txt', 'r').read() # should be simple plain text file
chars = list(set(data))
data_size, vocab_size = len(data), len(chars)