create different ssh key according the article Mac Set-Up Git
$ ssh-keygen -t rsa -C "your_email@youremail.com"
#!/usr/bin/env python | |
""" | |
nsb_entropy.py | |
June, 2011 written by Sungho Hong, Computational Neuroscience Unit, Okinawa Institute of | |
Science and Technology | |
May, 2019 updated to Python 3 by Charlie Strauss, Los Alamos National Lab | |
This script is a python version of Mathematica functions by Christian Mendl |
create different ssh key according the article Mac Set-Up Git
$ ssh-keygen -t rsa -C "your_email@youremail.com"
mix3d asked for some help using this guide with windows so here we go. This was tested with Windows 10. Run all commands in Git Bash once it's installed.
Github will be the main account and bitbucket the secondary.
""" | |
Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy) | |
BSD License | |
""" | |
import numpy as np | |
# data I/O | |
data = open('input.txt', 'r').read() # should be simple plain text file | |
chars = list(set(data)) | |
data_size, vocab_size = len(data), len(chars) |
import numpy as np | |
from tensorflow.python.summary.event_accumulator import EventAccumulator | |
import matplotlib as mpl | |
import matplotlib.pyplot as plt | |
def plot_tensorflow_log(path): | |
# Loading too much data is slow... | |
tf_size_guidance = { |
Maybe you've heard about this technique but you haven't completely understood it, especially the PPO part. This explanation might help.
We will focus on text-to-text language models 📝, such as GPT-3, BLOOM, and T5. Models like BERT, which are encoder-only, are not addressed.
Reinforcement Learning from Human Feedback (RLHF) has been successfully applied in ChatGPT, hence its major increase in popularity. 📈
RLHF is especially useful in two scenarios 🌟: