svpino

import torch
import peft
import transformers
from transformers import AutoTokenizer, AutoModelForCausalLM
from huggingface_hub.hf_api import HfFolder

ACCESS_TOKEN = "ENTER YOUR HUGGINGFACE ACCESS TOKEN HERE"

HfFolder.save_token(ACCESS_TOKEN)

JoaoLages

Maybe you've heard about this technique but you haven't completely understood it, especially the PPO part. This explanation might help.

We will focus on text-to-text language models 📝, such as GPT-3, BLOOM, and T5. Models like BERT, which are encoder-only, are not addressed.

Reinforcement Learning from Human Feedback (RLHF) has been successfully applied in ChatGPT, hence its major increase in popularity. 📈

RLHF is especially useful in two scenarios 🌟:

• You can’t create a good loss function
  • Example: how do you calculate a metric to measure if the model’s output was funny?
• You want to train with production data, but you can’t easily label your production data

sdiehl

Twitter threads from @smdiehl on Crypto Skepticism

• Bitcoin - https://twitter.com/smdiehl/status/1349307219318345728
• Environemtal Impact of Mining - https://twitter.com/smdiehl/status/1350869944888664064
• Ransomware & Extortion - https://twitter.com/smdiehl/status/1353369991022784515
• Cryptocurrency Exchanges - https://twitter.com/smdiehl/status/1355227881065082888
• Toxic Culture of Cryptocurrency - https://twitter.com/smdiehl/status/1358860077168537610
• Phoney Populism - https://twitter.com/smdiehl/status/1360504285440708611
• Whataboutism - https://twitter.com/smdiehl/status/1363418896301228033
• Investment Properties - https://twitter.com/smdiehl/status/1367409708517236736

LegrandNico

yunpengn

Install PostgreSQL on Ubuntu without sudo

Being the most advanced open-source relational database, many of us need to install PostgreSQL for some purposes. However, sometimes you may not have sudo privilege on an Ubuntu server. Then, how should you install PostgreSQL in this case?

Compile from source!

Next, we will show a step-by-step guide on how to install PostgreSQL on Ubuntu by compiling it from source.

PostgreSQL Compilation & Installation

jenniferthompson

---
title: "Example Data Dictionary"
author: "Jennifer Thompson"
date: "11/1/2018"
output:
  html_document:
    theme: yeti
    code_folding: hide
---

n-s-k

Object-Oriented Programming in Fortran 2003 Part 2: Data Polymorphism

Original article by Mark Leair, PGI Compiler Engineer

Note: This article was revised in March 2015 and again in January 2016 to bring it up-to-date with the production software release and to correct errors in the examples.

This is Part 2 of a series of articles:

• Part 1: Code Reusability
• Part 2: Data Polymorphism

Luthaf

#include "Foo.hpp"
#include <iostream>
using namespace std;


Foo::Foo(int _a, int _b): a(_a), b(_b){
    cout << "C++ side, constructor" << endl;
}

Foo::~Foo(){