Skip to content

Instantly share code, notes, and snippets.

View Krilecy's full-sized avatar

Kris Laumann Krilecy

  • Berlin
View GitHub Profile
@Krilecy
Krilecy / XLNet_seq_class_example.py
Last active April 5, 2021 21:58
Hugging Face Sequence Classification Example with XLNet
from transformers import AutoTokenizer, AutoModelForSequenceClassification, XLNetTokenizer
import torch
tokenizer = XLNetTokenizer.from_pretrained("ynie/xlnet-large-cased-snli_mnli_fever_anli_R1_R2_R3-nli")
model = AutoModelForSequenceClassification.from_pretrained("ynie/xlnet-large-cased-snli_mnli_fever_anli_R1_R2_R3-nli")
classes = ["not paraphrase", "is paraphrase"]
sequence_0 = "The company HuggingFace is based in New York City"
sequence_1 = "Apples are especially bad for your health"
@Krilecy
Krilecy / Synthetic Data Generation.ipynb
Last active May 7, 2024 19:20
Synthetic Data Generation for Embedding Model Fine-Tuning
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.