Skip to content

Instantly share code, notes, and snippets.

@charlieoneill11

charlieoneill11/map_2.py

Created May 1, 2022 05:56
Show Gist options
  • Save charlieoneill11/23f2e97930b399a5faf5402af0f546cc to your computer and use it in GitHub Desktop.
Save charlieoneill11/23f2e97930b399a5faf5402af0f546cc to your computer and use it in GitHub Desktop.
Download ZIP
Raw
map_2.py
offensive_encoded = offensive.map(tokenize, batched=True, batch_size=None)
print(offensive_encoded["train"].column_names)
> ['text', 'label', 'input_ids', 'attention_mask']
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment