Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save ahmadnazeeh/570bda097dff845bd524d9ad0085551d to your computer and use it in GitHub Desktop.
Save ahmadnazeeh/570bda097dff845bd524d9ad0085551d to your computer and use it in GitHub Desktop.
Transformer data set problem
In the code for "Transformer model for language understanding" , I need to use this code for my own data set. I don't want to install it cause I already have it.
in the following code, the data set is downloaded from Ted Talk. I want to use my own data set instade. How can I use the code to use my own data set instade of this downloaded one?
examples, metadata = tfds.load('ted_hrlr_translate/pt_to_en', with_info=True,
as_supervised=True)
train_examples, val_examples = examples['train'], examples['validation']
The code is in the following URL: https://www.tensorflow.org/tutorials/text/transformer
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment