Skip to content

Instantly share code, notes, and snippets.

Embed
What would you like to do?
input_features:
-
name: Original_Title
type: text
level: word
encoder: t5
reduce_output: null
-
name: Keyword
type: text
level: word
tied_weights: Original_Title
encoder: t5
reduce_output: null
output_features:
-
name: Optimized_Title
type: sequence
level: word
decoder: generator
@mithila2806
Copy link

mithila2806 commented Dec 21, 2020

Hi @hamletbatista

Thank you very much for the prompt reply.

I did make changes in the code as per the thread you shared above and included the updated YAML file.

My Collab Notebook (If needed)
https://colab.research.google.com/drive/1aB-ABCXrv5bz85sZKtbLIQXryJQIhNfB?usp=sharing

image

image

Afraid to say I'm still stuck on the same step with below error:

`Epoch 1
Training: 0% 0/6 [00:00<?, ?it/s]Traceback (most recent call last):
File "/usr/local/bin/ludwig", line 8, in
sys.exit(main())
File "/usr/local/lib/python3.6/dist-packages/ludwig/cli.py", line 146, in main
CLI()
File "/usr/local/lib/python3.6/dist-packages/ludwig/cli.py", line 72, in init
getattr(self, args.command)()
File "/usr/local/lib/python3.6/dist-packages/ludwig/cli.py", line 77, in train
train.cli(sys.argv[2:])
File "/usr/local/lib/python3.6/dist-packages/ludwig/train.py", line 412, in cli
train_cli(**vars(args))
File "/usr/local/lib/python3.6/dist-packages/ludwig/train.py", line 197, in train_cli
debug=debug,
File "/usr/local/lib/python3.6/dist-packages/ludwig/api.py", line 469, in train
save_path=model_dir,
File "/usr/local/lib/python3.6/dist-packages/ludwig/models/trainer.py", line 552, in train
self.regularization_lambda
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 780, in call
result = self._call(*args, **kwds)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 823, in _call
self._initialize(args, kwds, add_initializers_to=initializers)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 697, in _initialize
*args, **kwds))
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 2855, in _get_concrete_function_internal_garbage_collected
graph_function, _, _ = self._maybe_define_function(args, kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 3213, in _maybe_define_function
graph_function = self._create_graph_function(args, kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 3075, in _create_graph_function
capture_by_value=self._capture_by_value),
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/func_graph.py", line 986, in func_graph_from_py_func
func_outputs = python_func(*func_args, **func_kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/def_function.py", line 600, in wrapped_fn
return weak_wrapped_fn().wrapped(*args, **kwds)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/eager/function.py", line 3735, in bound_method_wrapper
return wrapped_fn(*args, **kwargs)
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/framework/func_graph.py", line 973, in wrapper
raise e.ag_error_metadata.to_exception(e)
ValueError: in user code:

/usr/local/lib/python3.6/dist-packages/ludwig/models/ecd.py:176 train_step  *
    model_outputs = self((inputs, targets), training=True)
/usr/local/lib/python3.6/dist-packages/ludwig/models/ecd.py:101 call  *
    encoder_output = encoder(input_values, training=training,
/usr/local/lib/python3.6/dist-packages/ludwig/features/text_feature.py:242 call  *
    encoder_output = self.encoder_obj(
/usr/local/lib/python3.6/dist-packages/ludwig/encoders/text_encoders.py:640 call  *
    transformer_outputs = self.transformer(
/usr/local/lib/python3.6/dist-packages/transformers/models/t5/modeling_tf_t5.py:1095 call  *
    inputs = input_processing(
/usr/local/lib/python3.6/dist-packages/transformers/modeling_tf_utils.py:349 input_processing  *
    raise ValueError(

ValueError: The following keyword arguments are not supported by this model: ['token_type_ids'].

Training: 0% 0/6 [00:01<?, ?it/s]`

Do you have a copy of the code which I can run myself? If comfortable, could you share a copy of it please?
I'm very new to Python and ML models. So I might be missing the basic details.
Sorry to bother with long message.

Regards,
Mithila

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment