Skip to content

Instantly share code, notes, and snippets.

@jamesr66a

jamesr66a/standalone_tracing.patch

Last active March 24, 2022 03:29
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jamesr66a/d9debfe77f37b7dca4e0c57ecf6c32f3 to your computer and use it in GitHub Desktop.
Save jamesr66a/d9debfe77f37b7dca4e0c57ecf6c32f3 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
standalone_tracing.patch
diff --git a/test/t5_test.py b/test/t5_test.py
index e6b36b8..b72108f 100644
--- a/test/t5_test.py
+++ b/test/t5_test.py
@@ -34,4 +34,13 @@ t5_input = torch.zeros(bs, seq_length, dtype=torch.long).random_(t5.config.vocab
decoder_input_ids = torch.zeros(bs, seq_length, dtype=torch.long).random_(t5.config.vocab_size)
t5_output = t5(input_ids=t5_input, decoder_attention_mask=None, decoder_input_ids=decoder_input_ids)
-t5_pipe_output = t5_pipe(input_ids=t5_input, decoder_attention_mask=None, decoder_input_ids=decoder_input_ids)
+
+standalone_tracer = fx.HFTracer()
+graph = standalone_tracer.trace(t5, concrete_args=concrete_args)
+gm = torch.fx.GraphModule(t5, graph)
+gm_output = gm(input_ids=t5_input, decoder_attention_mask=None, decoder_input_ids=decoder_input_ids)
+"""
+AttributeError: 'NoneType' object has no attribute 'dtype'
+"""
+
+# t5_pipe_output = t5_pipe(input_ids=t5_input, decoder_attention_mask=None, decoder_input_ids=decoder_input_ids)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment