Created
October 1, 2019 23:50
-
-
Save hsm207/143b6349ed1c92960be0dc1c6165d551 to your computer and use it in GitHub Desktop.
BERT_pretraining_share.ipynb
@mshivasharan what version of tensorflow are you using?
@hsm207 initially I was running with default tensorflow version in colab 2.x.x. Later I have changed to 1.11.
@mshivasharan do you know where the bert-vocab-builder folder come from?
ya, from gihub https://github.com/kwonmha/bert-vocab-builder
…On Wed, Dec 2, 2020 at 6:23 AM hsm207 ***@***.***> wrote:
***@***.**** commented on this gist.
------------------------------
@mshivasharan <https://github.com/mshivasharan> do you know where the
bert-vocab-builder folder come from?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<https://gist.github.com/143b6349ed1c92960be0dc1c6165d551#gistcomment-3546821>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AI64CXSIPBA2T5IAYAPW3XTSSWFZ5ANCNFSM4J2KRMPQ>
.
--
Best Regards,
Shivasharan Mudda.
I think it's best to raise an issue on that repo.
Yes, I have already raised an issue but haven't received any response yet.
…On Wed, Dec 2, 2020 at 8:25 PM hsm207 ***@***.***> wrote:
***@***.**** commented on this gist.
------------------------------
I think it's best to raise an issue on that repo.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<https://gist.github.com/143b6349ed1c92960be0dc1c6165d551#gistcomment-3547591>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AI64CXROIXSAXUVKII44BTTSSZINDANCNFSM4J2KRMPQ>
.
--
Best Regards,
Shivasharan Mudda.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I am getting an error while running vocab builder.
Issue 1: fixed replacing 'tf.flags' by ' tf.compat.v1.flags' (Version issue)
Traceback (most recent call last):
File "./bert-vocab-builder/subword_builder.py", line 37, in
tf.flags.DEFINE_string('output_filename', '/tmp/my.subword_text_encoder',
AttributeError: module 'tensorflow' has no attribute 'flags'
Issue 2:
The number of files to read : 1
Traceback (most recent call last):
File "./bert-vocab-builder/subword_builder.py", line 86, in
tf.app.run()
File "/usr/local/lib/python3.6/dist-packages/tensorflow/python/platform/app.py", line 125, in run
_sys.exit(main(argv))
File "./bert-vocab-builder/subword_builder.py", line 67, in main
split_on_newlines=FLAGS.split_on_newlines, additional_chars=FLAGS.additional_chars)
File "/content/bert-vocab-builder/tokenizer.py", line 191, in corpus_token_counts
split_on_newlines=split_on_newlines):
File "/content/bert-vocab-builder/tokenizer.py", line 139, in _read_filepattern
tf.logging.INFO("Start reading ", filename)
TypeError: 'int' object is not callable
Could any one help please me out on this issue? Thanks in advance