Skip to content

Instantly share code, notes, and snippets.

Shawn Presser shawwn

Block or report user

Report or block shawwn

Hide content and notifications from this user.

Learn more about blocking users

Contact Support about this user’s behavior.

Learn more about reporting abuse

Report abuse
View GitHub Profile
View gist:66eb85452fef4e508baea56f5c01614a
attach_debugger <function attach_debugger at 0x7fc84ecde950>
print_status <function print_status at 0x7fc84ecde9d8>
freeze_forever <function freeze_forever at 0x7fc84ecdeb70>
quit <function quit at 0x7fc84ecdebf8>
save_and_quit <function save_and_quit at 0x7fc84ecded08>
Using TPU grpc://10.28.1.2:8470
Prompt: 'The'
======================================== SAMPLE 1 ========================================
The teeth of who? Who the Vine-bender?
The nimble smell of the wind
View gpt_2_tensorflow_2.0.py.diff
diff --git a/requirements.txt b/requirements.txt
index 0d2556c..a573910 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -5,3 +5,4 @@ tqdm==4.31.1
toposort==1.5
tensor2tensor>=1.14.1
h5py
+tensorflow_addons>=0.6.0
diff --git a/src/generate_unconditional_samples.py b/src/generate_unconditional_samples.py
View goddamn_tensorflow_2.0.py.diff
diff --git a/requirements.txt b/requirements.txt
index 0d2556c..a573910 100644
--- a/requirements.txt
+++ b/requirements.txt
@@ -5,3 +5,4 @@ tqdm==4.31.1
toposort==1.5
tensor2tensor>=1.14.1
h5py
+tensorflow_addons>=0.6.0
diff --git a/src/generate_unconditional_samples.py b/src/generate_unconditional_samples.py
View gist:7df480bb4149b881f5c753aa261df709
'3|"' 2228
'G' 50108
'"' 50144
'Bddd' 3335
'2' 50106
'e' 50112
'|"' 139
'D' 50118
'"' 50144
'faa' 1167
View gist:43bf9024b62647bea0e47f10637a145a
[^\?\!a-zA-Z0-9", \.:|><'—-’&-\[\]…“”
–èíé$áàç#ñóú½äöåü<200b> â­%łāïū•_ê¢~`{}æûëÉ]
View gist:0336867dea1fc6676d2335d7d39089c1
>>> lr = tf.maximum(1e-5, tflex_sgdr.sgdr_decay(1.5e-4, global_step, initial_period_steps=100, t_mul=1.0, m_mul=1.0))
>>>
>>> for i, x in [(i, do_lr(i)) for i in range(1000)]: print('%d, %0.9f' % (i, x))
...
0, 0.000150000
1, 0.000149963
2, 0.000149852
3, 0.000149667
4, 0.000149409
5, 0.000149077
View abc.txt
% (0001 / 29600) http://abcnotation.com/tunePage?a=trillian.mit.edu/~jc/music/book/HillCountryTunes/proto/0000
X: 00
T: 00. __
B: Sam Bayard, "Hill Country Tunes" 1944 #00
N: Played by __
R: __
M: _/_
L: 1/_
Z: 2010 John Chambers <jc:trillian.mit.edu>
View gist:5de4b1970258375dcad151d410edd65a
X:1011800026
T:Romance 26
M:3/4
L:1/8
K:Amaj
V:1
|:ef/g/|aecf/e/d/c/B/A/|f2a2e2|f/g/a/f/e/c/A/B/c/e/|cBBcef/g/|
aecf/e/d/c/B/A/|f2a2ec/A/|c2B2c/B/A/G/|F4ef/g/|
aecf/e/d/c/B/A/|f2a2e2|f/g/a/f/e/c/A/B/c/e/|cBBcBc/B/|
AECA,CE|F2A2B2|c2B2A/G/F/E/|F4|]
You can’t perform that action at this time.