Skip to content

Instantly share code, notes, and snippets.

@zredlined
Created January 31, 2020 22:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save zredlined/353a6ae31239a193c1f5aa6d4ced4859 to your computer and use it in GitHub Desktop.
Save zredlined/353a6ae31239a193c1f5aa6d4ced4859 to your computer and use it in GitHub Desktop.
# training settings
max_chars: 0 # use a non-zero number to limit training data
epochs: 30 # number of training epochs (typically 15-30)
# RNN settings
batch_size: 64 # training batches
buffer_size: 10000 # maximum buffer size
seq_length: 100 # max length sentence for a single input in characters
embedding_dim: 256 # the embedding dimension
rnn_units: 256 #1024 # number of RNN units
dropout_rate: 0.2 # fraction of inputs to drop
rnn_initializer: glorot_uniform # set initial weightings of layers
# differential privacy settings
differential_privacy: true
learning_rate: 0.015
noise_multiplier: 1.1
l2_norm_clip: 1.0
microbatches: 256
# text generation settings
temperature: 1.0 # higher values generate more surprising texts.
chars_to_generate: 6000000 # characters to generate
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment