Skip to content

Instantly share code, notes, and snippets.

@hunan-rostomyan

hunan-rostomyan/config.json

Last active May 24, 2019 22:08
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save hunan-rostomyan/72560dce7708aa9d19ebd633d656e163 to your computer and use it in GitHub Desktop.
Save hunan-rostomyan/72560dce7708aa9d19ebd633d656e163 to your computer and use it in GitHub Desktop.
Download ZIP
GPT-2 345M Config
Raw
config.json
{
"initializer_range": 0.02,
"layer_norm_epsilon": 1e-05,
"n_ctx": 1024,
"n_embd": 1024,
"n_head": 16,
"n_layer": 24,
"n_positions": 1024,
"vocab_size": 50257
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment