Skip to content

Instantly share code, notes, and snippets.

View SivilTaram's full-sized avatar
🐕
Working on something

Qian SivilTaram

🐕
Working on something
View GitHub Profile
@SivilTaram
SivilTaram / minimal_transformer.py
Created January 5, 2022 03:24
Minimal Transformer Demo
import torch
import torch.nn as nn
import torch.nn.functional as F
import math
class Config:
embed_drop = 0.1
residual_drop = 0.1
attn_drop = 0.1
@SivilTaram
SivilTaram / ner-openai.jsonnet
Created December 2, 2019 04:56 — forked from joelgrus/ner-openai.jsonnet
config file for using the openai token embedder in allennlp
{
"dataset_reader": {
"type": "conll2003",
"token_indexers": {
"tokens": {
"type": "single_id",
"lowercase_tokens": true
},
"token_characters": {
"type": "characters"
@SivilTaram
SivilTaram / ner-openai.jsonnet
Created December 2, 2019 04:55 — forked from joelgrus/ner-openai.jsonnet
config file for using the openai token embedder in allennlp
{
"dataset_reader": {
"type": "conll2003",
"token_indexers": {
"tokens": {
"type": "single_id",
"lowercase_tokens": true
},
"token_characters": {
"type": "characters"
@SivilTaram
SivilTaram / 1-1000.txt
Created August 14, 2016 01:30 — forked from deekayen/1-1000.txt
1,000 most common US English words
the
of
to
and
a
in
is
it
you
that