Korean_NLP_study_matarials.txt

0. PyTorch Tutorial
  ☆ - https://github.com/yunjey/pytorch-tutorial
  - https://github.com/yoongi0428/dmlab_torch_tutorial
  
1. Word Embedding
  1) 관련 논문
    - Word2Vec: https://www.aclweb.org/anthology/N13-1090.pdf
    ☆ - Skip-gram: https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf
  2) 블로그
    ☆ - Jay Alammar "The Illustrated Word2Vec": http://jalammar.github.io/illustrated-word2vec/
    - ratsgo's Blog "Word2Vec 학습 방식": https://ratsgo.github.io/from%20frequency%20to%20semantics/2017/03/30/word2vec/
    - Beomsu Kim "Word2Vec 관련 이론 정리": https://shuuki4.wordpress.com/2016/01/27/word2vec-%EA%B4%80%EB%A0%A8-%EC%9D%B4%EB%A1%A0-%EC%A0%95%EB%A6%AC/
    - 윤기 "1.Word Vectorization" (참고만 하고 넘ㄱ..): https://yoongi0428.github.io/nlp%20story/2018/12/10/story2_1_word_vectirization.html

2. Basic NLP w/ RNN
  1) 관련 논문
    ☆ - Seq2Seq: https://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf    
  
  2) 블로그
    
  3) 코드 및 자료
    - 네이버 영화 평 분류 데이터: https://github.com/e9t/nsmc
    - 네이버 첼린지 코드: https://github.com/yoongi0428/Kor-Sentence-Classification
    - Sentiment analysis w/ PyTorch: https://github.com/lukysummer/Movie-Review-Sentiment-Analysis-LSTM-Pytorch

3. Attention
  1) 관련 논문
    ☆ - Luong Attention: https://arxiv.org/pdf/1508.04025.pdf
    ☆ - Bahdanau Attention: https://arxiv.org/pdf/1409.0473.pdf
    ☆ - Self Attention: https://arxiv.org/pdf/1706.03762.pdf
    
  2) 블로그
     ☆ - Seq2Seq w/ Attention: http://jalammar.github.io/visualizing-neural-machine-translation-mechanics-of-seq2seq-models-with-attention/
     ☆ - Transformer (Self-attention): http://jalammar.github.io/illustrated-transformer/
     
4. BERT
  1) 관련 논문
    ☆ - BERT: https://arxiv.org/pdf/1810.04805.pdf
  2) 블로그
    ☆ - Annotated BERT: https://nlp.seas.harvard.edu/2018/04/03/attention.html
    ☆ - The Illustrated BERT: http://jalammar.github.io/illustrated-bert/    
  3) 코드
    ☆ - Hugging face BERT and friends: https://github.com/huggingface/transformers