https://warm-uk.tistory.com/12

Torch의 Embedding Layer

1. Discrete Representation : Local Representation

값 그 자체를 표현, 정수로 표현된 이산표현

1) One - hot Vector

- One - hot Vector

2) Count Based

• Bag of Words (BoW)

• Document-Term Matrix (DTM)

• Term Frequency-Inverse Document Frequency (TF - IDF)

• N-gram Language Model (N-gram)

2. Continuous Representation

관계, 속성의미를 내포하여 표현, 실수로 표현된 연속표현

1) Prediction Based (Distributed Representation)

• Neural Network Language Model (NNLM) or Neural Probabilistic Language Model (NPLM)

• Word2Vec

• FastText