Summary:
- Input and output to numbers – Word Embedding
- Token; Activation Functions; Weight
- Word Embedding, Word2Vec
- Words Order
- Positional Encoding
- Word Embedding: Word to numbers
- Number that word order correspond to the word
- Unique sequence of position value for each word
- Cat eat dogs; dogs eat cat; keep track of word ordereing
- Self Attention: Associate words between each other.
- Similarities for each word in the sentence