
tokenize
- Dividing a sequence (text, f0 audio divided into frames, etc.) into tokens, quantifying them, and mapping them through indexing
embedding
- Arranging tokens based on their semantic associations
- Whether passing through an nn.Embedding layer or an already-created embedding model such as word2vec, as long as the first concept is shared, performing the act of embedding in any manner counts as embedding
