機械が「意味」を持つとはどういうことか －Embedding－

AI transforms simple numbers (tokens) into "semantic coordinates (vectors)." Similar meanings gather in similar locations, and semantic relationships can be calculated using addition and subtraction. This map—embedding—is explained using real word vectors. The AI ​​mechanism is explained with familiar examples and diagrams. From intuition to mechanism, formulas, and implementation, each video gently delves into one topic. 📖 Timestamps 0:00 Opening — The Mystery of "Sweet" 1:09 Intuition: Meaning Can Be Represented by "Location" 2:27 Concrete Example: Real Word Vectors and Meaning Calculation 4:17 Mechanism: Embedding Matrix and Distribution Hypothesis, the Limit of 1 Word = 1 Point 6:21 Summary and Next Episode Preview ▶ Next Episode: What is AI Looking at Now to Respond? – Attention – 🔔 Subscribe to the channel so you don't miss the next episode → https://www.youtube.com/@zunda-tsumug... ── Cast ── 🟢 Zundamon: The Explainer. Likes to understand things in terms of structure. 🌶️ Kasukabe Tsumugi: The Listener. This video addresses all of the viewers' common questions. 【For those who:】 ・Use ChatGPT or Claude but don't know the inner workings ・Want to understand the mechanism rather than just the superficial usage 【Primary sources referenced】 Mikolov, Chen, Corrado, Dean 2013 "Efficient Estimation of Word Representations in Vector Space" (word2vec) https://arxiv.org/abs/1301.3781 Mikolov, Yih, Zweig 2013 "Linguistic Regularities in Continuous Space Word Representations" (king-man+woman analogy) https://aclanthology.org/N13-1090/ Pennington, Socher, Manning 2014 "GloVe: Global Vectors for Word Representation" https://aclanthology.org/D14-1162/ Peters et al. 2018 "Deep contextualized word "Representations" (ELMo) https://aclanthology.org/N18-1202/ Devlin, Chang, Lee, Toutanova 2018 "BERT" https://arxiv.org/abs/1810.04805 【BGM/SE】 BGM: Amacha Music Studio https://amachamusic.chagasi.com/ Sound Effect Lab https://soundeffect-lab.info/ 【Voice】 VOICEVOX: Zundamon, Kasukabe Tsumugi https://voicevox.hiroshiba.jp/ #AIexplanation #LLM #ChatGPT #LargeScaleLanguageModel #Zundamon