Introduction to Language Models (LLM's, Prompt Engineering, Encoder/Decoder and more)

Introduction to language models. Covers a set of topics to get you started including generative AI (decoders), LLMs (e.g., GPT), encoders (e.g., BERT), prompt engineering, fine tuning, self-supervised learning, transformer architecture, attention, and embeddings. 00:00 Introduction 01:58 Embeddings 05:02 Transformer architecture 12:01 Encoders (BERT) 19:47 Generative AI (decoders/LLM/GPT) 28:26 Basic Prompt Engineering 34:24 Advanced Prompt Engineering 48:32 LLM Limitations and Hallucinations About the channel: The Neuro Symbolic Channel provides the tutorials, courses, and research results on one of the most exciting areas in artificial intelligence and machine learning. With content originally from the AI course taught at Arizona State University, this channel brings you the latest at the intersection of symbolic methods (e.g., logic programming) and deep learning. Learn about the latest algorithms, Python packages, and progress toward larger goals such as artificial general intelligence (AGI).