(IC 1.1) Information theory and Coding - Outline of topics
A playlist of these videos is available at: • Information Theory Overview of central topics in Information theory and Coding. Compression (source coding) theory: Source coding theorem, Kraft-McMillan inequality, Rate-distortion theorem Error-correction (channel coding) theory: Channel coding theorem, Channel capacity, Typicality and the AEP Compression algorithms: Huffman codes, Arithmetic coding, Lempel-Ziv Error-correction algorithms: Hamming codes, Reed-Solomon codes, Turbo codes, Gallager (LDPC) codes
▶︎
(IC 1.2) Applications of Compression codes
▶︎
Uses of Information Theory - Computerphile
▶︎
Information Theory Basics
▶︎
Huffman Codes: An Information Theory Perspective
▶︎
Introduction to Information Theory - Edward Witten
▶︎
Maxwell's Demon - Why Information is Entropy
▶︎
Stanford Seminar - Information Theory of Deep Learning, Naftali Tishby
▶︎
Why Information Theory is Important - Computerphile
▶︎
Entropy in Compression - Computerphile
▶︎
Lecture 1: Introduction to Information Theory
▶︎
1. Overview: information and entropy
▶︎
How To Think SO CLEARLY People Assume You're A Genius
▶︎
Intro to Information Theory | Digital Communication | Information Technology
▶︎
The Most Important (and Surprising) Result from Information Theory
▶︎
Train Your Brain to Never Forget (5 Feynman Habits)
▶︎
Claude Shannon - Father of the Information Age
▶︎
Data Compression (Summer 2023) - Lecture 14 - Arithmetic Coding
▶︎
What is information theory? | Journey into information theory | Computer Science | Khan Academy
▶︎