If you're seeing this message, it means we're having trouble loading external resources for Khan Academy.
If you're behind a web filter, please make sure that the domains *.kastatic.org and *.kasandbox.org are unblocked.
Modern Information Theory
Information Theory in the 20th Century
Introduction to Symbol Rate (Baud)
Introduction to Channel Capacity & Message Space
How can we quantify/measure an information source?
Introduction to Markov chains
Claude Shannon demonstrated how to generate "english looking" text using Markov chains.
Generate text using markov chains
Finally we arrive at our quantitative measure of entropy
What is the limit of compression?
How can we communicate in the presence of noise?
Can information theory help us talk to aliens?