If you're seeing this message, it means we're having trouble loading external resources for Khan Academy.

If you're behind a web filter, please make sure that the domains *.kastatic.org and *.kasandbox.org are unblocked.

Modern Information Theory

3 programs
9 videos
Information Theory in the 20th Century

Symbol rate

Introduction to Symbol Rate (Baud)

Introduction to channel capacity

Introduction to Channel Capacity & Message Space

Measuring information

How can we quantify/measure an information source?

Origin of Markov chains

Introduction to Markov chains

A mathematical theory of communication

Claude Shannon demonstrated how to generate "english looking" text using Markov chains.

Markov text exploration

Generate text using markov chains

Information entropy

Finally we arrive at our quantitative measure of entropy

Compression codes

What is the limit of compression?

Error correction

How can we communicate in the presence of noise?

The search for extraterrestrial intelligence

Can information theory help us talk to aliens?