- Asymptotic Equipartition Property (AEP) is given by
*X*is the DMS with statistically independent symbols*x*fed into a symbol register_{i}*x*= (^{n}*x*_{0},*x*_{1}, …,*x*_{n-1}) - Practical consequence of AEP is that it makes lossless data compression possible (data compaction).
- In general
- If
*X*is an Ergodic source, then - Ergodic source are source whose
- Probabilities don't change with time, i.e., stationary.
- For any and all of its statistics,

Time average = Ensemble average

- In the communication system

The typical set⊂^{n}A_{ε}such that^{n}X_{C} - The set
is typical enough that^{n}A_{ε}*n*. - The size of a typical set is given by
| is the cardinality of^{n}A_{ε}.^{n}A_{ε} - The number of data–bits (
*l*) required to form a typical set is*l*∕*n*is the number of .

♻

After this lecture you may take a mini EXAM

♻