# WUSTL ESE 523 - ee553ex105 (7 pages)

Previewing pages*1, 2*of 7 page document

**View the full content.**## ee553ex105

Previewing pages *1, 2*
of
actual document.

**View the full content.**View Full Document

## ee553ex105

0 0 45 views

- Pages:
- 7
- School:
- Washington University in St. Louis
- Course:
- Ese 523 - Information Theory

**Unformatted text preview: **

ESE 523 Exam 1 EDITED Professor Joseph A O Sullivan October 26 2005 This is a closed book closed notes exam It is scheduled to last for 1 5 hours All students must do their own work and are bound by the SEAS honor code If you do not undertand a question clearly state the assumptions used in trying to nd a solution NAME Problem Score 1 2 3 4 5 6 Total 1 1 15 points Let X1 X2 Xn be arbitrary discrete random variables with known joint probability distribution p x1 x2 xn In this question you will explore the information value of additional measurements a Future measurements Let h1 k H X1 X2 X3 Xk that is the entropy of X1 given measurements up to time k Show that h1 k h1 k 1 Denote the gain in information from the next measurement by i1 k 1 that is i1 k 1 h1 k h1 k 1 b Past measurements Let hn n k H Xn Xn 1 Xn 2 Xn k that is the entropy of Xn given measurements in the past to time n k Show that hn n k hn n k 1 Denote the gain in information from the next measurement by in n k 1 that is in n k 1 hn n k hn n k 1 c Show that i1 n in 1 That is the information about the past equals the information about the future 2 2 20 points A code designer claims to have designed a binary code for an alphabet of size fourteen with codelengths 2 3 4 4 5 5 5 6 6 6 6 6 6 6 a Can these codeword lengths correspond to a pre x code Justify your answer b Can these codeword lengths be the result of a Hu man encoding scheme Justify your answer c Suppose that a source has fourteen symbols that are equally likely What are the optimal binary codelengths d For the source with equally likely symbols what is the cost in average number of bits per symbol of using the code provided by the designer relative to the optimal code 3 3 15 points Suppose that there are eight horses in a set of i i d horse races The odds oi i 1 2 8 are 4 8 8 8 16 16 16 16 respectively Suppose that all horses are equally likely to win a Assuming that all money must be bet every iteration what is the optimum doubling rate b Suppose

View Full Document