11.

- , . . . , , 0, 1.

X

p

code(X)

9/16

0

β

3/16

10

3/16

110

1/16

111,

. , . . .

<()

X

p

A

0.4

B

0.2

C

0.4

11 ML(X) = MLl(X) = 1.6 /, 10, HX = log2 5 - 0.8 1.523 /.

(Huffman) 1952 . -, , . () . . . . ; , . , , . , ; , . , , 0 1. . . . , , .

- . , 2 , 10 , 0 ..

. . . .

X

00

01

10

11

9/

/16

/16

3/

/16

1/16

 

0 \

0\

0\ /1

7

16

/1

4

16

 

1

 

 

 

<1()

0

10

110

111

1 (X) = ()/2 = 27/32 = 0.84375 /.

X

0.4

0.2

0.4

 

 

0 \

/1

 

 

 

0.6

 

0\

/1

 

 

 

1

 

<1()

0

10

11

1 (X) = () = 1.6 /.

► 18

1 (X) X. 2 . . . . X .

► 19

HX ) - X.

. . . X :

X

1 2 3 4 5

7/18 1/6 1/6 1/6 1/9