INDEX 747
trace, 279, 547
transition matrix, 77, 92, 98, 144, 190
doubly stochastic, 83, 88, 190
transmitter, 266, 294, 296, 299, 515,
517–519, 546, 573, 574, 588, 601,
611
Treasury bonds, 614
tree,
code, 107
Huffman, 124
random, 89
tree structured Lempel-Ziv, 441, 442
triangle inequality, 20, 369
triangular distribution, 662
trigram model, 171
Trofimov, V.K., 706
Trott, M., xxiii
Tseng, C.W., xxiii
Tsoucas, P., 700
Tsybakov, B.S., 716
Tunstall, B.P., 716
Tunstall coding, 460
turbo codes, 3, 205, 215
Turing, A., 465
Turing machine, xix, 465, 466
Tusn
´
ady, G., 332, 335, 346, 697
Tuttle, D.L., 182, 707
TV, 509, 560, 561
twin, 171
two envelope problem, 179
two level signalling, 262
two stage description, 496
two-way channel, 510, 519, 594, 602, 609
type, 342, 347, 348–350, 353–356, 358,
360, 361, 366, 367, 371, 373, 374,
378, 391, 408, 474, 490, 499, 570, 666
type class, 348–351, 353–356, 666
typewriter, 74, 192, 224, 235, 482
typical sequence, 11, 12, 57, 63, 245, 381,
522
typical set, 57, 59, 61, 62, 64, 68, 77, 196,
220, 227, 245, 247, 258, 319, 321,
356, 381, 382, 384, 524, 551
conditionally typical, 341
data compression, 60
distortion typical, 319
properties, 59, 64, 245
strongly typical, 326
volume, 245
Ullman, J.D., 704
uncertainty, 5, 6, 11, 13, 15, 20, 22, 24, 31,
53, 83, 89, 170, 517, 518, 593
Ungerboeck, G., 716
uniform distribution, 5, 30, 43, 83, 88, 148,
163, 190, 195, 202, 204, 209, 210,
228, 268, 338, 375, 408, 411, 412,
434, 436, 437, 553, 662, 663
uniform fair odds, 163, 166, 176, 626
uniquely decodable code, see code,
uniquely decodable
universal computer, 465, 501
universal data compression, 333, 457
universal gambling, 487, 488, 507
universal portfolios, 629–643, 651
finite horizon, 631
horizon free, 638
universal probability, 481, 487, 489–491,
502, 503, 507, 686
universal probability mass function, 481
universal source, 358
universal source code, 357, 360, 461
universal source coding, xv, 355, 427–462
error exponent, 400
universal Turing machine, 465, 480
Unix, 443
Urbanke, R., 702, 712
V.90, 273
V’yugin, V.V., 507, 718
Vajda, I., 716
Valiant, L.G., 717
Van Campenhout, J.M., 717
Van der Meulen, E., xxiii, 609–611, 699,
702, 717
Van Trees, H.L., 716
Vapnik, V.N., 717
variable-to-fixed length coding, 460
variance, xx, 36, 37, 64, 65, 255, 261, 265,
272, 292, 315, 325, 389, 393, 394,
396, 513, 516, 520, 544, 614, 655,
681, 685, see also covariance matrix
variational distance, 370
vector quantization, 303, 306
Venkata, R., xxi
Venkatesh, S.S., 707
Venn diagram, 23, 47, 50, 213
Verdu, S., 690, 698, 703, 704, 714, 717,
718