Wiley series in telecommunications. John Wiley & Sons, Inc., 1991.
– 563 pages.
This is intended to be a simple and accessible book on information
theory. As Einstein said, ’’Everything should be made as simple as
possible, but no simpler.’’ This point of view drives our
development throughout the book. We were drawn to the field of
information theory from backgrounds in communication theory,
probability theory and statistics, because of the apparent
impossibility of capturing the intangible concept of information.
Throughout the book we use the method of weakly typical sequences,
which has its origins in Shannon’s original 1948 work but was
formally developed in the early 1970s. The key idea here is the
so-called asymptotic equipartition property, which can be roughly
paraphrased as ''Almost everything is almost equally
probable.''
This book has arisen from over ten years of lectures in a
two-quarter sequence of a senior and first-year graduate level
course in information theory, and is intended as an introduction to
information theory for students of communication theory, computer
science and statistics.
Cover T.M., Thomas J.A. Elements of Information Theory
Смотрите также
Chaitin G.J. The Limits of Mathematics
Springer, 1997. - 147 pages. This book is the final version of a course on algorithmic information theory and the epistemology of mathematics and physics. It discusses Einstein and Goedel's views on the nature of mathematics in the light of information theory, and sustains the thesis that mathematics is quasi-empirical. There is a foreword by Cris Calude of the University of Auckland, and supplementary material is available at the author's web s...
Cover Thomas. Elements of Information Theory
Cover, Thomas. Elements of Information Theory. 2006, 2ed Книга выложена в двух вариантах: в виде .pdf и .djvu файлов. Отзывы читателей amazon.com/ Review "As expected, the quality of exposition continues to be a high point of the book. Clear explanations, nice graphical illustrations, and illuminating mathematical derivations make the book particularly useful as a textbook on information theory. " (Journal of the American Statistical Association...
Desurvire E. Classical and Quantum Information Theory: An Introduction for the Telecom Scientist
Cаmbridge Univеrsity Prеss, 2009, 691 pages Information theory lies at the heart of modern technology, underpinning all communications, networking, and data storage systems. This book sets out, for the first time, a complete overview of both classical and quantum information theory. Throughout, the reader is introduced to key results without becoming lost in mathematical details. Opening chapters present the basic concepts and various applicati...
Gray R.M. Entropy and Information Theory
2nd Edition Springer, 2011. 409 p. ISBN:1441979697 This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New in this edition: Expanded treatment of stationary or sliding-block codes and their relations to...
Hamming R.W. Coding and Information Theory
Prentice Hall, 1986. - 272 pages. Preface to the First Edition: This book combines the fields of coding and information theory in a natural way. They are both theories about the representation of abstract symbols. The two fields are now each so vast that only the elements can be presented in a short book. Information theory is usually thought of as "sending information from here to there" (transmission of information), but this is exactly the...
Hirsch M.J., Pardalos P.M., Murphey R. Dynamics of Information Systems: Theory and Applications
Sрringer, 2010. - 371 p. "Dynamics of Information Systems" presents state-of-the-art research explaining the importance of information in the evolution of a distributed or networked system. This book presents techniques for measuring the value or significance of information within the context of a system. Each chapter reveals a unique topic or perspective from experts in this exciting area of research. These newly developed techniques have numer...
Kullback S. Information Theory and Statistics
Peter Smith, 1978. - 399 pages. Highly useful text studies the logarithmic measures of information and their application to testing statistical hypotheses. Topics include introduction and definition of measures of information, their relationship to Fisher’s information measure and sufficiency, fundamental inequalities of information theory, much more. Numerous worked examples and problems.
Neubauer A., Freudenberger J., Kuhn V. Coding theory: algorithms, architectures and applications
The present book provides a concise overview of channel coding theory and practice as well as the accompanying algorithms, architectures and applications. The selection of the topics presented in this book is oriented towards those subjects that are relevant for information and communication systems in use today or in the near future. The focus is on those aspects of coding theory that are important for the understanding of these systems. This bo...
Pierce J.R. An Introduction to Information Theory
Dover Publications, 1980. - 320 pages. Covers encoding and binary digits, entropy, language and meaning, efficient encoding and the noisy channel, and explores ways in which information theory relates to physics, cybernetics, psychology and art.
Thomas M. Cover, Joy A. Thomas. Elements of information theory
2nd ed. John Wiley & Sons, Inc. This book has arisen from over ten years of lectures in a two-quarter sequence of a senior and first-year graduate-level course in information theory, and is intended as an introduction to information theory for students of communication theory, computer science, and statistics. The first quarter might cover Chapters 1 to 9, which includes the asymptotic equipartition property, data compression, and channel...