A derivation of the basic statistic of information theory.
derivationofbasi00kola.pdf (1.315Mb)Abstract
Information Theory is applicable to a number of fields. The basic statistic of Information Theory, - Σp(i) log p(i), is derived for the discrete case using Bayes's rule for the probability of causes. Various properties of this function are derived and discussed.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Collections
Related items
Showing items related by title, author, creator and subject.
-
Attitude Dynamics/Control of Dual-Body Spacecraft with Variable-Speed Control Moment Gyros
(2004);The dynamics equations of a spacecraft consisting of two bodies mutually rotating around a common gimbal axis are derived by the use of the Newton–Euler approach. One of the bodies contains a cluster of single-gimbal var ... -
Times series models with a specified symmetric non-normal marginal distribution
(1985);Time series models with autoregressive , moving average and mixed autoregressive-moving average correlation structure and with symmetric, heavy-tailed, non-normal marginal distributions, called Jl -Laplace, are consid ... -
A CONCEPTUAL ARCHITECTURE TO ENABLE INTEGRATED COMBAT SYSTEM ADAPTIVE OPERATIONAL READINESS ASSESSMENTS
(Monterey, CA; Naval Postgraduate School, 2019-09);Delivering on the power of data to ships in austere or contested environments requires careful consideration of system capacity, bandwidth, and processes to drive capability. Ship-based and shore-based applications and ...
