Some New Results on Information Properties of Mixture Distributions

Abstract

This paper deals with information properties of mixture models in terms of the single distributions in finite model. We provide an expression for the entropy of mixture models. Also, we derive bounds as well as an approximation to approximate the behavior of entropy of mixture distributions.
 Moreover, some new results on the entropy of mixture distributions in terms of ordering properties of single distributions are provided. Examples are given to illustrate the results.