Authors
Saeid Haghighatshoar, Emmanuel Abbe, Emre Telatar
Publication date
2012/7/1
Conference
2012 IEEE International Symposium on Information Theory Proceedings
Pages
1842-1846
Publisher
Ieee
Description
This paper investigates the construction of deterministic measurement matrices preserving the entropy of a random vector with a given probability distribution. In particular, it is shown that for a random vector with i.i.d. discrete components, this is achieved by selecting a subset of rows of a Hadamard matrix such that (i) the selection is deterministic (ii) the fraction of selected rows is vanishing. In contrast, it is shown that for a random vector with i.i.d. continuous components, no entropy preserving measurement matrix allows dimensionality reduction. These results are in agreement with the results of Wu-Verdu on almost lossless analog compression and provide a low-complexity measurement matrix. The proof technique is based on a polar code martingale argument and on a new entropy power inequality for integer-valued random variables.
Scholar articles
S Haghighatshoar, E Abbe, E Telatar - 2012 IEEE International Symposium on Information …, 2012