TY - GEN
T1 - Convexity and Operational Interpretation of the Quantum Information Bottleneck Function
AU - Datta, Nilanjana
AU - Hirche, Christoph
AU - Winter, Andreas
PY - 2019/7
Y1 - 2019/7
N2 - In classical information theory, the information bottleneck method (IBM) can be regarded as a method of lossy data compression which focuses on preserving meaningful (or relevant) information. As such it has of late gained a lot of attention, primarily for its applications in machine learning and neural networks. A quantum analogue of the IBM has recently been defined, and an attempt at providing an operational interpretation of the so-called quantum IB function as an optimal rate of an information-theoretic task, has recently been made by Salek et al. The interpretation given by these authors, however, rests on their conjecture that the quantum IB function is convex. Our first contribution is the proof of this conjecture.Secondly, the expression for the rate function involves certain entropic quantities which occur explicitly in the very definition of the underlying information-theoretic task, thus making the latter somewhat contrived. We overcome this drawback by pointing out an alternative operational interpretation of it as the optimal rate of a bona fide information-theoretic task, namely that of quantum source coding with quantum side information at the decoder, which has recently been solved by Hsieh and Watanabe. We show that the quantum IB function characterizes the rate region of this task.We similarly show that the related privacy funnel function is concave (both in the classical and quantum case). However, we comment that it is unlikely that the quantum privacy funnel function can characterize the optimal asymptotic rate of an information theoretic task, since even its classical version lacks a certain essential additivity property.
AB - In classical information theory, the information bottleneck method (IBM) can be regarded as a method of lossy data compression which focuses on preserving meaningful (or relevant) information. As such it has of late gained a lot of attention, primarily for its applications in machine learning and neural networks. A quantum analogue of the IBM has recently been defined, and an attempt at providing an operational interpretation of the so-called quantum IB function as an optimal rate of an information-theoretic task, has recently been made by Salek et al. The interpretation given by these authors, however, rests on their conjecture that the quantum IB function is convex. Our first contribution is the proof of this conjecture.Secondly, the expression for the rate function involves certain entropic quantities which occur explicitly in the very definition of the underlying information-theoretic task, thus making the latter somewhat contrived. We overcome this drawback by pointing out an alternative operational interpretation of it as the optimal rate of a bona fide information-theoretic task, namely that of quantum source coding with quantum side information at the decoder, which has recently been solved by Hsieh and Watanabe. We show that the quantum IB function characterizes the rate region of this task.We similarly show that the related privacy funnel function is concave (both in the classical and quantum case). However, we comment that it is unlikely that the quantum privacy funnel function can characterize the optimal asymptotic rate of an information theoretic task, since even its classical version lacks a certain essential additivity property.
UR - https://www.scopus.com/pages/publications/85073165836
U2 - 10.1109/ISIT.2019.8849518
DO - 10.1109/ISIT.2019.8849518
M3 - Conference contribution
AN - SCOPUS:85073165836
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 1157
EP - 1161
BT - 2019 IEEE International Symposium on Information Theory, ISIT 2019 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE International Symposium on Information Theory, ISIT 2019
Y2 - 7 July 2019 through 12 July 2019
ER -