https://blog.bj-yan.top/en/tags/information-theory/ Recent content in Information-Theory on Bingjie's Blog https://blog.bj-yan.top/favicon.png https://blog.bj-yan.top/favicon.png Hugo -- gohugo.io en-US Fri, 28 Jul 2023 14:55:49 +0800 https://blog.bj-yan.top/en/p/blog-information-theory-for-privacy/ Fri, 28 Jul 2023 14:55:49 +0800 https://blog.bj-yan.top/en/p/blog-information-theory-for-privacy/ Starting from the attacker's observations and auxiliary information, this article introduces entropy, conditional mutual information, the data processing inequality, and Fano's inequality. It also uses randomized response to illustrate the connections and distinctions between information-theoretic privacy and differential privacy.