Wow! eBook
Information-Theoretic Methods in Deep Learning: Theory and Applications
by: Shuangming Yang (Editor), Shujian Shujian Yu (Editor), Luis Gonzalo Sánchez Giraldo (Editor)
Publisher: Mdpi AG
Publication Date: 2025-01-16
Language: English
Print Length: 244 pages
ISBN-10: 3725829829
ISBN-13: 9783725829828
Book Description
The rapid development of deep learning has led to groundbreaking advancements across various fields, from computer vision to natural language processing and beyond. Information theory, as a mathematical foundation for understanding data representation, learning, and communication, has emerged as a powerful tool in advancing deep learning methods. This Special Issue, “Information-Theoretic Methods in Deep Learning: Theory and Applications”, presents cutting-edge research that bridges the gap between information theory and deep learning. It covers theoretical developments, innovative methodologies, and practical applications, offering new insights into the optimization, generalization, and interpretability of deep learning models. The collection includes contributions on: Theoretical frameworks combining information theory with deep learning architectures; Entropy-based and information bottleneck methods for model compression and generalization; Mutual information estimation for feature selection and representation learning; Applications of information-theoretic principles in natural language processing, computer vision, and neural network optimization.
Editorial Reviews
The rapid development of deep learning has led to groundbreaking advancements across various fields, from computer vision to natural language processing and beyond. Information theory, as a mathematical foundation for understanding data representation, learning, and communication, has emerged as a powerful tool in advancing deep learning methods. This Special Issue, “Information-Theoretic Methods in Deep Learning: Theory and Applications”, presents cutting-edge research that bridges the gap between information theory and deep learning. It covers theoretical developments, innovative methodologies, and practical applications, offering new insights into the optimization, generalization, and interpretability of deep learning models. The collection includes contributions on: Theoretical frameworks combining information theory with deep learning architectures; Entropy-based and information bottleneck methods for model compression and generalization; Mutual information estimation for feature selection and representation learning; Applications of information-theoretic principles in natural language processing, computer vision, and neural network optimization.
