信息论与编码

定　　价：69.9 元

• 作者：李敏
• 出版时间：2025/7/1
• ISBN：9787121511240
• 出 版 社：电子工业出版社

• 中图法分类：TN911.2 
• 页码：264
• 版次：01
• 开本：16开

内容简介

本书系统阐述信息论的基本原理、编码方法及工程实践，并融入前沿发展动态，共四篇14章。本书注重知识体系的系统性和实践性，在理论推导中强调物理意义的阐释，体现信息传输追求的有效性、可靠性和安全性，在编码方法中着重介绍典型算法的实现，并通过工程案例解析，帮助读者建立从数学理论到技术落地的完整认知。本书可作为高等学校电子信息类专业的本科生、研究生教材，也可供信息科学及系统工程领域有关人员参考。

作者介绍

李敏，火箭军工程大学教授，博士生导师，任国家科技部专家，军事科技奖励评审委员，全军信息安全专业教指委委员，陕西省图像图形学会常务理事，某体系建设专家，大学教育教学委员会成员，学院教学委员会成员、教学督导组成员。现为校级重点建设教学科研团队负责人，计算机科学与技术一级学科计算机视觉与智能信息系统方向负责人。

目 录

第一篇 理论基础篇
第 1 章 绪论··································································································································.2
1.1 信息的内涵及相关概念···································································································.2
1.1.1 信息的定义 ··············································································································.2
1.1.2 信息与情报等概念的区别和联系 ················································································.3
1.2 信息论及其发展 ··············································································································.4
1.2.1 信息论发展简介········································································································.4
1.2.2 信息论的应用···········································································································.6
1.3 通信系统一般模型···········································································································.7
1.4 信息论的研究内容···········································································································.9
习题·········································································································································.10
第 2 章 信息度量与信息熵 ········································································································.11
2.1 信源的分类与数学模型·································································································.11
2.1.1 信源分类················································································································.11
2.1.2 信源的数学模型······································································································.12
2.2 离散单符号信源的信息度量·························································································.13
2.2.1 信息量 ···················································································································.13
2.2.2 信息熵 ···················································································································.18
2.2.3 联合熵与条件熵······································································································.30
2.2.4 互熵与平均互信息 ··································································································.33
2.3 离散序列信源的信息度量·····························································································.39
2.4 连续信源的信息度量·····································································································.40
2.4.1 均匀分布的连续信源的熵 ························································································.41
2.4.2 高斯（正态）分布的连续信源的熵···········································································.41
2.4.3 指数分布的连续信源的熵 ························································································.42
习题·········································································································································.43
第 3 章 信道与信道容量 ············································································································.47
3.1 信道的分类与数学模型·································································································.47
3.1.1 信道分类················································································································.47
3.1.2 信道的数学模型······································································································.48
3.2 信息传输率与信道容量·································································································.51
3.2.1 信道疑义度 ············································································································.51
3.2.2 信息传输率 ············································································································.51
3.2.3 信道容量················································································································.52
3.3 离散信道及其容量·········································································································.53
3.3.1 强对称信道的信道容量····························································································.53
3.3.2 准对称信道的信道容量····························································································.54
3.3.3 一般离散信道的信道容量计算 ·················································································.55
3.4 连续信道及其容量·········································································································.57
3.4.1 高斯信道················································································································.57
3.4.2 广义平稳信道的信道容量 ························································································.57
3.5 有噪信道编码定理·········································································································.61
习题·········································································································································.62
第 4 章 无失真信源编码理论 ····································································································.65
4.1 信源编码基础 ················································································································.65
4.1.1 信源编码基本概念 ··································································································.65
4.1.2 常用编码格式·········································································································.66
4.2 无失真信源编码 ············································································································.68
4.2.1 定长码及其编码定理·······························································································.68
4.2.2 变长码及其编码定理·······························································································.72
4.3 无失真信源编码定理·····································································································.76
习题·········································································································································.78
第 5 章 限失真信源编码理论 ····································································································.80
5.1 信息失真及其度量·········································································································.80
5.1.1 失真的定义与度量 ··································································································.80
5.1.2 限失真编码的基本思想····························································································.81
5.2 信息率失真函数 R（D）及其性质···············································································.81
5.2.1 信息率失真函数 ····································································································.81
5.2.2 R（D）函数的性质·································································································.83
5.2.3 R（D）函数性质证明······························································································.83
5.3 离散信源 R（D）函数 ··································································································.84
5.3.1 无记忆信源 R（D）的计算 ······················································································.84
5.3.2 R（D）函数的迭代算法 ··························································································.89
5.3.3 连续信源 R（D）函数·····························································································.91
5.4 限失真信源编码定理·····································································································.95
习题·········································································································································.97
第 6 章 安全编码基础理论 ········································································································.99
6.1 密码技术起源与发展·····································································································.99
6.2 安全编码分类 ··············································································································.100
6.2.1 对称密码体制·······································································································.100
6.2.2 非对称密码体制····································································································.101
6.2.3 基于身份的密码体制·····························································································.102
6.2.4 杂凑密码体制·······································································································.103
6.3 密码体制的安全性测度·······························································································.103
6.3.1 完善保密性 ··········································································································.103
6.3.2 唯一解距离 ··········································································································.105
习题·······································································································································.106
第二篇 编码实践篇
第 7 章 信源编码方法及实践 ··································································································.108
7.1 统计编码方法 ··············································································································.108
7.1.1 香农编码··············································································································.108
7.1.2 香农-费诺编码······································································································.111
7.1.3 霍夫曼编码 ··········································································································.112
7.1.4 香农-费诺-埃利斯编码···························································································.115
7.2 统计编码实践 ··············································································································.116
7.3 预测编码 ······················································································································.119
7.3.1 无损预测编码·······································································································.119
7.3.2 有损预测编码·······································································································.121
7.4 变换编码 ······················································································································.121
习题·······································································································································.123
第 8 章 信道编码方法及实践 ··································································································.124
8.1 信道编码概述 ··············································································································.124
8.1.1 信道错误概率分析 ································································································.124
8.1.2 编码方法选择·······································································································.129
8.1.3 检错与纠错 ··········································································································.133
8.2 线性码 ··························································································································.138
8.2.1 有限域上的线性空间·····························································································.138
8.2.2 线性码的生成矩阵与校验矩阵 ···············································································.139
8.2.3 线性码的汉明重量和系统码···················································································.141
8.2.4 线性码的编码与译码·····························································································.142
8.3 循环码 ··························································································································.145
8.3.1 循环码数学基础····································································································.145
8.3.2 循环码的生成多项式与校验多项式·········································································.146
8.3.3 循环码的编码与译码·····························································································.148
8.3.4 循环冗余校验码····································································································.153
习题·······································································································································.155
第 9 章 安全编码方法及实践 ··································································································.158
9.1 古典密码 ······················································································································.158
9.1.1 凯撒密码··············································································································.158
9.1.2 仿射密码··············································································································.159
9.1.3 维吉尼亚密码·······································································································.159
9.1.4 希尔密码··············································································································.161
9.2 近现代密码体制 ··········································································································.161
9.2.1 数据加密标准（DES）··························································································.162
9.2.2 高级加密标准（AES）··························································································.163
9.2.3 国际数据加密算法（IDEA）··················································································.165
9.2.4 非对称密码算法（RSA） ······················································································.166
9.3 安全编码实践 ··············································································································.168
习题·······································································································································.171
第三篇 工程应用篇
第 10 章 多媒体压缩应用········································································································.173
10.1 图像编码标准 ············································································································.173
10.1.1 无损压缩和有损压缩的区别 ·················································································.173
10.1.2 国际图像压缩标准·······························································································.174
10.2 音频编码 ····················································································································.175
10.2.1 音频信号的冗余信息 ···························································································.176
10.2.2 常见的音频编码技术 ···························································································.177
10.2.3 常见的音频编码格式 ···························································································.178
10.3 视频编码技术 ············································································································.180
10.3.1 高级视频编码（AVC）························································································.180
10.3.2 高效视频编码（HEVC） ·····················································································.181
习题·······································································································································.183
第 11 章 高可靠传输应用 ········································································································.184
11.1 可靠传输中的高效压缩编码设计 ·············································································.184
11.1.1 应用问题 ············································································································.184
11.1.2 研究与分析·········································································································.185
11.2 可靠通信信号中的编码识别·····················································································.187
11.2.1 应用问题 ············································································································.187
11.2.2 研究与分析·········································································································.188
11.3 基于信道编码的可靠传输·························································································.193
11.3.1 应用问题 ············································································································.193
11.3.2 研究与分析·········································································································.193
11.4 语音通信中的可靠预测编码技术 ·············································································.197
11.4.1 应用问题 ············································································································.197
11.4.2 研究与分析·········································································································.197
11.5 数据链中的可靠传输应用·························································································.201
11.5.1 应用问题 ············································································································.201
11.5.2 研究与分析·········································································································.202
习题·······································································································································.211
第 12 章 安全保密技术应用 ····································································································.212
12.1 密码系统应用 ············································································································.212
12.2 国密商密标准 ············································································································.215
12.2.1 国密标准 ············································································································.215
12.2.2 商密标准 ············································································································.218
12.2.3 国密与商密的区别·······························································································.221
12.3 区块链技术应用·········································································································.222
习题·······································································································································.225
第四篇 前沿发展篇
第 13 章 语义信息论················································································································.227
13.1 语义信息定义概述·····································································································.227
13.1.1 信息的不同维度··································································································.227
13.1.2 语义信息论的发展与意义·····················································································.229
13.1.3 语义信息的内涵··································································································.229
13.1.4 语义信息的特征··································································································.230
13.2 语义信息的表示与度量·····························································································.232
13.2.1 语义信息表示 ·····································································································.232
13.2.2 语义信息度量 ·····································································································.236
13.3 语义通信模型 ············································································································.237
13.4 语义信息论应用前景·································································································.238
习题·······································································································································.241
第 14 章 信息论与人工智能 ····································································································.242
14.1 样本数据质量评价中的信息论·················································································.242
14.2 通信数据传输冗余评价中的信息论 ·········································································.244
14.3 人工智能对信息论的影响·························································································.247
习题·······································································································································.248
参考文献······································································································································.249