基于细节还原卷积神经网络的压缩视频质量增强技术研究
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391.4

基金项目:

国家自然科学基金(61872006)


Quality enhancement for compressed video via detail recovery convolutional neural network
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    视频编码技术有效地解决了原始视频数据量过大的问题,但压缩效率的提升会使视频质量下降.为了提高压缩视频的视觉质量,本文提出了一种基于细节还原卷积神经网络(Detail Recovery Convolutional Neural Network,DRCNN)的视频质量增强方法,该方法由一个主去噪分支和一个细节补偿分支组成.为了有效地提取和消除压缩失真,在主去噪分支中提出了一个多尺度失真特征提取块(Multi-scale Distortion Feature Extraction Block,MDFEB),使其更加关注压缩视频中的失真区域,并提高DRCNN的失真特征学习能力.此外,为了丰富压缩视频中的细节,本文提出了细节补偿分支:首先采用预训练的50层残差网络组成的内容特征提取器,提供丰富的内容特征,如突出的物体、形状、细节等;然后通过设计的细节响应块(Detail Response Block,DRB)从内容特征中有效地提取细节特征.大量的实验结果表明,与4种有代表性的方法相比,本文所提出的DRCNN实现了最佳的压缩视频质量增强性能.

    Abstract:

    Video coding has effectively addressed the too large data volume of raw videos, however, the achieved compression efficiency comes at the cost of video quality degradation.To improve the visual quality of compressed video, a Detail Recovery Convolutional Neural Network (DRCNN)-based video quality enhancement method is proposed, which consists of a main denoising branch and a detail compensation branch.To effectively extract and eliminate the compression distortions, a Multi-scale Distortion Feature Extraction Block (MDFEB) is added to the main denoising branch, which can pay attention to the distorted areas in the compressed video, and improve the distortion feature learning ability of the proposed DRCNN.Furthermore, to enrich the details in the compressed video, the detail compensation branch adopts a content feature extractor composed of a pre-trained ResNet-50 to provide abundant content features, such as salient objects, shapes, and details, and then involves a Detail Response Block (DRB) to efficiently extract the detailed features from the content features.Extensive experimental results show that the proposed DRCNN achieves the best performance in enhancing the compressed video quality as compared with four representative methods.

    参考文献
    相似文献
    引证文献
引用本文

李子晗,邵笑,张佩云.基于细节还原卷积神经网络的压缩视频质量增强技术研究[J].南京信息工程大学学报(自然科学版),2023,15(3):274-285
LI Zihan, SHAO Xiao, ZHANG Peiyun. Quality enhancement for compressed video via detail recovery convolutional neural network[J]. Journal of Nanjing University of Information Science & Technology, 2023,15(3):274-285

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2022-03-21
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-06-28
  • 出版日期:

地址:江苏省南京市宁六路219号    邮编:210044

联系电话:025-58731025    E-mail:nxdxb@nuist.edu.cn

南京信息工程大学学报 ® 2024 版权所有  技术支持:北京勤云科技发展有限公司