融合信息化边界和多模态特征的室内空间布局估计
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61001152,31200747,61071091,61071166,61172118);江苏省自然科学基金(BK2012437);南京邮电大学校级科研基金(NY214037);国家留学基金(201208320219)


Indoor spatial layout estimation using informative edges and multi-modality features
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    为感知室内空间布局,提出一种基于信息化边界和多模态特征的场景布局估计方法.首先,采用VGG-16全卷积神经网络预测蕴含空间布局先验的信息化边界图.其次,采用Canny边缘检测和投票策略估计水平和竖直方向消失点,从消失点等角度间隔引出射线细采样信息化边界能量高的区域.接着,采用VGG空间多尺度卷积神经网络估计几何深度和法向特征.然后,积分几何求和候选布局多边形中多模特征描述一元共生,候选布局的表面法向平滑和位置关系确定二元标记约束.最后,采用结构化支持向量机学习模型,最大布局候选得分以推理布局.实验结果表明,与经典方法相比,本估计方法可以有效改善布局的完整度.

    Abstract:

    To perceive indoor spatial layout,we present a scene layout estimation method based on informative edges and multi-modality features.First,the VGG-16 full convolutional neural network is applied to predict informative edge map with the prior of spatial layout.Then,Canny edge detection and voting strategy are utilized to estimate the horizontal and vertical vanishing points,while the rays led at equal intervals from the given vanishing points finely resample the divided regions with high informative edge energies for the layout candidates.Next,the spatial multi-scaled VGG-16-based convolutional neural network is adopted to estimate the related geometric depth and normal vectors on the scene surfaces.And then,integral geometry is applied to accumulate the multi-model regional features as unary occurrence potential in the polygons of candidate layouts,and the pairwise label constrains are reflected by surface normal smooth and the location relationship of candidate layouts.Finally,the mode parameters can be learned by structural SVM learning,and the scene layout can be inferred by maximizing the related scores of the layout candidates.Experimental results show that,compared with traditional methods,this proposed estimation method can effectively improve the completeness of the resulting spatial layouts.

    参考文献
    相似文献
    引证文献
引用本文

刘天亮,陆泮宇,戴修斌,刘峰,罗杰波.融合信息化边界和多模态特征的室内空间布局估计[J].南京信息工程大学学报(自然科学版),2019,11(6):735-742
LIU Tianliang, LU Panyu, DAI Xiubin, LIU Feng, LUO Jiebo. Indoor spatial layout estimation using informative edges and multi-modality features[J]. Journal of Nanjing University of Information Science & Technology, 2019,11(6):735-742

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2019-10-20
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2020-01-19
  • 出版日期:

地址:江苏省南京市宁六路219号    邮编:210044

联系电话:025-58731025    E-mail:nxdxb@nuist.edu.cn

南京信息工程大学学报 ® 2024 版权所有  技术支持:北京勤云科技发展有限公司