Semantic segmentation of point cloud by incorporating two-way attention mechanism in superpoint graph framework
Author:
Clc Number:

TP391.41

  • Article
  • | |
  • Metrics
  • |
  • Reference [23]
  • |
  • Related
  • | | |
  • Comments
    Abstract:

    To address the deficiencies of traditional graph neural network methods in point cloud semantic segmentation,such as high requirements for supervision accuracy,one-way only node label propagation,and neglect of global information,this paper proposes a point cloud semantic segmentation method based on bidirectional attention mechanism.Firstly,the point cloud is over-segmented into superpoints and a superpoint graph is constructed,thus introducing the point cloud classification problem into the superpoint graph network framework.Subsequently,the two-way attention module is utilized to alternately focus on superpoints and update their features according to the weights of neighboring superpoints,enabling the two-way information propagation.Unlike previous graph pooling methods,this study applies both maximum pooling and average pooling,and combines their pooled features.Finally,the public dataset Semantic 3D is used for training and experiments.The results show that the proposed method can effectively correct labelling errors while coupling local features with long-range information,and the mean Intersection over Union (mIoU) and overall Accuracy (oAcc) of the dataset are 75.4% and 95.1%,respectively,exhibiting a better label delivery mechanism and higher classification accuracy compared with existing methods.

    Reference
    [1] Chakraborty D,Dey E K.Segmentation of LiDAR point cloud data in urban areas using adaptive neighborhood selection technique[J].PLoS One,2024,19(7):e0307138
    [2] Fan S Q,Dong Q L,Zhu F H,et al.SCF-net:learning spatial contextual features for large-scale point cloud segmentation[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 20-25,2021,Nashville,TN,USA.IEEE,2021:14499-14508
    [3] Koszyk J,Jasińska A,Pargieła K,et al.Semantic segmentation-driven integration of point clouds from mobile scanning platforms in urban environments[J].Remote Sensing,2024,16(18):3434
    [4] Quan S W,Xin Y,Cheng Y X,et al.Road extraction from 3D point clouds based on the difference of normal vector[C]//Thirteenth International Conference on Graphics and Image Processing (ICGIP 2021).August 18-20,2021.Kunming,China.SPIE,2022:12083
    [5] Wang Y,Sun Y B,Liu Z W,et al.Dynamic graph CNN for learning on point clouds[J].ACM Transactions on Graphics,2019,38(5):1-12
    [6] Zhai Z L,Zhang X,Yao L Y.Multi-scale dynamic graph convolution network for point clouds classification[J].IEEE Access,2020,8:65591-65598
    [7] Zhang K G,Hao M,Wang J,et al.Linked dynamic graph CNN:learning through point cloud by linking hierarchical features[C]//2021 27th International Conference on Mechatronics and Machine Vision in Practice (M2VIP).November 26-28,2021,Shanghai,China.IEEE,2021:7-12
    [8] Zhang C,Chen H,Wan H C,et al.Graph-PBN:Graph-based parallel branch network for efficient point cloud learning[J].Graphical Models,2022,119:101120
    [9] Landrieu L,Simonovsky M.Large-scale point cloud semantic segmentation with superpoint graphs[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.June 18-23,2018,Salt Lake City,UT,USA.IEEE,2018:4558-4567
    [10] Te G S,Hu W,Zheng A M,et al.RGCNN:regularized graph CNN for point cloud segmentation[C]//Proceedings of the 26th ACM International Conference on Multimedia.October 22-26,2018,Seoul,Republic of Korea.ACM,2018:746-754
    [11] Liang Z M,Huang Y P,Liu Z W.Efficient graph attentional network for 3D object detection from Frustum-based LiDAR point clouds[J].Journal of Visual Communication and Image Representation,2022,89:103667
    [12] Luo N,Yu H Q,Huo Z F,et al.KVGCN:a KNN searching and VLAD combined graph convolutional network for point cloud segmentation[J].Remote Sensing,2021,13(5):1003
    [13] Chen C F,Qian S S,Fang Q,et al.HAPGN:hierarchical attentive pooling graph network for point cloud segmentation[J].IEEE Transactions on Multimedia,2021,23:2335-2346
    [14] Charles R Q,Hao S,Mo K C,et al.PointNet:deep learning on point sets for 3D classification and segmentation[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).July 21-26,2017,Honolulu,HI,USA.IEEE,2017:77-85
    [15] Guinard S,Landrieu L.Weakly supervised segmentation-aided classification of urban scenes from 3d lidar point clouds[J].The International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2017,XLII-1/W1:151-157
    [16] Landrieu L,Boussaha M.Point cloud oversegmentation with graph-structured deep metric learning[C]//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 15-20,2019,Long Beach,CA,USA.IEEE,2019:7432-7441
    [17] Chen Y M,Li G L,Liu X Q,et al.Integrating OpenStreetMap tags for efficient LiDAR point cloud classification using graph neural networks[J].International Journal of Digital Earth,2024,17(1):2297946
    [18] Cheng M,Hui L,Xie J,et al.SSPC-Net:semi-supervised semantic 3d point cloud segmentation network[J]Proceedings of the AAAI Conference on Artificial Intelligence,2021,35(2):1140-1147
    [19] Qi C R,Yi L,Su H,et al.PointNet++:deep hierarchical feature learning on point sets in a metric space[C]//31st Conference on Neural Information Processing Systems (NIPS 2017).December 4-9,2017,Long Beach,CA,USA.NIPS,2017:5105-5114
    [20] Gong J Y,Xu J C,Tan X,et al.Omni-supervised point cloud segmentation via gradual receptive field component reasoning[C]//2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).June 20-25,2021,Nashville,TN,USA.IEEE,2021:11668-11677
    [21] Xu S,Vosselman G,Oude Elberink S.Multiple-entity based classification of airborne laser scanning data in urban areas[J].ISPRS Journal of Photogrammetry and Remote Sensing,2014,88:1-15
    [22] Wang L C,Chen Y J,Xu H H.Point cloud denoising in outdoor real-world scenes based on measurable segmentation[J].Remote Sensing,2024,16(13):2347
    [23] Choe J,Park C,Rameau F,et al.PointMixer:MLP-mixer for point cloud understanding[M]//Lecture Notes in Computer Science.Cham:Springer Nature Switzerland,2022:620-640
    Related
    Cited by
Get Citation

LI Guoli, CHEN Yanming, XIA Jiakang, ZOU Xincan. Semantic segmentation of point cloud by incorporating two-way attention mechanism in superpoint graph framework[J]. Journal of Nanjing University of Information Science & Technology,2025,17(2):165-171

Copy
Related Videos

Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:October 24,2024
  • Online: April 16,2025
  • Published: March 28,2025
Article QR Code

Address:No. 219, Ningliu Road, Nanjing, Jiangsu Province

Postcode:210044

Phone:025-58731025