Details

Autor(en) / Beteiligte

• Zhou, Wujie
• Liu, Jinfu
• Lei, Jingsheng
• Yu, Lu
• Hwang, Jenq-Neng

Titel

GMNet: Graded-Feature Multilabel-Learning Network for RGB-Thermal Urban Scene Semantic Segmentation

Ist Teil von

• IEEE transactions on image processing, 2021, Vol.30, p.7790-7802

Ort / Verlag

New York: IEEE

Erscheinungsjahr

2021

Quelle

IEEE Electronic Library Online

Beschreibungen/Notizen

• Semantic segmentation is a fundamental task in computer vision, and it has various applications in fields such as robotic sensing, video surveillance, and autonomous driving. A major research topic in urban road semantic segmentation is the proper integration and use of cross-modal information for fusion. Here, we attempt to leverage inherent multimodal information and acquire graded features to develop a novel multilabel-learning network for RGB-thermal urban scene semantic segmentation. Specifically, we propose a strategy for graded-feature extraction to split multilevel features into junior, intermediate, and senior levels. Then, we integrate RGB and thermal modalities with two distinct fusion modules, namely a shallow feature fusion module and deep feature fusion module for junior and senior features. Finally, we use multilabel supervision to optimize the network in terms of semantic, binary, and boundary characteristics. Experimental results confirm that the proposed architecture, the graded-feature multilabel-learning network, outperforms state-of-the-art methods for urban scene semantic segmentation, and it can be generalized to depth data.