SE-PSNet: Silhouette-based Enhancement Feature for Panoptic Segmentation Network

Shuo En Chang, Yi Chen, Yi Cheng Yang, En Ting Lin, Pei Yung Hsiao, Li Chen Fu*

*Corresponding author for this work

Research output: Contribution to journalJournal Article peer-review

1 Scopus citations

Abstract

In this work, we propose a panoptic segmentation model that integrates bottom-up and top-down methods. Our framework is designed to guarantee both the performance and the inference speed. We also focus on improving the quality of semantic and instance masks. The proposed auxiliary task with the silhouette-based enhanced features can help the model improve the prediction quality of mask contours. Additionally, we introduce a new mask quality score intending to solve the occlusion problem. The model has less chance of ignoring small objects, which often have lower confidence scores than larger objects behind them. The results show that the proposed mask quality score can better distinguish the priority of objects when the occlusion occurs. We demonstrate the results of our work on two datasets: the COCO dataset and the CityScapes dataset. Via our approach, we obtained competitive results with fast inference time.

Original languageEnglish
Article number103736
JournalJournal of Visual Communication and Image Representation
Volume90
DOIs
StatePublished - 02 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2022

Keywords

  • Deep learning
  • Instance segmentation
  • Panoptic segmentation
  • Silhouette
  • confidence score

Fingerprint

Dive into the research topics of 'SE-PSNet: Silhouette-based Enhancement Feature for Panoptic Segmentation Network'. Together they form a unique fingerprint.

Cite this