Residential Collegefalse
Status已發表Published
Automatic Schelling Point Detection From Meshes
Chen, Geng1; Dai, Hang2; Zhou, Tao3; Shen, Jianbing4; Shao, Ling5
2022-01-19
Source PublicationIEEE Transactions on Visualization and Computer Graphics
ISSN1077-2626
Volume29Issue:6Pages:2926-2939
Abstract

Mesh Schelling points explain how humans focus on specific regions of a 3D object. They have a large number of important applications in computer graphics and provide valuable information for perceptual psychology studies. However, detecting mesh Schelling points is time-consuming and expensive since the existing techniques are mostly based on participant observation studies. To overcome these limitations, we propose to employ powerful deep learning techniques to detect mesh Schelling points in an automatic manner, free from participant observation studies. Specifically, we utilize the mesh convolution and pooling operations to extract informative features from mesh objects, and then predict the 3D heat map of Schelling points in an end-to-end manner. In addition, we propose a Deep Schelling Network (DS-Net) to automatically detect the Schelling points, including a multi-scale fusion component and a novel region-specific loss function to improve our network for a better regression of heat maps. To the best of our knowledge, DS-Net is the first deep neural network for detecting Schelling points from 3D meshes. We evaluate DS-Net on a mesh Schelling point dataset obtained from participant observation studies. The experimental results demonstrate that DS-Net is capable of detecting mesh Schelling points effectively and outperforms various state-of-the-art mesh saliency methods and deep learning models, both qualitatively and quantitatively.

KeywordDeep Neural Network Geometric Deep Learning Heat Map Regression Mesh Schelling Points
DOI10.1109/TVCG.2022.3144143
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaComputer Science
WOS SubjectComputer Science, Software Engineering
WOS IDWOS:000981880500008
PublisherIEEE COMPUTER SOC, 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1314
Scopus ID2-s2.0-85123363872
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionDEPARTMENT OF COMPUTER AND INFORMATION SCIENCE
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Corresponding AuthorDai, Hang; Shen, Jianbing
Affiliation1.National Engineering Laboratory for Integrated Aero-Space-Ground-Ocean Big Data Application Technology, School of Computer Science and Engineering, Northwestern Polytechnical University, Xi’an, 710060, China
2.Mohamed Bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates
3.School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing, 210094, China
4.State Key Laboratory of Internet of Things for Smart City, Department of Computer and Information Science, University of Macau, Macau, Macao
5.National Center for Artificial Intelligence, Saudi Data and Ai Authority, Riyadh, Saudi Arabia
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Chen, Geng,Dai, Hang,Zhou, Tao,et al. Automatic Schelling Point Detection From Meshes[J]. IEEE Transactions on Visualization and Computer Graphics, 2022, 29(6), 2926-2939.
APA Chen, Geng., Dai, Hang., Zhou, Tao., Shen, Jianbing., & Shao, Ling (2022). Automatic Schelling Point Detection From Meshes. IEEE Transactions on Visualization and Computer Graphics, 29(6), 2926-2939.
MLA Chen, Geng,et al."Automatic Schelling Point Detection From Meshes".IEEE Transactions on Visualization and Computer Graphics 29.6(2022):2926-2939.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Chen, Geng]'s Articles
[Dai, Hang]'s Articles
[Zhou, Tao]'s Articles
Baidu academic
Similar articles in Baidu academic
[Chen, Geng]'s Articles
[Dai, Hang]'s Articles
[Zhou, Tao]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Chen, Geng]'s Articles
[Dai, Hang]'s Articles
[Zhou, Tao]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.