Repository logo
 
Publication

Eye Importance in Facial Expression Recognition

2024Conference paper Open access
Simple item page
dc.contributor.authorRodrigues, Ana Sofia Figueiredo
dc.contributor.authorLopes, Júlio Castro
dc.contributor.authorLopes, Rui Pedro
dc.date.accessioned2024-07-31T13:40:02Z
dc.date.available2024-07-31T13:40:02Z
dc.date.issued2024
dc.description.abstractThe human face is a powerful tool for nonverbal communication, capable of conveying a wide range of emotions. Previous research has shown that facial expressions contribute significantly to interpersonal communication, indicating that 55% of information is conveyed through facial expression alone. Despite advancements, Facial Expression Recognition (FER) technology faces challenges, particularly in scenarios involving occlusions. Instances during the COVID-19 pandemic and in Virtual Reality (VR) environments highlight these challenges, where mask usage and head-mounted displays obstruct facial features critical for accurate recognition. This paper aims to investigate the importance of the eyes in facial expression recognition by using four models: ResNet-18, VGG-19, EfficientNet-B1, and an Ensemble model. Utilising the FERPlus dataset, scenarios with and without occlusion were examined. In scenarios without occlusion, ResNet-18 emerged as the top-performing model, achieving 86.1% accuracy. However, when occluded by goggles, the Ensemble model demonstrated superior performance with 82.8% accuracy. Furthermore, in the presence of mask occlusion, EfficientNet-B1 exhibited the most robust performance, achieving an accuracy of 71.2%. Despite challenges, the results of this paper reaffirm the enduring importance of the eyes in facial expression recognition, emphasizing their pivotal role in conveying emotions even amidst technological obstacles.pt_PT
dc.description.versioninfo:eu-repo/semantics/publishedVersionpt_PT
dc.identifier.citationRodrigues, Ana Sofia; Lopes, Júlio Castro; Lopes, Rui Pedro (2024). Eye Importance in Facial Expression Recognition. In 2024 IEEE 12th International Conference on Serious Games and Applications for Health (SeGAH). IEEE, p. 1-8. ISBN 979-8-3503-8438-3pt_PT
dc.identifier.doi10.1109/SeGAH61285.2024.10639602pt_PT
dc.identifier.isbn979-8-3503-8438-3
dc.identifier.urihttp://hdl.handle.net/10198/30136
dc.language.isoengpt_PT
dc.peerreviewedyespt_PT
dc.publisherIEEEpt_PT
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/pt_PT
dc.subjectFacial Expression Recognitionpt_PT
dc.subjectPartial Occlusionpt_PT
dc.subjectPartial Occlusionpt_PT
dc.subjectVirtual Realitypt_PT
dc.subjectEyespt_PT
dc.subjectCOVID-19pt_PT
dc.subjectSerious Gamespt_PT
dc.titleEye Importance in Facial Expression Recognitionpt_PT
dc.typeconference paper
dspace.entity.typePublication
oaire.citation.endPage8pt_PT
oaire.citation.startPage1pt_PT
oaire.citation.title2024 IEEE 12th International Conference on Serious Games and Applications for Health (SeGAH)pt_PT
person.familyNameLopes
person.givenNameRui Pedro
person.identifier.ciencia-id8E14-54E4-4DB5
person.identifier.orcid0000-0002-9170-5078
rcaap.rightsrestrictedAccesspt_PT
rcaap.typeconferenceObjectpt_PT
relation.isAuthorOfPublicatione1e64423-0ec8-46ee-be96-33205c7c98a9
relation.isAuthorOfPublication.latestForDiscoverye1e64423-0ec8-46ee-be96-33205c7c98a9

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Eye_Importance_in_Facial_Expression_Recognition.pdf
Size:
3.04 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.75 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

ESTiG - Publicações em Proceedings Indexadas à WoS/Scopus