Publication
Classification of facial expressions under partial occlusion for VR games
| dc.contributor.author | Rodrigues, Ana Sofia Figueiredo | |
| dc.contributor.author | Lopes, Júlio Castro | |
| dc.contributor.author | Lopes, Rui Pedro | |
| dc.contributor.author | Teixeira, Luís F. | |
| dc.date.accessioned | 2018-03-23T15:13:36Z | |
| dc.date.available | 2018-03-23T15:13:36Z | |
| dc.date.issued | 2022 | |
| dc.description.abstract | Facial expressions are one of the most common way to externalize our emotions. However, the same emotion can have different effects on the same person and has different effects on different people. Based on this, we developed a system capable of detecting the facial expressions of a person in real-time, occluding the eyes (simulating the use of virtual reality glasses). To estimate the position of the eyes, in order to occlude them, Multi-task Cascade Convolutional Neural Networks (MTCNN) were used. A residual network, a VGG, and the combination of both models, were used to perform the classification of 7 different types of facial expressions (Angry, Disgust, Fear, Happy, Sad, Surprise, Neutral), classifying the occluded and non-occluded dataset. The combination of both models, achieved an accuracy of 64.9% for the occlusion dataset and 62.8% for no occlusion, using the FER-2013 dataset. The primary goal of this work was to evaluate the influence of occlusion, and the results show that the majority of the classification is done with the mouth and chin. Nevertheless, the results were far from the state-of-the-art, which is expect to be improved, mainly by adjusting the MTCNN. | pt_PT |
| dc.description.version | info:eu-repo/semantics/publishedVersion | pt_PT |
| dc.identifier.citation | Rodrigues, Ana Sofia Figueiredo; Lopes, Julio Castro; Lopes, Rui Pedro; Teixeira, Luís F. (2022). Classification of facial expressions under partial occlusion for VR games. In Optimization, Learning Algorithms and Applications, OL2A 2022. eISSN 1865-0937. 1754, p. 804-819 | pt_PT |
| dc.identifier.doi | 10.1007/978-3-031-23236-7_55 | |
| dc.identifier.eissn | 1865-0937 | |
| dc.identifier.issn | 1865-0929 | |
| dc.identifier.uri | http://hdl.handle.net/10198/16498 | |
| dc.peerreviewed | yes | pt_PT |
| dc.publisher | Springer | pt_PT |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | pt_PT |
| dc.subject | Facial expression recognition | pt_PT |
| dc.subject | Emotions | pt_PT |
| dc.subject | ResNet | pt_PT |
| dc.subject | VGG | pt_PT |
| dc.subject | MTCNN | pt_PT |
| dc.subject | Virtual reality | |
| dc.title | Classification of facial expressions under partial occlusion for VR games | pt_PT |
| dc.type | conference object | |
| dspace.entity.type | Publication | |
| oaire.citation.title | Optimization, Learning Algorithms and Applications, OL2A 2022 | pt_PT |
| person.familyName | Lopes | |
| person.givenName | Rui Pedro | |
| person.identifier.ciencia-id | 8E14-54E4-4DB5 | |
| person.identifier.orcid | 0000-0002-9170-5078 | |
| rcaap.rights | openAccess | pt_PT |
| rcaap.type | conferenceObject | pt_PT |
| relation.isAuthorOfPublication | e1e64423-0ec8-46ee-be96-33205c7c98a9 | |
| relation.isAuthorOfPublication.latestForDiscovery | e1e64423-0ec8-46ee-be96-33205c7c98a9 |
Files
Original bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- Classification of Facial Expressions.pdf
- Size:
- 2.02 MB
- Format:
- Adobe Portable Document Format
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 1.75 KB
- Format:
- Item-specific license agreed upon to submission
- Description: