Video-based continuous affect recognition of children with Autism Spectrum Disorder using deep learning - Université Paris-Est-Créteil-Val-de-Marne Access content directly
Journal Articles Biomedical Signal Processing and Control Year : 2024

Video-based continuous affect recognition of children with Autism Spectrum Disorder using deep learning

Mamadou Dia
  • Function : Author
Ghazaleh Khodabandelou
Aznul Qalid Md Sabri

Abstract

Affect recognition is currently an active research area for machine learning researchers. Researchers are paying more and more attention to the assessment and the classification of emotions in people with mental disorders in order to propose monitoring healthcare systems and then to better assist patients. In this paper, a supervised learning method to classify Autism Spectrum Disorder (ASD) and to evaluate affect levels among autistic children is proposed. The use of methodologies for clinical patient monitoring and management is the focus of our research. YouTube video frames acquired in unconstrained environments and conditions of autistic children demonstrating typical autistic behaviors, as well as images of neurotypical people are used to evaluate the performance of the proposed approach. This paper also proposes an extended version of a dataset, including the additional affect labels corresponding to the affect levels of autistic children. Finally, experiments using different models were conducted to determine which architecture performed best. These experiments have shown very promising results for continuous affect recognition of children with ASD. Results show also that using a model that has only been trained on neurotypical subjects does not perform as great when the subjects are ASD children.
No file

Dates and versions

hal-04317121 , version 1 (01-12-2023)

Identifiers

Cite

Mamadou Dia, Ghazaleh Khodabandelou, Aznul Qalid Md Sabri, Alice Othmani. Video-based continuous affect recognition of children with Autism Spectrum Disorder using deep learning. Biomedical Signal Processing and Control, 2024, 89, pp.105712. ⟨10.1016/j.bspc.2023.105712⟩. ⟨hal-04317121⟩

Collections

LISSI UPEC
18 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More