ETS System for AV EC 2015
ETS System for AV EC 2015
Cardinal, Patrick and Dehak, Najim and Koerich, Alessandro Lameiras and Alam, Jahangir and Boucher, Patrice and Lameiras, Alessandro and Boucher, Patrice
Proceedings of the 5th International Workshop on Audio/Visual Emotion Challenge – AVEC ’15 2015
Abstract : © 2015 ACM.This paper presents the system that we have developed for the AV+EC 2015 challenge which is mainly based on deep neural networks (DNNs). We have investigated different op- Tions using the audio feature set as a base system. The improvements that were achieved on this specific modality have been applied to other modalities. One of our main findings is that the frame stacking technique improves the quality of the predictions made by our model, and the im- provements were also observed in all other modalities. Be- sides that, we also present a new feature set derived from the cardiac rhythm that were extracted from electrocardio- gram readings. Such a new feature set helped us to improve the concordance correlation coefficient from 0.088 to 0.124 (on the development set) for the valence, an improvement of 25%. Finally, the fusion of all modalities has been studied using fusion at feature level using a DNN and at prediction level by training linear and random forest regressors. Both fusion schemes provided promising results.
