Open Access Open Access  Restricted Access Subscription or Fee Access

Biometric Feature Extraction and Encoding for Face-Voice Association Learning using Spiking Neural Network

Nooraini Yusoff, Mohammed Fadhil-Ibrahim, Husniz Husni, Azizi Ab Aziz


In most biometric neural network-based recognitions, learning have been implemented using supervised approaches. These approaches require a set of learning targets with particular encoding rules to train a network to recognise the biometric features. However, in some applications, the exact teacher signals are not easy to be formulated. For this study, we propose an encoding of biometric features for association learning of face-voice using a recurrent spatio-temporal neural network. The association learning rules are implemented using reward-modulated spike-time dependent plasticity without any particular spike templates as the learning targets. Prior to learning, the face features are extracted using principal component analysis (PCA). We have also experimented on the face feature extraction using singular value decomposition (SVD). The network learns better with the features obtained from PCA. Meanwhile the voice features are extracted using wavelet packet decomposition (WPD). The face and voice features are then encoded into spikes. We have run a series of experiment to find the optimal set of learning parameters. The best performance achieved was 77.26% and 82.66% for training and testing, respectively.


multimodal association learning, spike encoding, principal component analysis, singular value decomposition, wavelet packet decomposition,

Full Text:


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information. Also: DOI is paid service which provided by a third party. We never mentioned that we go for this for our any journal. However, journal have no objection if author go directly for this paid DOI service.