Select Publications
Book Chapters
2018, 'Multimodal assessment of depression from behavioral signals', in The Handbook of Multimodal-Multisensor Interfaces, Volume 2 Signal Processing, Architectures, and Detection of Emotion and Cognition, Morgan & Claypool, http://dx.doi.org/10.1145/3107990.3108004
,2017, 'Task Load and Stress', in The Wiley Handbook of Human Computer Interaction Set, pp. 207 - 223, http://dx.doi.org/10.1002/9781118976005.ch11
,2015, 'Speech based emotion recognition', in Speech and Audio Processing for Coding, Enhancement and Recognition, Springer Link, pp. 197 - 228, http://dx.doi.org/10.1007/978-1-4939-1456-2_7
,2011, 'Speech characterization and feature extraction for speaker recognition', in Li H; Toh KA; Li LY (ed.), Advanced Topics in Biometrics, World Scientific Publishing Company, Singapore, pp. 45, http://www.amazon.com/Advanced-Topics-Biometrics-Haizhou-Li/dp/9814287849
,Journal articles
2024, 'Eye Action Units as Combinations of Discrete Eye Behaviors for Wearable Mental State Analysis', IEEE Transactions on Affective Computing, http://dx.doi.org/10.1109/TAFFC.2024.3422448
,2023, 'A High-Quality Landmarked Infrared Eye Video Dataset (IREye4Task): Eye Behaviors, Insights and Benchmarks for Wearable Mental State Analysis', IEEE Transactions on Affective Computing, 14, pp. 3078 - 3093, http://dx.doi.org/10.1109/TAFFC.2023.3258915
,2023, 'DNN controlled adaptive front-end for replay attack detection systems', Speech Communication, 154, http://dx.doi.org/10.1016/j.specom.2023.102973
,2023, 'Pupillometric and blink measures of diverse task loads: Implications for working memory models', British Journal of Educational Psychology, 93, pp. 318 - 338, http://dx.doi.org/10.1111/bjep.12577
,2023, 'Ordinal Logistic Regression With Partial Proportional Odds for Depression Prediction', IEEE Transactions on Affective Computing, 14, pp. 563 - 577, http://dx.doi.org/10.1109/TAFFC.2020.3031300
,2022, 'Breaking Age Barriers With Automatic Voice-Based Depression Detection', IEEE Pervasive Computing, 21, pp. 10 - 19, http://dx.doi.org/10.1109/MPRV.2022.3163656
,2022, 'Development of an Undergraduate Quantum Engineering Degree', IEEE Transactions on Quantum Engineering, 3, http://dx.doi.org/10.1109/TQE.2022.3157338
,2022, 'Multi-Task Semi-Supervised Adversarial Autoencoding for Speech Emotion Recognition', IEEE Transactions on Affective Computing, 13, pp. 992 - 1004, http://dx.doi.org/10.1109/TAFFC.2020.2983669
,2021, 'An adaptive transmission line cochlear model based front-end for replay attack detection', Speech Communication, 132, pp. 114 - 122, http://dx.doi.org/10.1016/j.specom.2021.06.004
,2021, 'Read speech voice quality and disfluency in individuals with recent suicidal ideation or suicide attempt', Speech Communication, 132, pp. 10 - 20, http://dx.doi.org/10.1016/j.specom.2021.05.004
,2021, 'Task Load Estimation from Multimodal Head-Worn Sensors Using Event Sequence Features', IEEE Transactions on Affective Computing, 12, pp. 622 - 635, http://dx.doi.org/10.1109/TAFFC.2019.2956135
,2021, 'Automatic Detection of COVID-19 Based on Short-Duration Acoustic Smartphone Speech Analysis', Journal of Healthcare Informatics Research, 5, pp. 201 - 217, http://dx.doi.org/10.1007/s41666-020-00090-4
,2021, 'Teaching Signal Processing through Frequent and Diverse Design: A Pedagogical Approach', IEEE Signal Processing Magazine, 38, pp. 133 - 143, http://dx.doi.org/10.1109/MSP.2021.3057855
,2020, 'A comparison of methods for mitigating within-task luminance change for eyewear-based cognitive load measurement', IEEE Transactions on Cognitive and Developmental Systems, 12, pp. 681 - 694, http://dx.doi.org/10.1109/TCDS.2018.2876348
,2020, 'Multimodal Coordination Measures to Understand Users and Tasks', ACM Transactions on Computer-Human Interaction, 27, pp. 1 - 26, http://dx.doi.org/10.1145/3412365
,2020, 'Think before you speak: An investigation of eye activity patterns during conversations using eyewear', International Journal of Human Computer Studies, 143, http://dx.doi.org/10.1016/j.ijhcs.2020.102468
,2020, 'An Investigation of Partition-Based and Phonetically-Aware Acoustic Features for Continuous Emotion Prediction from Speech', IEEE Transactions on Affective Computing, 11, pp. 653 - 668, http://dx.doi.org/10.1109/TAFFC.2018.2821135
,2020, 'Generalized two-stage rank regression framework for depression score prediction from speech', IEEE Transactions on Affective Computing, 11, pp. 272 - 283, http://dx.doi.org/10.1109/TAFFC.2017.2766145
,2020, 'Natural Language Processing Methods for Acoustic and Landmark Event-Based Features in Speech-Based Depression Detection', IEEE Journal on Selected Topics in Signal Processing, 14, pp. 435 - 448, http://dx.doi.org/10.1109/JSTSP.2019.2949419
,2019, 'Automatic depression classification based on affective read sentences: Opportunities for text-dependent analysis', Speech Communication, 115, pp. 1 - 14, http://dx.doi.org/10.1016/j.specom.2019.10.003
,2019, 'Automatic Pupillary Light Reflex Detection in Eyewear Computing', IEEE Transactions on Cognitive and Developmental Systems, 11, pp. 560 - 572, http://dx.doi.org/10.1109/TCDS.2018.2880664
,2019, 'Atomic Head Movement Analysis for Wearable Four-Dimensional Task Load Recognition', IEEE Journal of Biomedical and Health Informatics, 23, pp. 2464 - 2474, http://dx.doi.org/10.1109/JBHI.2019.2893945
,2019, 'Eyelid and Pupil Landmark Detection and Blink Estimation Based on Deformable Shape Models for Near-Field Infrared Video', Frontiers in ICT, 6, pp. 18, http://dx.doi.org/10.3389/fict.2019.00018
,2019, 'An investigation of linguistic stress and articulatory vowel characteristics for automatic depression classification', Computer Speech and Language, 53, pp. 140 - 155, http://dx.doi.org/10.1016/j.csl.2018.08.001
,2019, 'Investigation of Speech Landmark Patterns for Depression Detection', IEEE Transactions on Affective Computing, 13, pp. 666 - 679, http://dx.doi.org/10.1109/TAFFC.2019.2944380
,2018, 'Automatic Task Analysis', IEEE Systems Man and Cybernetics Magazine, 4, pp. 15 - 20, http://dx.doi.org/10.1109/msmc.2018.2822846
,2018, 'Multimodal Depression Detection: Fusion Analysis of Paralinguistic, Head Pose and Eye Gaze Behaviors', IEEE Transactions on Affective Computing, 9, pp. 478 - 490, http://dx.doi.org/10.1109/TAFFC.2016.2634527
,2018, 'A flipped mode teaching approach for large and advanced electrical engineering courses', European Journal of Engineering Education, 43, pp. 413 - 426, http://dx.doi.org/10.1080/03043797.2017.1383974
,2018, 'Prediction of emotion change from speech', Frontiers in ICT, 5, http://dx.doi.org/10.3389/fict.2018.00011
,2016, 'Pupillary transient responses to within-task cognitive load variation', Computer Methods and Programs in Biomedicine, 137, pp. 47 - 63, http://dx.doi.org/10.1016/j.cmpb.2016.08.017
,2016, 'The Geneva Minimalistic Acoustic Parameter Set (GeMAPS) for Voice Research and Affective Computing', IEEE Transactions on Affective Computing, 7, pp. 190 - 202, http://dx.doi.org/10.1109/TAFFC.2015.2457417
,2015, 'Analysis of acoustic space variability in speech affected by depression', Speech Communication, 75, pp. 27 - 49, http://dx.doi.org/10.1016/j.specom.2015.09.003
,2015, 'Beyond Subjective Self-Rating: EEG Signal Classification of Cognitive Workload', IEEE Transactions on Autonomous Mental Development, 7, pp. 301 - 310, http://dx.doi.org/10.1109/TAMD.2015.2441960
,2015, 'A review of depression and suicide risk assessment using speech analysis', Speech Communication, 71, pp. 10 - 49, http://dx.doi.org/10.1016/j.specom.2015.03.004
,2015, 'Voice source under cognitive load: Effects and classification', Speech Communication, 72, pp. 74 - 95, http://dx.doi.org/10.1016/j.specom.2015.05.007
,2015, 'An investigation of supervector regression for forensic voice comparison on small data', Eurasip Journal on Audio, Speech, and Music Processing, 2015, pp. 1 - 15, http://dx.doi.org/10.1186/s13636-014-0048-z
,2014, 'Efficient and robust pupil size and blink estimation from near-field video sequences for human-machine interaction', IEEE Transactions on Cybernetics, 44, pp. 2356 - 2367, http://dx.doi.org/10.1109/TCYB.2014.2306916
,2014, 'Using task-induced pupil diameter and blink rate to infer cognitive load', Human-Computer Interaction, 29, pp. 390 - 413, http://dx.doi.org/10.1080/07370024.2014.892428
,2013, 'Estimating cognitive workload using wavelet entropy-based features during an arithmetic task', Computers in Biology and Medicine, 43, pp. 2186 - 2195, http://dx.doi.org/10.1016/j.compbiomed.2013.08.021
,2013, 'On the use of speech parameter contours for emotion recognition', Eurasip Journal on Audio, Speech, and Music Processing, 2013, http://dx.doi.org/10.1186/1687-4722-2013-19
,2013, 'Multimodal assistive technologies for depression diagnosis and monitoring', Journal on Multimodal User Interfaces, 7, pp. 217 - 228, http://dx.doi.org/10.1007/s12193-013-0123-2
,2013, 'Blinking: Toward wearable computing that understands your current task', IEEE Pervasive Computing, 12, pp. 56 - 65, http://dx.doi.org/10.1109/MPRV.2013.45
,2013, 'Characterising depressed speech for classification', Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, pp. 2534 - 2538
,2013, 'Automatic classification of eye activity for cognitive load measurement with emotion interference', Computer Methods and Programs in Biomedicine, 110, pp. 111 - 124, http://dx.doi.org/10.1016/j.cmpb.2012.10.021
,2013, 'Experimental evaluation of inverse filtering using physical systems with known glottal flow and tract characteristics', Journal of the Acoustical Society of America, 133, pp. EL358 - EL362, http://scitation.aip.org/getpdf/servlet/GetPDFServlet?filetype=pdf&id=JASMAN0001330000050EL358000001&idtype=cvips&prog=normal
,2013, 'I-Vector with sparse representation classification for speaker verification', Speech Communication, 55, pp. 707 - 720, http://dx.doi.org/10.1016/j.specom.2013.01.005
,