Select Publications
Books
2016, Computational Models of Motivation for Game-Playing Agents, Springer International Publishing, http://dx.doi.org/10.1007/978-3-319-33459-2
,2009, Motivated Reinforcement Learning: Curious Characters for Multiuser Games, Springer Verlag, Berlin, http://dx.doi.org/10.1007/978-3-540-89187-1
,Book Chapters
2022, 'Design and Validation of a Mini-Game for Player Motive Profiling', in Women in Computational Intelligence: Key Advances and Perspectives on Emerging Topics, Springer, pp. 103 - 129, http://dx.doi.org/10.1007/978-3-030-79092-9_5
,2022, 'Chapter 8 Tuning swarm behavior for environmental sensing tasks represented as coverage problems', in Artificial Intelligence and Data Science in Environmental Sensing, Elsevier, pp. 155 - 178, http://dx.doi.org/10.1016/b978-0-323-90508-4.00001-0
,2021, 'Human Performance Operating Picture for Shepherding a Swarm of Autonomous Vehicles', in Shepherding UxVs for Human-Swarm Teaming An Artificial Intelligence Approach to Unmanned X Vehicles, Springer Nature, pp. 293 - 323, http://dx.doi.org/10.1007/978-3-030-60898-9_13
,2021, 'Transparent Shepherding: A Rule-Based Learning Shepherd for Human Swarm Teaming', in Shepherding UxVs for Human-Swarm Teaming An Artificial Intelligence Approach to Unmanned X Vehicles, Springer Nature, pp. 267 - 292, http://dx.doi.org/10.1007/978-3-030-60898-9_12
,2021, 'Logical Shepherd Assisting Air Traffic Controllers for Swarm UAV Traffic Control Systems', in Abbass H; Robert H (ed.), Shepherding UxVs for Human-Swarm Teaming: An Artificial Intelligence Approach to Unmanned X Vehicles, Springer International Publishing, pp. 245 - 263, http://dx.doi.org/10.1007/978-3-030-60898-9_11
,2021, 'Tuning Swarm Behaviour for Environmental Sensing Tasks Represented as Coverage Problems', in Artificial Intelligence and Data Science in Environmental Sensing, Elsevier, pp. 155 - 178, http://dx.doi.org/10.1016/B978-0-323-90508-4.00001-0
,2017, 'Computational Motivation, Autonomy and Trustworthiness: Can We Have It All?', in Foundations of Trusted Autonomy, Springer, pp. 293 - 316, http://dx.doi.org/10.1007/978-3-319-64816-3_16
,2013, 'Novelty and beyond: Towards combined motivation models and integrated learning architectures', in Baldassarre G; Mirolli M (ed.), Intrinsically Motivated Learning in Natural and Artificial Systems, Springer Verlag, pp. 209 - 233, http://dx.doi.org/10.1007/978-3-642-32375-1_9
,2012, 'Agent Based Intrinsically Motivated Intelligent Environments', in Yang L; Syukur E; Loke S (ed.), Handbook on Mobile and Ubiquitous Computing Status and Perspective, CRC Press, https://www.crcpress.com/Handbook-on-Mobile-and-Ubiquitous-Computing-Status-and-Perspective/Yang-Syukur-W-Loke/9781439848111
,2011, 'A Pedagogical Approach to Exploring Place and Interaction Design in Collaborative Virtual Environments', in Wang X; Tsai JJH (ed.), Collaborative Design in Virtual Environments, Springer Verlag, pp. 111 - 120, http://dx.doi.org/10.1007/978-94-007-0605-7_10
,Journal articles
2025, 'Competence Awareness for Humans and Machines: A Survey and Future Research Directions from Psychology', ACM Computing Surveys, 57, pp. 1 - 26, http://dx.doi.org/10.1145/3689626
,2025, 'Optimizing and predicting swarming collective motion performance for coverage problems solving: A simulation-optimization approach', Engineering Applications of Artificial Intelligence, 139, http://dx.doi.org/10.1016/j.engappai.2024.109522
,2024, 'Swarm Robotics: A Survey from a Multi-Tasking Perspective', ACM Computing Surveys, 56, pp. 1 - 38, http://dx.doi.org/10.1145/3611652
,2024, 'A Taxonomy-Based Survey of EM-SCA and Implications for Multi-Robot Systems', IEEE Open Journal of the Computer Society, 5, pp. 511 - 529, http://dx.doi.org/10.1109/OJCS.2024.3461808
,2024, 'Active Sensing Strategy: Multi-Modal, Multi-Robot Source Localization and Mapping in Real-World Settings With Fixed One-Way Switching', Journal of Field Robotics, http://dx.doi.org/10.1002/rob.22441
,2023, 'Coverage Path Planning With Budget Constraints for Multiple Unmanned Ground Vehicles', IEEE Transactions on Intelligent Transportation Systems, 24, pp. 12506 - 12522, http://dx.doi.org/10.1109/TITS.2023.3285624
,2023, 'Guest Editorial Special Issue on Intrinsically Motivated Open-Ended Learning (IMOL)', IEEE Transactions on Cognitive and Developmental Systems, 15, pp. 321 - 324, http://dx.doi.org/10.1109/TCDS.2023.3276597
,2023, 'Dynamic Frontier-Led Swarming: Multi-Robot Repeated Coverage in Dynamic Environments', IEEE/CAA Journal of Automatica Sinica, 10, pp. 646 - 661, http://dx.doi.org/10.1109/JAS.2023.123087
,2023, 'Multi-gas source localization and mapping by flocking robots', Information Fusion, 91, pp. 665 - 680, http://dx.doi.org/10.1016/j.inffus.2022.11.001
,2023, 'Iterative transfer learning for automatic collective motion tuning on multiple robot platforms', Frontiers in Neurorobotics, 17, pp. 1113991, http://dx.doi.org/10.3389/fnbot.2023.1113991
,2023, 'Motion Behaviour Recognition Dataset Collected from Human Perception of Collective Motion', Data in Brief, 47, pp. 108976, http://dx.doi.org/10.1016/j.dib.2023.108976
,2022, 'Grammar-based autonomous discovery of abstractions for evolution of complex multi-agent behaviours', Swarm and Evolutionary Computation, 73, http://dx.doi.org/10.1016/j.swevo.2022.101106
,2022, 'Automatic Collective Motion Tuning using Actor-Critic Deep Reinforcement Learning', Swarm and Evolutionary Computation, 72, pp. 101085, http://dx.doi.org/10.1016/j.swevo.2022.101085
,2022, 'Concurrent Skill Composition using Ensemble of Primitive Skills', IEEE Transactions on Cognitive and Developmental Systems
,2022, 'Frontier Led Swarming: Robust Multi-robot coverage of Unknown Environments', Swarm and Evolutionary Computation, 75, pp. 101171, http://dx.doi.org/10.1016/j.swevo.2022.101171
,2021, 'Novel binary differential evolution algorithm for knapsack problems', Information Sciences, 542, pp. 177 - 194, http://dx.doi.org/10.1016/j.ins.2020.07.013
,2021, 'A Novel Trust Architecture Integrating Differentiated Trust and Response Strategies for a Team of Agents', International Journal of Intelligent Systems, 36, pp. 7017 - 7052, http://dx.doi.org/10.1002/int.22578
,2021, 'Assessing Player Profiles of Achievement, Affiliation and Power Motivation using Electroencephalography', IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 52, pp. 3648 - 3658, http://dx.doi.org/10.1109/TSMC.2021.3073216
,2021, 'Autonomous recommender system for reconnaissance tasks using a swarm of UAVs and asynchronous shepherding', Human-Intelligent Systems Integration, 3, pp. 175 - 186, http://dx.doi.org/10.1007/s42454-020-00024-w
,2021, 'Exploiting Abstractions for Grammar-Based Learning of Complex Multi-Agent Behaviours', International Journal of Intelligent Systems, 36, pp. 6273 - 6311, http://dx.doi.org/10.1002/int.22550
,2021, 'Grammar-Based Cooperative Learning for Evolving Collective Behaviours in Multi-Agent Systems', Swarm and Evolutionary Computation, 69, pp. 101017, http://dx.doi.org/10.1016/j.swevo.2021.101017
,2021, 'On the channel density of EEG signals for reliable biometric recognition', Pattern Recognition Letters, 147, http://dx.doi.org/10.1016/j.patrec.2021.04.003
,2021, 'Weighted Gate Layer Autoencoders', IEEE Transactions on Cybernetics, 52, pp. 7242 - 7253, http://dx.doi.org/10.1109/TCYB.2021.3049583
,2020, 'Q-Learning with Differential Entropy of Q-Tables', , http://arxiv.org/abs/2006.14795v1
,2020, 'Continuous Deep Hierarchical Reinforcement Learning for Ground-Air Swarm Shepherding', , http://arxiv.org/abs/2004.11543v4
,2020, 'Towards Interpretable ANNs: An Exact Transformation to Multi-Class Multivariate Decision Trees', , http://arxiv.org/abs/2003.04675v4
,2020, 'Electroencephalographic Workload Indicators During Teleoperation of an Unmanned Aerial Vehicle Shepherding a Swarm of Unmanned Ground Vehicles in Contested Environments', Frontiers in Neuroscience, 14, http://dx.doi.org/10.3389/fnins.2020.00040
,2020, 'A Novel Design of Differential Evolution for Solving Discrete Traveling Salesman Problems', Swarm and Evolutionary Computation, 52
,2020, 'Autonomous Detection of Collective Behaviours in Swarms', Swarm and Evolutionary Computation, 57, pp. 100715, http://dx.doi.org/10.1016/j.swevo.2020.100715
,2019, 'A novel differential evolution mapping technique for generic combinatorial optimization problems', Applied Soft Computing Journal, 80, pp. 297 - 309, http://dx.doi.org/10.1016/j.asoc.2019.04.017
,2019, 'A Robust Policy Bootstrapping Algorithm for Multi-objective Reinforcement Learning in Non-stationary Environments', Adaptive Behavior, 28, pp. 273 - 292, http://dx.doi.org/10.1177/1059712319869313
,2019, 'Building girls' confidence in themselves as future engineers', Teaching Science, 65, pp. 10 - 18
,2019, 'Intrinsically Motivated Hierarchical Policy Learning in Multi-objective Markov Decision Processes', IEEE Transactions on Cognitive and Developmental Systems, Special Issue on Continual Unsupervised Sensorimotor Learning, 13, pp. 262 - 273, http://dx.doi.org/10.1109/TCDS.2019.2948025
,2019, 'Multi-Modal Fusion for Objective Assessment of Cognitive Workload: A Review', IEEE Transactions on Cybernetics, 51, pp. 1542 - 1555, http://dx.doi.org/10.1109/TCYB.2019.2939399
,2019, 'Open-Ended Continuous Learning of Compound Goals', IEEE Transactions on Cognitive and Developmental Systems, Special Issue on Continual Unsupervised Sensorimotor Learning, http://dx.doi.org/10.1109/TCDS.2019.2947896
,2018, 'Assessing Human Judgement of Computationally Generated Swarming', Frontiers Robotics and AI
,2018, 'Evolving Robust Policy Coverage Sets in Multi-objective Markov Decision Processes Through Intrinsically Motivated Self-play', Frontiers in Neurorobotics
,2018, 'Hierarchical Deep Reinforcement Learning for Continuous Action Control', IEEE Transactions on Neural Networks and Learning Systems, 29, pp. 5174 - 5184, http://dx.doi.org/10.1109/TNNLS.2018.2805379
,