Posts by Collection

Published: September 01, 2022

My new publication “Pose Augmentation: Mirror the right way” is available in the proceedings of IVA ‘22. I will be presenting this work at the conference in Faro next week.

Published: October 01, 2022

A new publication “Arm Motion Symmetry In conversation” is available in the proceedings of Speech Communication, 144, 75-88.

Published: November 07, 2022

A new publication “UEA Digital Humans Entry to the GENEA Challenge 2022” is available in the proceedings of ICMI ‘22. I will be presenting this work remotely at the conference next week.

Published: May 30, 2023

Today I won runner-up in the Advanced Stage Category at UEAs PGR Day for my poster presenting “Style Conditioned Diffusion for Speech-To- Gesture Generation With Long-Term Context”. click here to see the poster!

Published: October 01, 2023

My new publication “The UEA Digital Humans Entry to the GENEA Challenge 2023” is available in the proceedings of ICMI ‘23. I will be presenting this work at the conference in Paris next week.

Published: October 16, 2024

My new publication “LLAniMAtion: LLAMA Driven Gesture Animation” is available in the Computer Graphics Forum journal. This is work I presented at the Symposium on Computer Animation in August.

Short description of portfolio item number 1

Short description of portfolio item number 2

Published in CVMP '21: European Conference on Visual Media Production, 2021

This paper introduces the Flow-VAE model for speech-driven gesture generation.

Recommended citation: Taylor, S., Windle, J., Greenwood, D., & Matthews, I. (2021, December). Speech-driven conversational agents using conditional flow-vaes. In Proceedings of the 18th ACM SIGGRAPH European Conference on Visual Media Production (pp. 1-9). https://dl.acm.org/doi/10.1145/3485441.3485647

Published in Computers & Security, 2022

This paper builds upon the notion of keystroke dynamics (the analysis of typing behaviours) to infer an anonymous user’s name and predict their native language.

Recommended citation: Buckley, O., Hodges, D., Windle, J., & Earl, S. (2022). CLICKA: Collecting and leveraging identity cues with keystroke dynamics. Computers & Security, 120, 102780. https://www.sciencedirect.com/science/article/pii/S0167404822001754

Published in IVA '22: Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, 2022

This paper investigates the effect of lateral mirroring as a means of data augmentation for 3D poses in multi-speaker, speech-to-motion modelling.

Recommended citation: Windle, J., Taylor, S., Greenwood, D., & Matthews, I. (2022, September). Pose augmentation: Mirror the right way. In Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents (pp. 1-3). https://dl.acm.org/doi/abs/10.1145/3514197.3549677

Published in Speech Communication, 2022

This paper reviews the motion symmetry of multiple speakers during dyadic conversation.

Recommended citation: Windle, J., Taylor, S., Greenwood, D., & Matthews, I. (2022). Arm motion symmetry in conversation. Speech Communication, 144, 75-88. https://www.sciencedirect.com/science/article/pii/S0167639322001054

Published in International Conference on Multimodal Interaction, 2022

This paper describes the UEA Digital Humans entry to the GENEA (Generation and Evaluation of Non-verbal Behaviour for Embodied Agents) challenge 2022

Recommended citation: Windle, J., Greenwood, D., & Taylor, S. (2022, November). UEA Digital Humans entry to the GENEA Challenge 2022. In Proceedings of the 2022 International Conference on Multimodal Interaction (pp. 771-777). https://dl.acm.org/doi/abs/10.1145/3536221.3558065

Published in International Conference on Multimodal Interaction, 2023

This paper adapts the Transformer-XL architecture for dyadic gesture generation by adding a cross-attention module that integrates the interlocutor’s speech with that of the main-agent.

Recommended citation: Windle, J., Matthews, I., Milner, B., & Taylor, S. (2023, October). The UEA Digital Humans entry to the GENEA Challenge 2023. In Proceedings of the 25th International Conference on Multimodal Interaction (pp. 802-810). https://dl.acm.org/doi/abs/10.1145/3577190.3616116

Published in Computer Graphics Forum, 2024

This paper experiments with using Large-Language Model (LLM) features for gesture generation that are extracted from text using Llama2.

Recommended citation: J. Windle, I. Matthews, and S. Taylor, “Llanimation: Llama driven gesture animation,” Computer Graphics Forum, vol. n/a, no. n/a, e15167, DOI: https://doi.org/10.1111/cgf.15167. eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.15167. https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.15167

Published: October 16, 2021

Presented initial findings for the “Motion Symmetry In Conversation” paper which was later published in Speech Communication. The presentation can be seen here.

Published: September 08, 2022

View the poster here!

Published: November 11, 2022

Presented two gesture-generation methods to the GENEA Challenge, discussed the results and observations. View the presentation here.

Published: May 27, 2023

Provided a guest lecture regarding the introduction to Artificial Intelligence for Software Developers and Executives.

Published: October 09, 2023

Presented a Cross-Attentive Transformer-XL model to the GENEA Challenge 2023, discussed the results and observations. View the presentation here.

Published: August 23, 2024

Presented the paper LLAniMAtion: LLAMA Driven Gesture Animation discussing the methood, results and observations. View the paper here.

Undergraduate and Postgraduate course, University of East Anglia, School of Computing Science, 2019

A module focused on AI and Machine Learning. Topics covered include state space representation and search algorithms, knowledge representation, natural language processing, chatbot, expert systems, Bayesian networks, Markov models, neural networks, and deep learning.

Undergraduate course, University of East Anglia, School of Computing Science, 2019

Topics covered include the organisation of system software and the underlying hardware architecture in modern computer systems, cover ARM Assembly language and C programming for OS scheduling and memory management.

Undergraduate and Postgraduate course, University of East Anglia, School of Computing Science, 2019

A module focused on taking computing power away from the desktop. Topics covered include Signal Processing, Machine Learning, Human Computer Interaction, Internet of Things, Networks, and the use of hardware.

Undergraduate course, University of East Anglia, School of Computing Science, 2022

Topics covered include design, analysis and implementation of algorithms and in the efficient implementation of a wide range of important data structures.

Undergraduate course, University of East Anglia, School of Computing Science, 2022

This module introduces essential features of object-oriented programming usinig Java as well as an introduction to Python.