Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

news

New Publication! Permalink

Published:

My new publication “Pose Augmentation: Mirror the right way” is available in the proceedings of IVA ‘22. I will be presenting this work at the conference in Faro next week.

New Publication! Permalink

Published:

A new publication “Arm Motion Symmetry In conversation” is available in the proceedings of Speech Communication, 144, 75-88.

New Publication! Permalink

Published:

A new publication “UEA Digital Humans Entry to the GENEA Challenge 2022” is available in the proceedings of ICMI ‘22. I will be presenting this work remotely at the conference next week.

PGR Day Runner-Up

Published:

Today I won runner-up in the Advanced Stage Category at UEAs PGR Day for my poster presenting “Style Conditioned Diffusion for Speech-To- Gesture Generation With Long-Term Context”. click here to see the poster!

New Publication! Permalink

Published:

My new publication “The UEA Digital Humans Entry to the GENEA Challenge 2023” is available in the proceedings of ICMI ‘23. I will be presenting this work at the conference in Paris next week.

New Publication! Permalink

Published:

My new publication “LLAniMAtion: LLAMA Driven Gesture Animation” is available in the Computer Graphics Forum journal. This is work I presented at the Symposium on Computer Animation in August.

portfolio

publications

Speech-Driven Conversational Agents using Conditional Flow-VAE

Published in CVMP '21: European Conference on Visual Media Production, 2021

This paper introduces the Flow-VAE model for speech-driven gesture generation.

Recommended citation: Taylor, S., Windle, J., Greenwood, D., & Matthews, I. (2021, December). Speech-driven conversational agents using conditional flow-vaes. In Proceedings of the 18th ACM SIGGRAPH European Conference on Visual Media Production (pp. 1-9). https://dl.acm.org/doi/10.1145/3485441.3485647

CLICKA: Collecting and leveraging identity cues with keystroke dynamics

Published in Computers & Security, 2022

This paper builds upon the notion of keystroke dynamics (the analysis of typing behaviours) to infer an anonymous user’s name and predict their native language.

Recommended citation: Buckley, O., Hodges, D., Windle, J., & Earl, S. (2022). CLICKA: Collecting and leveraging identity cues with keystroke dynamics. Computers & Security, 120, 102780. https://www.sciencedirect.com/science/article/pii/S0167404822001754

Pose augmentation: Mirror the right way

Published in IVA '22: Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents, 2022

This paper investigates the effect of lateral mirroring as a means of data augmentation for 3D poses in multi-speaker, speech-to-motion modelling.

Recommended citation: Windle, J., Taylor, S., Greenwood, D., & Matthews, I. (2022, September). Pose augmentation: Mirror the right way. In Proceedings of the 22nd ACM International Conference on Intelligent Virtual Agents (pp. 1-3). https://dl.acm.org/doi/abs/10.1145/3514197.3549677

UEA Digital Humans entry to the GENEA Challenge 2022

Published in International Conference on Multimodal Interaction, 2022

This paper describes the UEA Digital Humans entry to the GENEA (Generation and Evaluation of Non-verbal Behaviour for Embodied Agents) challenge 2022

Recommended citation: Windle, J., Greenwood, D., & Taylor, S. (2022, November). UEA Digital Humans entry to the GENEA Challenge 2022. In Proceedings of the 2022 International Conference on Multimodal Interaction (pp. 771-777). https://dl.acm.org/doi/abs/10.1145/3536221.3558065

The UEA Digital Humans entry to the GENEA Challenge 2023

Published in International Conference on Multimodal Interaction, 2023

This paper adapts the Transformer-XL architecture for dyadic gesture generation by adding a cross-attention module that integrates the interlocutor’s speech with that of the main-agent.

Recommended citation: Windle, J., Matthews, I., Milner, B., & Taylor, S. (2023, October). The UEA Digital Humans entry to the GENEA Challenge 2023. In Proceedings of the 25th International Conference on Multimodal Interaction (pp. 802-810). https://dl.acm.org/doi/abs/10.1145/3577190.3616116

LLAniMAtion: LLAMA Driven Gesture Animation

Published in Computer Graphics Forum, 2024

This paper experiments with using Large-Language Model (LLM) features for gesture generation that are extracted from text using Llama2.

Recommended citation: J. Windle, I. Matthews, and S. Taylor, “Llanimation: Llama driven gesture animation,” Computer Graphics Forum, vol. n/a, no. n/a, e15167, DOI: https://doi.org/10.1111/cgf.15167. eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.15167. https://onlinelibrary.wiley.com/doi/pdf/10.1111/cgf.15167

talks

Motion Symmetry In Conversation

Published:

Presented initial findings for the “Motion Symmetry In Conversation” paper which was later published in Speech Communication. The presentation can be seen here.

Intoroduction to AI

Published:

Provided a guest lecture regarding the introduction to Artificial Intelligence for Software Developers and Executives.

teaching

Artificial Intelligence

Undergraduate and Postgraduate course, University of East Anglia, School of Computing Science, 2019

A module focused on AI and Machine Learning. Topics covered include state space representation and search algorithms, knowledge representation, natural language processing, chatbot, expert systems, Bayesian networks, Markov models, neural networks, and deep learning.

Architectures and Operating Systems

Undergraduate course, University of East Anglia, School of Computing Science, 2019

Topics covered include the organisation of system software and the underlying hardware architecture in modern computer systems, cover ARM Assembly language and C programming for OS scheduling and memory management.

Ubiquitous Computing

Undergraduate and Postgraduate course, University of East Anglia, School of Computing Science, 2019

A module focused on taking computing power away from the desktop. Topics covered include Signal Processing, Machine Learning, Human Computer Interaction, Internet of Things, Networks, and the use of hardware.

Data Structures and Algorithms

Undergraduate course, University of East Anglia, School of Computing Science, 2022

Topics covered include design, analysis and implementation of algorithms and in the efficient implementation of a wide range of important data structures.

Programming 1

Undergraduate course, University of East Anglia, School of Computing Science, 2022

This module introduces essential features of object-oriented programming usinig Java as well as an introduction to Python.