Dr Shanxin Yuan

Queen Mary University of London

Dr  Shanxin Yuan is a Lecturer in Digital Environment at Queen Mary  University of London. He has rich expertise in deep learning, low level  computer vision, and 3D digital modelling of humans from photographs.  His PhD thesis focused on 3D hand pose estimation, his work is well  recognized in the academia and is also deployed into commercially  launched mass market mobile phones. His current research on digital  humans focuses reconstructing, modelling, and rendering digital twins.  He is interested in super-realistic immersive gaming, body/hand pose and  facial expression retargeting, and behaviour analysis with avatars.

For the new project in 2023, we are interested in working on human  facial expression estimation, high-res realistic face reconstruction and  rendering, face re-enactment, and face augmentation. The aim of the  project is to build an editable super-realistic 3D human face model that  can express novel expressions, views, shapes, and appearance, from  multiple sources of input, such as images, sounds, and key points. The  related techniques include deep learning, computer vision, natural  language processing, and neural rendering.