me3

Lingyun Yu

name

[Google Scholar]
Associate Researcher
University of Science and Technology of China
Email:            yuly@ustc.edu.cn
Address:        Gaoxin Campus USTC, Fuxing Road, Hefei, Anhui, 230000, P. R. China



      My research interests span Talking face generation, Face forgery detection, Multi-modal learning, Articulatory movements-driven 3D Talking Head, Human-Computer Interaction and Video synthesis.

  News!

 2022/11   One Journal paper accepted by T-Web!
 2022/05   Two Regular papers accepted by ACM MM!
 2022/01   Regular papers accepted by IJIS and ACM T-IST!
 2021/09   Receive a funding support from the Hefei Postdoctoral Research Activities Foundation!
 2021/09   One regular paper accepted by IEEE Transactions on Knowledge and Data Engineering (Impact Factor 6.977)!
 2021/06   One regular paper accepted by IEEE Transactions on Multimedia (Impact Factor 6.513)!
 2021/03   One regular paper accepted by Pattern Recognition (Impact Factor 7.74)!
 2020/02   One Journal paper accepted by IEEE Transactions on on Circuits and Systems for Video Technology (Impact Factor 4.685)!

  Work Experience

2022/10-present
Associate Researcher
University of Science and Technology of China

2020/08-2022/09
Associate Researcher
Hefei comprehensive national science center

2020/08-2022/09
Postdoctor
University of Science and Technology of China

  Education

2020/01-2020/04
Visiting Student
the University of Sydney, Australia (USYD)

2015/09-2020/07
Doctor of Control Science and Engineering
University of Science and Technology of China (USTC)

2011/09-2015/06
Bachelor of Electrical Engineering and Automation
China University of Mining and Technology (CUMT)

  Publications

Constructing Spatio-Temporal Graphs for Face Forgery Detection
Zhihua Shang, Hongtao Xie, Lingyun Yu*, Zhengjun Zha, and Yongdong Zhang.
ACM T-Web 

Wavelet-enhanced Weakly Supervised Local Feature Learning for Face Forgery Detection.
Li, Jiaming, Hongtao Xie, Lingyun Yu, and Yongdong Zhang.
ACM MM2022 

REMOT: A Region-to-Whole Framework for Realistic Human Motion Transfer.
Yang, Quanwei, Xinchen Liu, Wu Liu, Hongtao Xie, Xiaoyan Gu, Lingyun Yu, and Yongdong Zhang.
ACM MM2022 

Attention-Guided Transformation-Invariant Attack for Black-Box Adversarial Examples
Jiaqi Zhu, Feng Dai, Lingyun Yu, HongtaoXie*, Lidong Wang, Bo Wu, Yongdong Zhang.
International Journal of Intelligent Systems 

Dynamic-aware Federated Learning for Face Forgery Video Detection
Ziheng Hu, Hongtao Xie*, Lingyun Yu, Xingyu Gao*, Zhihua Shang, Yongdong Zhang.
ACM Transactions on Intelligent Systems and Technology 

Discriminative Feature Mining Based on Frequency Information and Metric Learning for Face Forgery Detection
Jiaming Li, Hongtao Xie, Lingyun Yu, Xingyu Gao and Yongdong Zhang.
IEEE Transactions on Knowledge and Data Engineering 

Multimodal Learning for Temporally Coherent Talking Face Generation with Articulator Synergy
Lingyun Yu, Hongtao Xie and Yongdong Zhang.
IEEE Transactions on Multimedia 

PRRNet: Pixel-Region relation network for face forgery detection
Shang, Zhihua, Hongtao Xie, Zhengjun Zha, Lingyun Yu, Yan Li, and Yongdong Zhang.
Pattern Recognition 

Multimodal Inputs Driven Talking Face Generation With Spatial-Temporal Dependency
Lingyun Yu, Jun Yu, Mengyan Li and Qiang Ling.
IEEE Transactions on Circuits and Systems for Video Technology 

Mining Audio, Text and Visual information for Talking face generation
Lingyun Yu, Jun Yu
IEEE International Conference on Data Mining (ICDM) 2019 (Regular paper: 9.08% acceptance rate)

BLTRCNN Based 3D Articulatory Movement Prediction: Learning Articulatory Synchronicity From Both Text and Audio Inputs
Lingyun Yu, Jun Yu, and Qiang Ling.
IEEE Transactions on Multimedia

A realistic 3D articulatory animation system for emotional visual pronunciation
Lingyun Yu, Jun Yu
Multimedia Tools and Applications

Deep Neural Network Based 3D Articulatory Movement Prediction Using Both Text and Audio Inputs
Lingyun Yu, Jun Yu, Ling Qiang
International Conference on Multimedia Modeling

Synthesizing 3D Acoustic-Articulatory Mapping Trajectories: Predicting Articulatory Movements by Long-Term Recurrent Convolutional Neural Network.
Lingyun Yu, Jun Yu, Ling Qiang 
IEEE International Conference on Visual Communications and Image Processing (VCIP)

An Emotional Text-Driven 3D Visual Pronunciation System for Mandarin Chinese
Lingyun Yu, Changwei Luo, Jun Yu
Chinese Conference on Pattern Recognition (CCPR)

Synthesizing Photo-Realistic 3D Talking Head: Learning Lip Synchronicity and Emotion from Audio and Video
Jun Yun, Lingyun Yu
IEEE International Conference on Image Processing (ICIP)

Beauty Product Retrieval Based on Regional Maximum Activation of Convolutions with Generalized Attention.
Yu, Jun, Guochen Xie, Mengyan Li, Haonian Xie, and Lingyun Yu.
ACM MM 2019

Bidirectional Attention-Recognition Model for Fine-grained Object Classification
Liu, Chuanbin, Hongtao Xie, Zhengjun Zha, Lingyun Yu, Zhineng Chen, and Yongdong Zhang.
IEEE Transactions on Multimedia

Filtration and Distillation: Enhancing Region Attention for Fine-Grained Visual Categorization
Chuanbin Liu, Hongtao Xie, Zhengyun Zha,Lingfeng Ma, Lingyun Yu,Yongdong Zhang.
The Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI-20)

  Awards

2022/10 荣获第二届广播电视和网络视听人工智能应用创新大赛的创新项目优秀奖,http://www.nrta.gov.cn/art/2022/11/1/art_113_62625.html

2020/05 Excellent graduates, USTC

2019/12 Travel Award, 2019 IEEE International Conference on Data Mining

2019/10 Suzhou Industrial Park Scholarship, USTC

2019/07 1st place, ACMMultimedia "AI Meets Beauty" challenge

2017/11 Travel Award, 2017 IEEE International Conference on Visual Communications and Image Processing

2017/09 National Scholarships, USTC

2015/05 Excellent graduates, CUMT

2014/10 Exam-Free Postgraduate to USTC

  Fundation

2021/09 Hefei Postdoctoral Research Activities Foundation

2021/08 National Nature Science Foundation of China, 62102127

2020/10 China Postdoctoral Science Foundation, 2020M682035

2020/12 Anhui Postdoctoral Research Activities Foundation, 2020B436

  Professional Activities

Reviewer: IEEE Transactions on Multimedia; Speech Communication; ACM Transactions on Multimedia Computing, Communications, and Applications; Frontiers in Psychology; IEEE/ACM Transactions on Audio, Speech and Language Processing; Security and Communication Networks