Beyond research, I regularly spend time on photography (see the gallery below), playing hold'em (low stakes smasher), music (Erhu, Level 10 certification), and a variety of sports (e.g., basketball, skateboarding).
Open to Work! I am currently seeking full-time research opportunities in multimodal AI starting in 2026 and 2027.
Research Interests
My research focuses on multimodal AI—how we can build models that perceive,
ground, and reason over long, complex procedures with different modalities involved. I develop benchmarks that stress
advanced reasoning, grounding frameworks that align language with space-time, and
representation learning methods that scale robustly.
Video Spatial / Temporal Grounding Frameworks:Seq2Time(CVPR 2025),
MoRA(CVPR 2025) Mapping language to precise space-time segments with sequence-level localization.
[2023-07-02] One paper accepted by IEEE TCSVT 2023! Congrats to Shoubin and Zhongying!
[2023-03-13] One paper accepted by ICME 2023! Congrats to Wenke!
[2022-03-09] I will be joining UCF this summer as a CS PhD student with Dr. Chen Chen.
[2022-02-03] One paper accepted by CVPR 2022! Congrats to Xiaokang and Yake!
* equal contribution
Publications
SciVideoBench: Benchmarking Scientific Video Reasoning in Large Multimodal Models Andong Deng, Taojiannan Yang, Shoubin Yu, Lincoln Spencer, Mohit Bansal, Chen Chen, Serena Yeung-Levy, and Xiaohan Wang
ICML, 2026
Best Benchmark Paper@ICCV25-KnowledgeMR arxiv / project
We introduce SciVideoBench, the first scientific video reasoning benchmark!
Position: Video LLMs Must Not Ignore the Pixel Dynamics in Plain Sight
Shayda Moezzi, Umer Saleem, Andong Deng, Chen Chen, and Sarah Ostadabbas
ICML Position Track, 2026
arxiv (comming soon)
Video LLMs must not ignore the pixel dynamics in plain sight: models and benchmarks must make spatiotemporal evidence unavoidable, and must fail when motion and state transitions are ignored or contradicted.
VEBench: Benchmarking Large Multimodal Models for Real-World Video Editing Andong Deng, Dawei Du, Zhenfang Chen, Wen Zhong, Fan Chen, Guang Chen, Chia-Wen Kuo, Longyin Wen, Chen Chen, and Sijie Zhu
CVPR Findings, 2026
arxiv / project(coming soon)
We introduce VEBench, the first comprehensive benchmark designed to evaluate both editing knowledge understanding and operational reasoning in realistic video editing scenarios
AIR: Enabling Adaptive, Iterative, and Reasoning-based Frame Selection For Video Question Answering
Yuanhao Zou, Shengji Jin, Andong Deng, Youpeng Zhao, Jun Wang, and Chen Chen
ICLR, 2026
arxiv / project
We introduce AIR, a training-free approach for Adaptive, Iterative, and Reasoning-based frame selection!
Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding
Andong Deng, Zhongpai Gao, Anwesa Choudhuri, Benjamin Planche, Meng Zheng, Bin Wang, Terrence Chen, Chen Chen, Ziyan Wu
CVPR, 2025
arxiv / pdf
We present Seq2Time, a data-oriented method to enhance the time perception ability of video LLMs.
Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Level
Andong Deng, Tongjia Chen, Shoubin Yu, Taojiannan Yang, Lincoln Spencer, Yapeng Tian, Ajmal Saeed Mian, Mohit Bansal and Chen Chen
CVPR, 2025
arxiv / project
We present GroundMoRe, a new benchmark for novel Motion-Grounded Video Reasoning; and MoRA, a video LLM that is able to reason and perceive motion at the pixel level.
Sports-QA: A Large-Scale Video Question Answering Benchmark for Complex and Professional Sports
Haopeng Li, Andong Deng, Qiuhong Ke, Jun Liu, Hossein Rahmani, Yulan Guo, Bernt Schiele and Chen Chen
International Journal of Computer Vision, 2026
arxiv / code
In this paper, we introduce Sports-QA, the first dataset specifically designed for the sports-related VideoQA task.
Order-aware Interactive Segmentation
Bin Wang, Anwesa Choudhuri, Meng Zheng, Zhongpai Gao, Benjamin Planche, Andong Deng, Qin Liu, Terrence Chen, Ulas Bagci and Ziyan Wu.
ICLR, 2025
arxiv / project
We propose OIS: order-aware interactive segmentation, to explicitly integrate missing relative depth information into 2D interactive segmentation.
A Large-scale Study of Spatiotemporal Representation Learning with a New Benchmark on Action Recognition Andong Deng*, Taojiannan Yang*, and Chen Chen
ICCV, 2023
arxiv / code / CVF / Supp
We introduce BEAR, a new BEnchmark on video Action Recognition. BEAR is a collection of 18 video datasets grouped into 5 categories, which covers a diverse set of real-world applications.
Towards Inadequately Pre-trained Models in Transfer Learning Andong Deng*, Xingjian Li*, Di Hu, Tianyang Wang, Haoyi Xiong and Chengzhong Xu
ICCV, 2023
arxiv / CVF / Supp
Inadequately pre-trained models often extract better features than fully pre-trained ones. And deep models tend to first learn spectral components corresponding to large singular values.
Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detection
Shoubin Yu, Zhongying Zhao, Haoshu Fang, Andong Deng, Haisheng Su, Dongliang Wang, Weihao Gan, Cewu Lu and Wei Wu
IEEE Transactions on Circuits and Systems for Video Technology, 2022
arxiv
A motion prior distribution is utilized to construct the pose representation. MoPRL achieves the state-of-the-art performance by an average improvement of 4.7% AUC on several challenging datasets.
Robust Cross-Modal Knowledge Distillation for Unconstrained Videos
Wenke Xia, Xingjian Li, Andong Deng, Haoyi Xiong, Dejing Dou, and Di Hu
ICME, 2023
arxiv
We propose a Modality Noise Filter module to erase the irrelevant noise in teacher modality with cross-modal context and design a Contrastive Semantic Calibration module to adaptively distill useful knowledge for target modality, by referring to the differentiated sample-wise semantic correlation in a contrastive fashion.
Balanced Multimodal Learning via On-the-fly Gradient Modulation
Xiaokang Peng*, Yake Wei*, Andong Deng, Dong Wang and Di Hu
CVPR, 2022   (Oral Presentation) arxiv / CVF / code
Modulate gradients of two modalities to adaptively balance the optimization process of multimodal learning.
Education
University of Central FloridaPh.D.Orlando, FL, USA2022.08–Now