Jian-Fang Hu

Email: hujf5@mail.sysu.edu.cn
Address: Room 301, Building 571, No. 135, XinGangXi Road

Short Bio
I have joined Sun Yat-sen University, China as an Associate Professor, working closely with Prof. Wei-Shi Zheng and Prof. Jianhuang Lai. Before that, I obtained my PhD degree from the School of Mathematics, Sun Yat-sen University in December, 2016. I have also worked as a visiting student in Prof. Gang Wang's group at Nanyang Technological University, Singapore, from Sep. 2015 to Sep. 2016. My research interests are in computer vision and applied machine learning. Specifically, I mainly conduct reseaches on action/activity recognition and action/activity prediction. Recently, I also work on developing deep models for segmenting action objects, collaborating with Dr. Bing Shuai (Amazon, Seattle). I also work closely with Prof. Jianguo Zhang (University of Dundee, United Kingdom) for human action modelling.

研究组招研究生和本科生,研究方向包括:多模态视频-文本理解,3D运动生成与预测,大模型高效微调,可控视频编辑与生成,视频跨学科交叉研究等。

欢迎对计算机视觉研究感兴趣且能坚持投入时间和精力的同学联系!

研究组有2025年9月入学的直博名额,欢迎联系,hujf5@mail.sysu.edu.cn

Selected Publications
(*) indicates corresponding author (指导学生研究)
Chaolei Tan, Zihang Lin, Junfu Pu, Zhongang Qi, Wei-Yi Pei, Zhi Qu, Yexin Wang, Ying Shan, Wei-Shi Zheng, Jian-Fang Hu*, "SynopGround: A Large-Scale Dataset for Multi-Paragraph Video Grounding from TV Dramas and Synopses", ACM Multimedia (ACM MM), 2024.
Xiaotong Lin, Tianming Liang, Jianhuang Lai, and Jian-Fang Hu*,"Progressive Pretext Task Learning for Human Trajectory Prediction",European Conference on Computer Vision (ECCV), 2024.
Tianming Liang, Chaolei Tan, Beihao Xia, Wei-Shi Zheng, Jian-Fang Hu*, "Ranking Distillation for Open-Ended Video Question Answering with Insufficient Labels",IEEE Computer Vision and Pattern Recognition (CVPR), 2024.
Chaolei Tan, Jianhuang Lai, Wei-Shi Zheng, Jian-Fang Hu*, "Siamese Learning with Joint Alignment and Regression for Weakly-Supervised Video Paragraph Grounding",IEEE Computer Vision and Pattern Recognition (CVPR), 2024.
Dian Zheng, Xiao-Ming Wu, Shu-Zhou Yang, Jian Zhang, Jian-Fang Hu, Wei-Shi Zheng. Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Jianwei Tang, Jiangxin Sun, Xiaotong Lin, Lifang Zhang, Wei-Shi Zheng, Jian-Fang Hu*, "Temporal Continual Learning with Prior Compensation for Human Motion Prediction", Conference on Neural Information Processing Systems (NeurIPS), 2023.
Zihang Lin, Chaolei Tan, Jian-Fang Hu*, Zhi Jin, Tiancai Ye, and Wei-Shi Zheng, "Collaborative Static and Dynamic Vision-Language Streams for Spatio-Temporal Video Grounding", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. (Winner of Person In Context Challenge ACMM Workshop 2022)
Chaolei Tan, Zihang Lin, Jian-Fang Hu*, Wei-Shi Zheng, and Jianhuang Lai, "Hierarchical Semantic Correspondence Networks for Video Paragraph Grounding", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Jiangxin Sun, Chunyu Wang, Huang Hu, Hanjiang Lai, Zhi Jin, Jian-Fang Hu*,"You Never Stop Dancing: Non-freezing Dance Generation via Bank-constrained Manifold Projection", Conference and Workshop on Neural Information Processing Systems (NeurIPS), 2022.
Jiangxin Sun, Zihang Lin, Xintong Han, Jian-Fang Hu*, Jia Xu, Wei-Shi Zheng, "Action-guided 3D Human Motion Prediction", Conference and Workshop on Neural Information Processing Systems (NeurIPS), 2021.
DSD
Jian-Fang Hu#, Jiangxin Sun#, Zihang Lin, Jianhuang Lai, Wenjun Zeng, and Wei-Shi Zheng, "APANet: Auto-Path Aggregation for Future Instance Segmentation Prediction", IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI), 44 (7), 3386-3403, 2022. PDF, Supp, Link.
DSD
Jian-Fang Hu, Wei-Shi Zheng, Lianyang Ma, Gang Wang, Jianhuang Lai, and Jianguo Zhang, "Early Action Prediction by Soft Regression", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 41 (11), 2568-2583, 2019. PDF, SUPP-PDF
Jian-Fang Hu, Wei-Shi Zheng, Jianhuang Lai, and Jianguo Zhang, "Jointly Learning Heterogeneous Features for RGB-D Activity Recognition", IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 39 (11), 2186-2200, 2017. PDF SUPP-PDF Codes & SYSU 3D HOI Set & Demo
Zihang Lin#, Jiangxin Sun#, Jian-Fang Hu(*), Qizhi Yu, Jianhuang Lai, Wei-Shi Zheng, "Predictive Feature Learning for Future Segmentation Prediction", International Conference on Computer Vision (ICCV) 2021. PDF, SUPP-PDF
Xionghui Wang, Jian-Fang Hu (*) , Jianhuang Lai, Jianguo Zhang, and Wei-Shi Zheng, "Progressive Teacher-student Learning for Early Action Prediction", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019. PDF
ddd
Guoliang Pang , Xionghui Wang, Jian-Fang Hu (*), Qing Zhang, and Wei-Shi Zheng, DBDNet: Learning Bi-directional Dynamics for Early Action Prediction, International Joint Conference on Artificial Intelligence (IJCAI), 2019. PDF
ddd
Jian-Fang Hu, Wei-Shi Zheng, Jiahui Pan, Jianhuang Lai, and Jianguo Zhang, "Deep Bilinear Learning for RGB-D Action Recognition", European Conference on Computer Vision (ECCV), 2018. PDF
ddd
Jiafeng Xie, Bing Shuai, Jian-Fang Hu (*), Jingyang Lin, and Wei-Shi Zheng, "Improving Fast Segmentation with Teacher-student Learning", British Machine Vision Conference (BMVC), 2018. PDF
ddd
Shaofan Lai, Wei-Shi Zheng, Jian-Fang Hu, and Jianguo Zhang, "Global-Local Temporal Saliency Action Prediction", IEEE Transaction on Image Processing (TIP), 27(5), 2272-2285, 2018.
Jiachi He, Jian-Fang Hu, Xi Lu, Wei-Shi Zheng, "Multi-Task Mid-Level Feature Learning for Micro-Expression Recognition", Pattern Recognition (PR), 66 (6), 44-52, 2017.
DDS
Jian-Fang Hu, Wei-Shi Zheng, Xiaohua Xie, and Jianhuang Lai, "Sparse Transfer for Facial Shape-from-Shading", Pattern Recognition (PR), 68(8), 272-285, 2017. pdf
Jian-Fang Hu, Wei-Shi Zheng, Lianyang Ma, Gang Wang, and Jianhuang Lai, "Real-time RGB-D Activity Prediction by Soft Regression", European Conference on Computer Vision (ECCV), 280-296, 2016. pdf. Prediction Results

Zhaoze Zhou, Wei-Shi Zheng, Jian-Fang Hu, Yong Xu, Jane You, " One-pass Online Learning: A Local Approach", Pattern Recognition (PR), 51, 346-357, 2016. pdfcode.

Jian-Fang Hu, Wei-Shi Zheng, Jianhuang Lai, and Jianguo Zhang, "Jointly Learning Heterogeneous Features for RGB-D Activity Recognition", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 5344-5352, 2015pdf

Jian-Fang Hu, Wei-Shi Zheng, Jianhuang Lai, Shaogang Gong, and Tao Xiang, "Exemplar-based Recognition of Human-Object Interactions", IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 26(4), 647-660, 2016. pdf, BibTexPHOW features (sports & PPMI set), SYSU Action Dataset, Project

Jian-Fang Hu, Wei-Shi Zheng, Jianhuang Lai, Shaogang Gong, and Tao Xiang, "Recognising Human-Object Interaction via Exemplar based Modelling", International Conference on Computer Vision (ICCV) , 3144-3151, 2013. pdf, BibTex
Jianfang Hu, Guocan Feng, Jianhuang Lai, and Wei-Shi Zheng, "Asymmetric Facial Shape based on Some Symmetry Assumptions", Chines Conference on Biometric Recognition (CCBR), 42-49, 2011.  VIDEO

 

 

Copyright © 2015. Jian-Fang Hu All rights reserved.