Intelligent Video Analysis


 
Intelligent video analysis focus on automatic video analysis and security alerts. It aims at changing passive surveillance into active identification, thus reducing the need for most manual monitoring and its associated costs. We have developed several practical algorithms for video-based applications, including
  • detection of pedestrian, pedestrian, and special objects;
  • people counting;
  • person re-identification;
  • character recognition;
  • multi-camera object tracking (our group won the Rank 1 in this topic in the 2014 National Graduate Contest on Smart-City Technology Competition);
  • abnormal event detection (our group won the Rank 1 in this topic in the 2015 National Graduate Contest on Smart-City Technology Competition).
    •  
 

Human-Centred Vision based on RGB-D Sequence



With the emergence of low cost RGB-D camera Kinect, it becomes much easier and more convenient to capture the RGB, depth, and voice of a scene simultaneously. And more importantly, the dynamic skeletons of the persons involved in the view of the Kinect are also captured in real time. It can be used as a man-machine interface that allows users to interact naturally with computing technology. Based on the multi-module data provided by Kinect device, we focus on developing algorithms to address the following human-centred vision problems:

  • RGB-D Activity Recognition;
  • RGB-D Person Re-identification;
  • Human Face Shape Recovery based on RGB-D images;
  • Object detection and tracking in RGB-D videos.

Intrinsic Character Reconstruction

 
This project aims at inferring the underlying intrinsic physical characters (the 3D shape, illumination, shading, reflectance, etc.) that gave rise to observed images. Recovering these quantities from images is a core problem of vision, and facilitates the virtual reality applications such as the object recognition, object relighting, and object recoloring. We have developed some methods to seprate an image or multiple images into two kinds of intrinsic images (illumination image and reflectance image), now we are working on inferring three kinds of characters (shape, illumination, and reflectance) from different new-type cameras.

Face Analysis and Applications


 
This project aims at making the machine understand and interpret human face through cameras (may use RGB, depth, multispectral information), such as the human identity recognition and 3d shape recovery. Towards real applications, we pay special attention to critical technical problems, including
  • lighting preprocessing;
  • face liveness detection;
  • heterogeneous face recognition;
  • face hallucination;
  • facial 3d shape recovery；
  • micro expression recognition;
  • face landmarking;
  • facial image quality assessment;
  • large-scale face retrieval;
  • anti-diebstahl facial coding.
    •  
 

Data Mining and Machine Learning

 
 
To support different applications, we need to develop efficient, stable algorithms for analyzing a variety of datas especially for big datas, and to discovery underlying laws of datas and the inherent mechanism for previous methods. Specifically, we have made contributions on following topics:
  • nonlinear clustering;
  • large Scale Learning;
  • subspace learning;
  • sparse coding;