Human Detection, Tracking, and Activity Understanding

Back to Research Mainpage

1. Introduction

The Intelligent Systems Laboratory at RPI has long performed research related to human activity modeling and recognition. Specifically, we have performed research in face detection and tracking, human detection and tracking, human activity modeling and recognition. These efforts have led to algorithms and software for real time multi-view face detection and tracking, multi-target human body detection and tracking, human action and facial activity recognition.

Our recent efforts include person-object activity/event recognition (DARPA VIRAT program), complex activity recognition (DARPA PerSEAS), persistent detection, tracking and activity recognition of dismounts (sponsored by Army Research Office) and face recognition from distance for maritime applications (Sponsored by ONR). Our efforts in these areas have been supported by different governmental agencies including DARPA, ARO, ONR, AFOSR, and NSF.

2. Most Related Projects:

• Complex Activity Recognition (Sponsors: DARPA PerSEAS)

• Human Tracking and Activity Recognition in Urban Environment (Sponsors: DARPA VIRAT and Army)

• Multi-people detection and tracking

3. Other Related Projects:

• Human upper body tracking and hand gesture recognition (Sponsor: Mobinex)

• Multi-view human face detection, tracking, and recognition (Sponsors: AFOSR, TSWG, and DARPA)

• A Robust Non-cooperative Face/Iris Recognition Scheme from distance in Maritime Domain (Sponsor: ONR via IAI)

• Facial activity modeling and recognition (sponsor: DARPA)

• Vision Based Human Computer Interaction:
  Eye Detection, gaze tracking, facial feature tracking, 3D face pose tracking, facial expression analysis, and face tracking

• Related Publications

• Activity/action recognition datasets

4. Activity/action recognition datasets

For further information, please contact Prof.Qiang Ji at qji@ecse.rpi.edu.