We are part of Advanced Digital Sciences Center (ADSC), the Singapore-based research center of the University of Illinois at Urbana-Champaign (UIUC), set up with funding from the Agency of Science, Technology and Research (A*STAR). Our group is directed by Prof. Pierre Moulin. Research in our group focuses on developing fundamental computational methods for effectively fusing depth and color video data to detect, recognize and localize events and actions in multi-modal videos.
Event and action understanding is a key component of an interactive digital media system. Emerging visual sensors such as depth camera provide 3-D scene structure data which is complementary to the traditional appearance data provided by RGB camera. Our research project aims to develop fundamental computational methods for effectively fusing depth and colour video data to detect, recognize objects in the room, understand the environment, localize events, human actions/behaviors and infer human intention and emotion, etc. in multi-modal videos. Fundamental solutions to this research topic will positively impact several application areas, including video-based rehabilitation and sports training, smart office, and video surveillance.
Relation to IDM:
Event and action understanding is a sub-topic in ADSC’s interactive digital media (IDM) program. This research focuses on using depth camera for both scene understanding and human activity analysis. The fundamental solutions of the proposed project can facilitate various IDM related applications such as smart office and intelligent tele-presence.
This research topic will positively impact several application areas, including video-based rehabilitation (see video), sports training, smart office and video surveillance for security. Techniques and products developed based on the fundamental research results can be beneficial to physical therapist and security monitoring solution providers, etc.