Computer Vision
Enabling computers and devices to understand what they see.
Tool
Microsoft Inertial Motion Capture Dataset (MIMC17)
This dataset provides an unprecedented number of sensor recordings (405 in total), including multiple IMUs and infrared (IR) sensors deployed on 24 individual body segments. Together there are over 3 hours of data (sampled at…
Video
Physics-based Manipulation with and Around People
Robots manipulate with super-human speed and dexterity on factory floors. But yet they fail even under moderate amounts of clutter or uncertainty. However, human teleoperators perform remarkable acts of manipulation with the same hardware. My…
Project
On-device ML for Object and Activity Detection
To process data locally, we have accelerated ML computations via ASICs that incorporate efficient pipelining and parallelism techniques. We have also compressed ML models by scaling their bit-precision values.
Publication
Symmetry-Aware Façade Parsing with Occlusions
Publication
Coherent Online Video Style Transfer
Video
Robust, Visual-Inertial State Estimation: from Frame-based to Event-based Cameras
I will present the main algorithms to achieve robust, 6-DOF, state estimation for mobile robots using passive sensing. Since cameras alone are not robust enough to high-speed motion and high-dynamic range scenes, I will describe…
Project
Project Prague – Hand Gestures SDK
Project Prague is a cutting-edge, easy-to-use SDK that creates more intuitive and natural experiences by allowing users to control and interact with technologies through hand gestures. Based on extensive research, it equips developers and UX…