Envisioning privacy preserving image-based localization for augmented reality
New camera localization technology for sensitive environments can keep images and map data confidential Advances in augmented reality (AR) and mobile robotics promise to revolutionize how we see and interact with our physical world in…
HELP! Training assistive indoor agents to ask for assistance via imitation learning
Today people use personal digital assistants for help with scheduling, playing music, turning on or adjusting other devices, and answering basic questions such as “What time’s the game on?” or “Where’s the nearest hardware store?”…
All Data AI with Dr. Andrew Fitzgibbon
You may not know who Dr. Andrew Fitzgibbon is, but if you’ve watched a TV show or movie in the last two decades, you’ve probably seen some of his work. An expert in 3D computer…
VNLA via Imitation Learning with Indirect Intervention
We present Vision-based Navigation with Language-based Assistance (VNLA), a grounded vision-language task where an agent with visual perception is guided via language to find objects in photorealistic indoor environments. The task emulates a real-world scenario…
2019 Dissertation Grant recipients embarking on diverse paths to scientific and societal impact
I’m pleased to announce the winners of the 2019 Microsoft Research Dissertation Grants. Each dissertation grant provides up to $25,000 in funding to doctoral students at North American universities who are underrepresented in the field…
Models as Code: Differentiable Programming with Zygote
Scientific computing is increasingly incorporating the advancements in machine learning and the ability to work with large amounts of data. At the same time, machine learning models are becoming increasingly sophisticated and exhibit many features…