{"id":4271,"date":"2015-08-24T09:00:00","date_gmt":"2015-08-24T09:00:00","guid":{"rendered":"https:\/\/blogs.technet.microsoft.com\/inside_microsoft_research\/2015\/08\/24\/mobilefusion-research-project-turns-regular-mobile-phone-into-3d-scanner\/"},"modified":"2016-08-25T20:33:06","modified_gmt":"2016-08-26T03:33:06","slug":"mobilefusion-research-project-turns-regular-mobile-phone-into-3d-scanner","status":"publish","type":"post","link":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/blog\/mobilefusion-research-project-turns-regular-mobile-phone-into-3d-scanner\/","title":{"rendered":"MobileFusion: Research project turns regular mobile phone into 3D scanner"},"content":{"rendered":"<p class=\"posted-by\"><em>By <span class=\"author\">Allison Linn, Senior Writer, Microsoft Research<\/span><\/em><\/p>\n<p><img decoding=\"async\" src=\"https:\/\/msdnshared.blob.core.windows.net\/media\/TNBlogsFS\/prod.evol.blogs.technet.com\/CommunityServer.Blogs.Components.WeblogFiles\/00\/00\/00\/90\/35\/mobile-fusion_550.png\" alt=\" \" border=\"0\" \/><\/p>\n<p>A new Microsoft Research project lets people to create high-quality 3D images in real time, using a regular mobile phone, with about the same effort it takes to snap a picture or capture a video.<\/p>\n<p>&#8220;What this system effectively allows us to do is to take something similar to a picture, but it&#8217;s a full 3D object,&#8221; said <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Peter Ondruska\" href=\"http:\/\/mrg.robots.ox.ac.uk\/mrg_people\/peter-ondruska\/\" target=\"_blank\">Peter Ondruska<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a Ph.D. candidate at Oxford University who worked on the project while he was an intern at Microsoft Research.<\/p>\n<p>The researchers say the system, called <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"MobileFusion research paper - 5.6 MB .pdf\" href=\"http:\/\/www.robots.ox.ac.uk\/~mobile\/Papers\/2015ISMAR_ondruska.pdf\" target=\"_blank\">MobileFusion<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, is better than other methods for 3D scanning with a mobile device because it doesn&#8217;t need any extra hardware, or even an Internet connection, to work. That means scientists in remote locations or hikers deep in the woods can capture their surroundings using a regular cell phone without a Wi-Fi connection.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/8M_-lSYqACo\" width=\"560\" height=\"315\" frameborder=\"0\"><\/iframe><\/p>\n<p>&#8220;Everything happens on the phone itself,&#8221; said <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Pushmeet Kohli\" href=\"http:\/\/research.microsoft.com\/en-us\/um\/people\/pkohli\/\" target=\"_blank\">Pushmeet Kohli<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a principal research scientist with Microsoft Research who also worked on the project.<\/p>\n<p>The scans are high-quality enough to be used for things like 3D printing and augmented reality video games.<\/p>\n<p><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Shahram Izadi\" href=\"http:\/\/research.microsoft.com\/en-us\/people\/shahrami\/\" target=\"_blank\">Shahram Izadi<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, a principal researcher who also worked on the project, said he imagines people using a tool like this to take a 3D scan of something they see on vacation, such as the Eiffel Tower, and immediately sharing it with friends or family.<\/p>\n<p>He said a person might also use it to take a 3D scan of something they wanted to sell online, such as a vase or a lamp, and post that, instead of the more conventional picture or video.<\/p>\n<p>&#8220;This is really about the accessibility and ubiquity of 3D scanning,&#8221; Izadi said.<\/p>\n<p>The researchers will present MobileFusion in early October at the <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"International Symposium on Mixed and Augmented Reality\" href=\"http:\/\/ismar.vgtc.org\/\" target=\"_blank\">International Symposium on Mixed and Augmented Reality<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>.<\/p>\n<p>Kohli and Izadi had previously worked on a similar project, called <a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Kinect Fusion\" href=\"http:\/\/research.microsoft.com\/en-us\/projects\/surfacerecon\/\" target=\"_blank\">Kinect Fusion<span class=\"sr-only\"> (opens in new tab)<\/span><\/a>, which lets people build 3D models of their houses, offices or even themselves. However, that system requires a PC and other gadgets, making it difficult to do any 3D scanning on the go.<\/p>\n<p>When Ondruska came to the lab, Kohli said they were curious to see if they could &#8220;go to the next level, in the sense of usability.&#8221;<\/p>\n<p>They found most mobile devices had become powerful enough that they could build a 3D-scanning system just using the computational power found on a regular mobile phone.<\/p>\n<p>&#8220;The great starting point was to take a sensor that everyone has in their pocket, which is the camera you have on your mobile phone,&#8221; Izadi said.<\/p>\n<p>The researchers then developed an algorithm that allowed the camera to act as a 3D scanner, using a technique of taking multiple images that is similar to how the human eye works, Izadi explained.<\/p>\n<p>Currently, the researchers are working on making sure the system works with all types of mobile devices, including Windows Phone, Android and iPhone devices. Izadi said they hope to eventually make it available to the general public in some form, but there are no firm plans right now.<\/p>\n<p><strong>Related:<\/strong><\/p>\n<ul>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Read more about MobileFusion\" href=\"http:\/\/www.robots.ox.ac.uk\/~mobile\/Papers\/2015ISMAR_ondruska.pdf\" target=\"_blank\">Read more about MobileFusion<span class=\"sr-only\"> (opens in new tab)<\/span><\/a> (PDF, 5.6 MB)<\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft Research's Interactive 3D Technologies group\" href=\"http:\/\/research.microsoft.com\/en-us\/groups\/i3d\/\" target=\"_blank\">Microsoft Research&#8217;s Interactive 3D Technologies group<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Picture this: Microsoft research can interpret, caption photos\" href=\"http:\/\/blogs.microsoft.com\/next\/2015\/05\/28\/picture-this-microsoft-research-project-can-interpret-caption-photos\/\" target=\"_blank\">Picture this: Microsoft research can interpret, caption photos<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<li><a class=\"msr-external-link glyph-append glyph-append-open-in-new-tab glyph-append-xsmall\" rel=\"noopener noreferrer\" title=\"Microsoft Hyperlapse makes first-person videos smooth and speedy\" href=\"https:\/\/news.microsoft.com\/features\/microsoft-hyperlapse-makes-first-person-videos-smooth-and-speedy\/\" target=\"_blank\">Microsoft Hyperlapse makes first-person videos smooth and speedy<span class=\"sr-only\"> (opens in new tab)<\/span><\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>By Allison Linn, Senior Writer, Microsoft Research A new Microsoft Research project lets people to create high-quality 3D images in real time, using a regular mobile phone, with about the same effort it takes to snap a picture or capture a video. &#8220;What this system effectively allows us to do is to take something similar [&hellip;]<\/p>\n","protected":false},"author":30766,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194480],"tags":[200179,186897,202069,196136,186601,202875,203431,203773],"research-area":[13551],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-4271","post","type-post","status-publish","format-standard","hentry","category-graphics-and-multimedia","tag-3d-scanning","tag-computer-vision","tag-international-symposium-on-mixed-and-augmented-reality","tag-kinect-fusion","tag-mobile-computing","tag-mobilefusion","tag-pushmeet-kohli","tag-shahram-izadi","msr-research-area-graphics-and-multimedia","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"August 24, 2015","formattedExcerpt":"By Allison Linn, Senior Writer, Microsoft Research A new Microsoft Research project lets people to create high-quality 3D images in real time, using a regular mobile phone, with about the same effort it takes to snap a picture or capture a video. &quot;What this system&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/4271","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/users\/30766"}],"replies":[{"embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/comments?post=4271"}],"version-history":[{"count":4,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/4271\/revisions"}],"predecessor-version":[{"id":283667,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/4271\/revisions\/283667"}],"wp:attachment":[{"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media?parent=4271"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/categories?post=4271"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/tags?post=4271"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=4271"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=4271"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=4271"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=4271"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=4271"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=4271"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=4271"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/new-cm-edgedigital.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=4271"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}