Using Reflections to See the World From New Points of View

Typography

A new computer vision system turns any shiny object into a camera of sorts, enabling an observer to see around corners or beyond obstructions.

A new computer vision system turns any shiny object into a camera of sorts, enabling an observer to see around corners or beyond obstructions.

As a car travels along a narrow city street, reflections off the glossy paint or side mirrors of parked vehicles can help the driver glimpse things that would otherwise be hidden from view, like a child playing on the sidewalk behind the parked cars.

Drawing on this idea, researchers from MIT and Rice University have created a computer vision technique that leverages reflections to image the world. Their method uses reflections to turn glossy objects into “cameras,” enabling a user to see the world as if they were looking through the “lenses” of everyday objects like a ceramic coffee mug or a metallic paper weight.

Using images of an object taken from different angles, the technique converts the surface of that object into a virtual sensor which captures reflections. The AI system maps these reflections in a way that enables it to estimate depth in the scene and capture novel views that would only be visible from the object’s perspective. One could use this technique to see around corners or beyond objects that block the observer’s view.

Read more at Massachusetts Institute of Technology

Image: Caption:Researchers from MIT and Rice University have created a computer vision technique that leverages reflections to image the world by using them to turn glossy objects into “cameras,” enabling a user to see the world as if they were looking through the “lenses” of everyday objects like a ceramic coffee mug or a metallic paper weight. (Credits: Courtesy of the researchers)