To replicate physical objects for virtual reality, turn on your smartphone – ScienceDaily



[ad_1]

Capturing and reproducing real and realistic objects for any virtual environment is complex and time consuming. Imagine using a classic camera with built-in flash – from any mobile device or standard digital camera – to simplify this task. An international team of computer scientists has developed a new method for replicating physical objects in the virtual and augmented reality space by simply using a compact camera with flash, without the need for additional, often expensive hardware.

"To faithfully reproduce a real-world object in the VR / AR environment, we must reproduce the geometry and the 3D appearance of the object," said Min H. Kim, an associate professor of 39, Computer Science at KAIST in South Korea and lead author of the research. "Traditionally, this was done manually by 3D artists, which was a tedious task, or by using specialized and expensive hardware.Our method is simple, less expensive and efficient, and reproduces realistic 3D objects by simply taking camera photos. photo with built-in flash. "

Kim and his collaborators, Diego Gutierrez, professor of computer science at the University of Zaragoza in Spain, as well as Giljoo Nam and Joo Ho Lee, doctoral students at KAIST, will present this new work at SIGGRAPH Asia 2018 in Tokyo from 4 to December 7th. The annual conference will bring together the most respected technical and creative members in the field of computer graphics and interactive techniques, and will present cutting-edge research in the fields of science, art, gaming and art. l & # 39; animation.

Existing approaches to the acquisition of physical objects require specialized hardware configurations to model the geometry and appearance of desired objects. These configurations may include a 3D laser scanner or multiple cameras, or a lighting dome with over a hundred light sources. In contrast, this new technique requires only one camera to produce high quality outputs.

"Many traditional single-camera methods can only capture the 3D geometry of objects, but not the complex reflectance of real-world objects given by the SVBRDF," says Kim. SVBRDF, which represents spatially varying bidirectional reflectance distribution functions, is essential for obtaining the actual shape and appearance of an object. "Using only 3D geometry does not make it possible to reproduce the realistic appearance of the object in the AR / VR environment. Our technique allows to capture a high quality 3D geometry, as well as its material appearance. , so that objects can be rendered realistically in any virtual environment. "

The group presented its framework using a digital camera, the Nikon D7000 and the built-in camera of an Android mobile phone, in a series of examples in their document titled "Practical acquisition in SVBRDF. 3D objects with an unstructured flash photography ". The new algorithm, which does not require any input geometry of the target object, was able to capture the geometry and appearance of 3D objects with basic flash photography and consistent reproduced results. Examples presented in the work included various sets of objects covering a wide range of geometries and materials, including metal, wood, plastic, ceramics, resin and paper, and made up of complex shapes such as a finely detailed mini-status of Nefertiti.

In future work, researchers hope to further simplify the capture process or extend the method to dynamic geometry or larger scenes, for example.

Source of the story:

Material provided by Association for Computer Machines. Note: Content can be changed for style and length.

[ad_2]
Source link