Intel Labs Advances Computer Vision Development with Two New AI Models
March 24, 2023 | IntelEstimated reading time: 2 minutes
![](https://iconnect007.com/application/files/9116/9087/1246/MiDaS3.1.jpg)
Depth estimation is a challenging computer vision task required to create a wide range of applications in robotics, augmented reality (AR) and virtual reality (VR). Existing solutions often struggle to correctly estimate distances, which is a crucial aspect in helping plan motion and avoiding obstacles when it comes to visual navigation. Researchers at Intel Labs are addressing this issue by releasing two AI models1 for monocular depth estimation: one for visual-inertial depth estimation and one for robust relative depth estimation (RDE).
The latest RDE model, MiDaS version 3.1, predicts robust relative depth using only a single image as an input. Due to its training on a large and diverse dataset, it can efficiently perform on a wider range of tasks and environments. The latest version of MiDaS improves model accuracy for RDE by about 30% with its larger training set and updated encoder backbones.
MiDaS has been incorporated into many projects, most notably Stable Diffusion 2.0, where it enables the depth-to-image feature that infers the depth of an input image and then generates new images using both the text and depth information. For example, digital creator Scottie Fox used a combination of Stable Diffusion and MiDaS to create a 360-degree VR environment. This technology could lead to new virtual applications, including crime scene reconstruction for court cases, therapeutic environments for healthcare and immersive gaming experiences.
Intel Introduces MiDaS 3.1 for Computer Vision
While RDE has good generalizability and is useful, the lack of scale decreases its utility for downstream tasks requiring metric depth, such as mapping, planning, navigation, object recognition, 3D reconstruction and image editing. Researchers at Intel Labs are addressing this issue by releasing VI-Depth, another AI model that provides accurate depth estimation.
VI-Depth is a visual-inertial depth estimation pipeline that integrates monocular depth estimation and visual-inertial odometry (VIO) to produce dense depth estimates with a metric scale. This approach provides accurate depth estimation, which can aid in scene reconstruction, mapping and object manipulation.
Incorporating inertial data can help resolve scale ambiguity. Most mobile devices already contain inertial measurement units (IMUs). Global alignment determines appropriate global scale, while dense scale alignment (SML) operates locally and pushes or pulls regions toward correct metric depth. The SML network leverages MiDaS as an encoder backbone. In the modular pipeline, VI-Depth combines data-driven depth estimation with the MiDaS relative depth prediction model, alongside the IMU sensor measurement unit. The combination of data sources allows VI-Depth to generate more reliable dense metric depth for every pixel in an image.
Suggested Items
Danish Instrument Helps NASA’s Juno Spacecraft See Radiation
08/21/2024 | NASA JPLUsing cameras designed for navigation, scientists count ‘fireflies’ to determine the amount of radiation the spacecraft receives during each orbit of Jupiter.
Eurocircuits Installs Ledia 6 Hyper Direct Imager at Hungarian Production Site
08/19/2024 | UcamcoEurocircuits is proud to announce the installation of a new Ledia 6 Hyper direct imager at their production site in Hungary last year. This marks the company's fifth direct imager across its multiple production sites, highlighting Eurocircuits' ongoing commitment to enhancing production capabilities and ensuring top-notch service for its customers.
NEC, Ursa Space Collaborate on Satellite Image Analysis Services Using One of the World's Largest Virtual Constellations
06/21/2024 | JCN NewswireNEC Corporation and Ursa Space Systems Inc. (Ursa Space) have agreed to collaborate on satellite image data analysis services. By combining services and technologies, the two companies will provide solutions for various applications for enterprises.
Vision Engineering Celebrates 30 Years of Mantis
05/27/2024 | Vision EngineeringVision Engineering, the world-leading provider of innovative inspection, metrology, and digital 3D visualization solutions, is celebrating the 30th anniversary of its best-selling and award-winning Mantis range of ergonomic optical stereo microscopes.
First Two WorldView Legion Spacecraft Performing Well After Launch
05/03/2024 | BUSINESS WIREMaxar Intelligence, provider of secure, precise geospatial intelligence, today confirmed the first two WorldView Legion satellites are performing well after being launched on a SpaceX Falcon 9 rocket earlier today from Vandenberg Space Force Base, California.