This is Changing 3D Scanning!!

InspirationTuts
25 Aug 202309:40

TLDR3D scanning is evolving rapidly with technologies like photogrammetry and augmented reality gaining more attention. Kiri Engine, a versatile tool for 3D scanning and AR, offers a new feature called virtual scanning using NeRF (Neural Radiance Fields) technology, specifically Norlandulo, which is a significant advancement. While photogrammetry is effective for capturing detailed 3D models, it struggles with objects lacking distinct features. NeRF technology, on the other hand, can reconstruct 3D scenes from images or videos, even when there are insufficient feature points. Norlandulo takes this further by generating high-quality 3D models usable in software like Blender. Kiri Engine's implementation of Norlandulo is a game-changer, allowing users to scan objects, including reflective or single-colored ones, which were previously challenging for photogrammetry. The process involves recording a video of the object and submitting it to the cloud for processing. Although NeRF technology is not yet a replacement for photogrammetry, Norlandulo shows promise in addressing its limitations and expanding the possibilities of 3D scanning.

Takeaways

  • 📈 **3D Scanning Trends**: 3D scanning and photogrammetry are gaining attention with the market shifting towards AI and AR technologies.
  • 📱 **Kiri Engine**: Kiri engine is a versatile tool for 3D scanning and AR technology, available for both iPhone and Android, offering an alternative to polycam.
  • 🔍 **Nerf Technology**: The Kiri engine features a new virtual scanning method using Nerf (Neural Radiance Fields) technology, which is designed to overcome some limitations of photogrammetry.
  • 🚀 **Advancements in Tech**: Despite initial skepticism, technology is advancing rapidly, and Kiri engine's implementation of Nerf technology is an example of this progress.
  • 🧩 **Mesh Quality**: Nerf doesn't generate high-quality meshes like photogrammetry, but Kiri engine's future updates are expected to improve this with the norlandulo technique.
  • 🚫 **Photogrammetry Limitations**: Photogrammetry struggles with objects that lack distinct features, such as single-color or reflective surfaces, which Nerf technology aims to address.
  • 🌐 **Accessibility**: Kiri engine is free to download and compatible with both Android and iPhones, making advanced 3D scanning technology more accessible.
  • 🎥 **Nerf vs. Photogrammetry**: Nerf technology can reconstruct scenes and objects that photogrammetry cannot, due to insufficient feature points.
  • 🔄 **Orlando Technology**: Orlando is an advancement over Nerf, producing usable 3D models for software like Blender, and is the basis for Kiri engine's featureless object mode.
  • ⏱️ **Scanning Process**: The featureless scanning process in Kiri engine involves recording a video of the object from different angles and submitting it to the cloud for processing.
  • ❗ **Future of 3D Scanning**: While Nerf shows promise, it is not yet a replacement for photogrammetry. Orlando, however, is a stronger contender for the future of 3D scanning.

Q & A

  • What is the current state of 3D scanning in the industry?

    -3D scanning is one of the most challenging subjects in 3D technology and is gaining more attention daily, especially with the market's shift towards artificial intelligence and augmented reality.

  • What is Kiri Engine and how does it relate to 3D scanning?

    -Kiri Engine is a tool for 3D scanning and AR technology that was reviewed as a great alternative to iPhone 3D scanning apps like Polycam. It is now available for Android and supports QR, making it accessible for more users.

  • What is the new feature in Kiri Engine that the speaker is excited about?

    -The speaker is excited about the new feature of virtual scanning using NeRF technology, specifically a technique called Norlandulo, which aims to mitigate some of the shortcomings of photogrammetry.

  • What are the limitations of photogrammetry?

    -Photogrammetry requires distinct features in an image of an object, such as changes in color or shape, to create a complete shape. It struggles with objects that don't have many feature points, like objects with one color, transparent, or extremely reflective surfaces.

  • How does NeRF technology differ from photogrammetry?

    -NeRF, which stands for Neural Radiance Field, uses machine learning and artificial intelligence to reconstruct an entire 3D scene from a set of images or a video, without relying on distinct features like photogrammetry does.

  • What is Norlandulo and how does it improve upon NeRF technology?

    -Norlandulo is a technique that not only generates neural rendered scenes like NeRF but also produces a high-quality mesh of the object that is usable in 3D software like Blender. It addresses some of the shortcomings of both NeRF and photogrammetry.

  • How does one use the featureless object mode in Kiri Engine?

    -To use the featureless object mode, you click the big plus button, select the featureless option, and start recording a video of the object. You should circle around the object, maintaining a steady hand and covering different layers from top, middle, and bottom.

  • What are the limitations of the video length for scanning with Kiri Engine?

    -Kiri Engine limits the video length for scanning to 2 minutes due to server limitation purposes.

  • Is NeRF expected to replace photogrammetry in the future?

    -No, NeRF is not expected to replace photogrammetry. While NeRF can handle scenes and objects that photogrammetry cannot, it currently can't produce high-quality 3D models and textures suitable for a typical 3D pipeline.

  • What are some of the other features of Kiri Engine besides featureless mode?

    -Kiri Engine offers multiple features including a web app, access to a library, the ability to create a floor plane, in-app editing, texture toning, and more.

  • How can one try Kiri Engine for free?

    -You can try Kiri Engine for free by downloading it from the provided link in the video description. It is compatible with both Android and iPhone devices.

  • What are some common use cases for 3D scanning and photogrammetry?

    -Common use cases include entertainment projects such as game development and visual effects for movies, as well as applications in the medical field, engineering, and more.

Outlines

00:00

📐 Introduction to 3D Scanning and Kiri Engine

The first paragraph introduces 3D scanning as a challenging and growing field, increasingly significant with the rise of artificial intelligence and augmented reality. It highlights the Kiri engine as a versatile tool for 3D scanning and AR technology, available on both iPhone and Android. The Kiri engine is noted for its new feature of virtual scanning using NeRF (Neural Radiance Fields) technology, which aims to improve upon the limitations of traditional photogrammetry, such as difficulties with reflective surfaces or black colors. The speaker expresses excitement about this feature, given their own struggles with 3D scanning hardware. The paragraph also touches on the broader applications of 3D scanning in various industries like gaming, movies, medical, and engineering.

05:01

🚀 NeRF and Norlandulo: Emerging Technologies in 3D Scanning

The second paragraph delves into the pros and cons of photogrammetry and introduces NeRF (neural Radiance field) as a machine learning technology that can reconstruct 3D scenes from a series of images or video, overcoming the limitations of photogrammetry by not relying on distinct features. Norlandulo is mentioned as an advancement over NeRF, capable of producing high-quality 3D models usable in software like Blender. The paragraph explains how to use the featureless object mode in Kiri engine, which is based on Norlandulo, to scan objects by recording a video and submitting it to the cloud for processing. It acknowledges that while NeRF is promising, it is not yet a replacement for photogrammetry due to its current inability to handle high-quality textures and models. However, Norlandulo 2.0 is seen as a more viable contender for replacing photogrammetry. The paragraph concludes by inviting viewers to try Kiri engine and engage with the content through likes and subscriptions.

Mindmap

Keywords

💡3D Scanning

3D scanning is a process that captures the shape of an object or environment and converts it into a three-dimensional digital model. It's a crucial technology in fields like game development, movie visual effects, and medical imaging. In the video, 3D scanning is highlighted as a subject that is gaining attention due to advancements in artificial intelligence and augmented reality.

💡Photogrammetry

Photogrammetry is a technique used in 3D scanning that involves taking multiple photographs of an object from different angles. These photos are then used to create a detailed 3D model. However, it has limitations when dealing with objects that lack distinct features. The video discusses how photogrammetry is used in creating 3D models for various applications.

💡Kiri Engine

Kiri Engine is a tool for 3D scanning and augmented reality technology. It is mentioned as an alternative to other iPhone 3D scanning apps and is noted for its support for Android as well. The video script discusses a new feature in Kiri Engine called virtual scanning using NeRF technology, which is significant for overcoming some of the limitations of traditional photogrammetry.

💡NeRF (Neural Radiance Fields)

NeRF is a machine learning technology that uses artificial intelligence to reconstruct a 3D scene from a set of images or a video. Unlike photogrammetry, NeRF doesn't rely on distinct features and can reconstruct scenes and objects that are challenging for traditional methods. The video explains how NeRF is a significant advancement in the field of 3D scanning.

💡Nerf Technology

Nerf Technology, as discussed in the video, refers to the use of neural networks to generate 3D models from images. It is particularly useful for objects that are difficult to scan using photogrammetry, such as reflective or black surfaces. The video highlights how Kiri Engine has implemented NeRF technology to improve 3D scanning capabilities.

💡Norlandulo

Norlandulo is a technique that builds upon NeRF by generating not just neural rendered scenes but also high-quality meshes that are usable in 3D software like Blender. It is an advancement that addresses some of the shortcomings of NeRF and photogrammetry. The video mentions that Kiri Engine's featureless object mode is based on Norlandulo, making it a powerful tool for 3D scanning.

💡Featureless Object Mode

Featureless Object Mode is a feature in Kiri Engine that allows users to scan objects that lack distinct features, which are typically difficult for photogrammetry to process. The video demonstrates how this mode uses Norlandulo to generate 3D models from video recordings, even for objects that are uniform in color or texture.

💡AR (Augmented Reality)

Augmented Reality (AR) is a technology that overlays digital information or objects onto the real world, enhancing the user's perception of their environment. The video script discusses how AR is becoming increasingly accessible with tools like Kiri Engine, which is designed to work with both AR and 3D scanning technologies.

💡AI (Artificial Intelligence)

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. In the context of the video, AI is used in NeRF technology to analyze images and reconstruct 3D scenes, showcasing how AI is transforming the field of 3D scanning.

💡Point Cloud

A Point Cloud is a collection of data points in space that represents the external surface of an object in 3D space. It is an essential part of 3D scanning and modeling. The video explains that photogrammetry relies on creating a coherent Point Cloud to generate a 3D model, which can be challenging for objects with few distinct features.

💡Texture Mapping

Texture Mapping is the process of applying a 2D image (texture) to the surface of a 3D model to give it a realistic appearance. The video script mentions that while photogrammetry can capture highly detailed geometry, it also produces good texture quality, which is important for creating realistic 3D models.

Highlights

3D scanning is becoming increasingly important with the market moving towards artificial intelligence and augmented reality.

Kiri Engine is a tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam.

Kiri Engine now supports Android and has QR code support for those without the hardware for Real Time 3D scanning.

A new feature in Kiri Engine is virtual scanning using NeRF technology, specifically a technique called Norlandulo.

NeRF technology aims to address some of the limitations of photogrammetry, such as difficulties scanning reflective surfaces or black colors.

Kiri Engine's Norlandulo feature allows for 3D scanning of objects that lack distinct features, which traditional photogrammetry struggles with.

Photogrammetry requires distinct features like color or shape changes for creating a complete 3D model.

NeRF stands for Neural Radiance Field, a machine learning technology that uses AI to reconstruct 3D scenes from images or video.

Norlandulo is a more advanced form of NeRF that generates high-quality 3D models usable in software like Blender.

Kiri Engine is the first to implement Norlandulo technology, making it available on both iPhone and Android phones.

To use the Norlandulo feature in Kiri Engine, users record a video of the object, moving around it to capture it from different angles.

The video length for scanning with Kiri Engine's Norlandulo feature is limited to 2 minutes due to server limitations.

Processing time for Norlandulo scanning may be longer than photogrammetry, but optimization is in progress.

NeRF is not expected to replace photogrammetry, but Norlandulo 2.0 could be a stronger contender due to its ability to address the shortcomings of both.

Kiri Engine offers more than just the featureless mode, including a web app, access library, in-app editing, and more.

The Kiri Engine is available for free and can be downloaded from the provided link.

Casual Browsing

Unleash the power of 360 cameras with AI-assisted 3D scanning. (Luma AI)

2024-06-18 04:00:00

Changing Hairstyles In #SeaArt AI

2024-05-09 20:20:00

Game Changing New Udio Tool, Major Updates!

2024-05-16 21:40:03

This Midjourney Reference Page Is Insane

2024-05-16 20:00:03

This MidJourney Approval Automation is INSANE

2024-05-17 14:10:03