Leap Motion CTO David Holz demo

joe chan
31 Mar 201603:22

TLDRIn this demo, Leap Motion CTO David Holz showcases the advanced capabilities of their hand-tracking technology. He demonstrates interactions with virtual objects using hand gestures, like pinching and throwing virtual items. Holz introduces a 'virtual wearable interface' that enables complex tasks without the need for physical programming. The technology's physics engine allows for subtle manipulations, such as turning off gravity. Holz explains the potential for embedding this technology in VR headsets, emphasizing the low-cost hardware and software licensing model, marking it as a breakthrough for future VR interfaces.

Takeaways

  • 👐 Leap Motion technology allows for non-physical interactions, such as controlling virtual objects with hand gestures.
  • 👌 In the demo, David Holz shows how pinching with one hand can create and manipulate virtual objects in real time.
  • 🌐 The demo demonstrates a virtual wearable interface, which brings virtual controls to a user’s hands, as though wearing an interface.
  • 🎯 Complex virtual interactions are possible without extensive programming due to the physical interaction paradigm used by Leap Motion.
  • 🔄 David Holz demonstrates turning gravity off in the virtual environment, allowing objects to behave differently without real-world physics.
  • 👨‍💻 Leap Motion technology has been under development for around six or seven years, with a virtual reality version being worked on for two years.
  • 🕶️ Future versions of Leap Motion will feature embedded sensors in virtual reality headsets, making the technology more integrated.
  • 💵 The hardware for Leap Motion is simple and affordable, costing around five dollars to manufacture.
  • 🤝 Leap Motion partners with manufacturers in Asia, offering software licensing fees for the technology, which generates pure profit.
  • 🚀 Leap Motion technology has only recently been released, but is seen as crucial for the future of virtual reality by many in the industry.

Q & A

  • What is David Holz demonstrating in this video?

    -David Holz is demonstrating non-physical interactions using Leap Motion technology. He shows how to manipulate virtual objects using hand gestures, creating interfaces and effects in a virtual environment.

  • What does Holz mean by 'non-physical reactions'?

    -By 'non-physical reactions,' Holz refers to the ability to manipulate and interact with virtual objects using hand gestures without physically touching anything in the real world.

  • What is the 'virtual wearable interface' that David Holz mentions?

    -The 'virtual wearable interface' is an interface that can be summoned by hand gestures in a virtual space, allowing users to interact with virtual buttons or controls as if they are wearing the interface on their body.

  • What is the significance of turning gravity off during the demo?

    -Turning gravity off demonstrates how the physics engine can be controlled within the virtual environment, allowing objects to float and interact without the influence of gravity.

  • How long has this technology been in development?

    -According to David Holz, the virtual reality version of the technology has been in development for about two years, while the general technology has been under development for six or seven years.

  • What does David Holz say about embedding sensors in headsets?

    -David Holz mentions that their goal is to embed sensors directly inside VR headsets, making the external sensor technology part of the headset hardware itself.

  • How affordable is the hardware according to Holz?

    -Holz states that the hardware is very affordable, costing around five dollars to produce, and can be mass-produced by their partners in Asia.

  • What business model does Leap Motion plan to use for their software?

    -Leap Motion plans to license their software to hardware manufacturers, charging a software license fee per unit, ranging from three to ten dollars.

  • How does David Holz describe the potential of the technology in virtual reality?

    -David Holz explains that the technology is expected to be widely adopted by virtual reality headset makers, as it enhances the interaction between users and virtual environments.

  • Why does Holz consider Leap Motion a 'pure software company'?

    -Holz describes Leap Motion as a 'pure software company' because they do not focus on manufacturing hardware themselves but instead license their software to other companies that integrate it into their products.

Outlines

00:00

✋ Demonstrating Non-Physical Reactions

The speaker begins by explaining a demonstration of non-physical reactions. They use both hands, pinching their left ear with their right hand, while discussing how they can create subtle, non-physical effects. These actions represent the ability to produce small but impactful reactions, which are likened to creating 'power' and performing delicate, effeminate movements. This part showcases various non-physical interactions and sets the stage for more complex demonstrations.

🤖 Introduction to a Virtual Wearable Interface

The speaker transitions to describing a virtual wearable interface, where they extend their left hand, flip it, and create an interface seemingly out of thin air. This interface allows the user to interact in a more complex, immersive way. The speaker emphasizes the advanced nature of the interactions, achieved without extensive programming, due to the physical interaction paradigm they are using. The interface demonstrates the potential for intricate user experiences through simple gestures.

⚙️ Simulating Physics and Environmental Interactions

The speaker moves on to discuss how they can manipulate physics within the virtual environment, such as turning off gravity. They explain the subtle effects of this action and demonstrate how objects can still behave in familiar ways even when the environment is drastically altered. This part emphasizes the integration of physics into the system and showcases how realistic interactions can be simulated within a virtual space.

🛠️ Development of the Technology and Future Plans

Here, the speaker delves into the history and development of the technology, which has been in the works for several years, including a specific focus on the virtual reality version developed over the past two years. They reveal their expectations for the technology, noting that it could become embedded in headsets. The hardware is described as cost-effective and easy to produce, while the company itself will focus on software licensing for profit. Partnerships in Asia are mentioned, with a focus on enabling widespread access to the technology through affordable modules.

Mindmap

Keywords

non-physical reactions

In the context of this demo, 'non-physical reactions' refers to interactions that happen in a virtual space, without the need for physical touch. This highlights the Leap Motion technology's ability to simulate and manipulate objects in a virtual environment using hand gestures, without actual physical contact.

pinch gesture

A 'pinch gesture' is a specific hand motion where the user brings their thumb and fingers together, often used as a control gesture in virtual interfaces. In the demo, the pinch gesture is used to manipulate virtual objects, showcasing how Leap Motion tracks hand movements to interact with digital elements.

virtual wearable interface

A 'virtual wearable interface' is a digital interface that appears as if it is worn or attached to the user’s body, but exists only in virtual space. The demo shows how the Leap Motion system can project such interfaces onto the body, allowing the user to control virtual elements with gestures as if they were interacting with a physical device.

hierarchy of buttons

This concept refers to the structured organization of buttons or controls in a user interface, where more complex interactions are possible through layered or nested menus. In the demo, the Leap Motion CTO mentions the need for such an interface to handle more advanced control inputs using hand gestures.

physical interaction paradigm

The 'physical interaction paradigm' refers to a model of interaction where physical movements, such as hand gestures, control digital or virtual elements. The Leap Motion demo relies on this concept, enabling users to control virtual objects through natural hand movements, as if manipulating physical objects.

stress test

A 'stress test' in this context refers to a trial where the system's capabilities are pushed to their limits to see how well it performs under pressure. In the demo, the Leap Motion technology is being tested with complex interactions to demonstrate its robustness and reliability.

gravity

Gravity in this demo refers to the simulation of physical forces in the virtual environment. The CTO demonstrates turning off gravity to show how virtual objects behave when this force is absent, which highlights the system's ability to simulate realistic physics.

embedded sensors

'Embedded sensors' refer to sensors that are built into a device rather than being externally attached. In the future vision of the Leap Motion technology, these sensors will be integrated directly into VR headsets, enhancing the seamless experience of tracking hand movements in virtual environments.

software license fee

A 'software license fee' is a charge for using proprietary software. In the business model discussed, Leap Motion plans to sell its technology by licensing the software to manufacturers, who then integrate it into their devices. This fee ranges from $3 to $10 per unit, allowing Leap Motion to operate as a software company.

virtual reality

Virtual reality (VR) is the simulated experience of being in a three-dimensional environment, which users can interact with. Leap Motion's technology enhances VR by enabling users to interact with virtual objects using hand gestures, making the virtual experience more immersive and intuitive.

Highlights

Demonstrates non-physical reactions using hand gestures, creating interactive virtual objects.

Performs a pinch gesture with the right hand while manipulating a virtual object with the left hand.

Shows the ability to control objects in real time by letting go and observing their virtual movements.

Demonstrates the ability to create virtual power and manipulate objects in a non-physical space.

Illustrates how physical interactions can control non-physical elements, such as buttons in a virtual interface.

Introduces a 'virtual wearable interface' by flipping the left hand to reveal interactive elements.

Highlights the creation of complicated virtual interactions without needing additional programming.

Displays the integration of physical and virtual actions, like making circles and throwing them.

Describes how the interaction system handles more complex and detailed tasks in a user-friendly way.

Explains the ability to switch off gravity within the virtual world for more creative and experimental interactions.

Demonstrates subtle control over physics within the virtual space, creating real-time dynamic effects.

Mentions the recent release of the technology, which has been in development for several years.

Describes the company's focus on developing software, licensing it to hardware partners for integration into VR headsets.

Plans to embed motion-tracking sensors directly into virtual reality headsets, making the hardware affordable and accessible.

Mentions partnerships in Asia to manufacture modules, with software licensing fees providing a profitable business model.