From XR to AI: David Dowling Shares Pixotope's Latest Innovations

Joey /// VP Land
29 Apr 202409:16

TLDRDavid Dowling from Pixotope shares insights on the company's latest innovations in virtual production. Pixotope, a software company with a background in production, has developed solutions to assist studios and broadcasters in realizing their virtual production visions. The discussion covers various applications, including extended reality (XR), Pixotope Pocket for students, and Pixo Fly for markless tracking with drones. Dowling also highlights the company's AI developments, which enable chroma key without a green screen, allowing for AR elements to be placed in front of and behind subjects. This technology is already in use worldwide across sports and election graphics. The summary concludes with Dowling's excitement about the future of virtual production, emphasizing its evolution into a standard tool in the industry.

Takeaways

  • 📈 **Pixotope's Growth**: Pixotope has evolved from a production company to a software company in the virtual production space for five years, aiming to help studios and broadcasters realize their virtual production visions.
  • 🎓 **Pixotope Pocket for Education**: A new application designed for students, Pixotope Pocket, allows for tracking and video using mobile phones, currently available on iOS with Android support coming soon.
  • 📱 **Mobile Phone Integration**: Students and professionals can use their mobile phones to previs AR elements without needing studio space, making virtual production more accessible.
  • 🚀 **Innovations in Tracking**: Pixotope Fly, introduced nearly two years ago, offers markless tracking for drones and steady cams, with new zoom capabilities for sports broadcasting.
  • 🤖 **Machine Learning in Pixotope Fly**: The system uses machine learning to develop a point cloud for tracking, eliminating the need for physical markers and allowing for AR integration from a distance.
  • 📊 **AI-Powered Solutions**: An upcoming AI feature will enable chroma key without a green screen, allowing talent to stand in front of and behind AR elements with automatic edge detection.
  • 🔍 **Low Processing Power Requirement**: Pixotope's software is designed to require minimal processing power, making it suitable for use with gaming engines and accessible to a wider range of users.
  • 📹 **Broadcast Industry Application**: Pixotope's tools are gaining popularity in the broadcast industry, used by videographers and cinematographers for various applications.
  • 🏈 **Sports Broadcasting**: Pixotope's technology is used in sports broadcasting, including the NFL, for adding AR markers on the field with ease.
  • 🌐 **Global Use**: The technology has seen global adoption, being used in soccer, NFL, rugby, cricket, and even for election graphics with CNN.
  • ⏱️ **Upcoming Release**: The AI feature for chroma key without a green screen is expected to release at the end of summer or beginning of fall, marking a significant advancement in virtual production.

Q & A

  • What is Pixotope and how long has the company been in business?

    -Pixotope is a virtual production solution that has been in business for five years as a software company. Prior to that, it was a production company specializing in helping studios and broadcasters realize their virtual production visions.

  • What is the significance of the partnership with UN Lum for Pixotope?

    -UN Lum is a strategic partner of Pixotope. They are acknowledged in the video for their contribution, and Pixotope demonstrates their 2.6 pitch LED panel alongside their XR software on the UN Lum Booth.

  • What is Pixotope Pocket and for whom is it designed?

    -Pixotope Pocket is an application designed specifically for students. It allows for tracking and video using a mobile phone, currently running on iOS with Android support coming soon. It enables students to visualize AR elements and previs these elements without needing access to a studio.

  • How does Pixotope Pocket work in terms of technology?

    -Pixotope Pocket works by utilizing a gaming machine, often equipped with an Nvidia GPU, to run Pixotope software. Instead of a traditional broadcast camera, a mobile phone is used for previsualization and incorporating tracking and video directly.

  • What is Pixo Fly and how does it innovate in the field of virtual production?

    -Pixo Fly is a system developed by Pixotope for markless tracking for drones or steady cams. It uses machine learning to develop a point cloud, enabling real-time, low latency tracking without the need for physical markers or sensors in the environment.

  • How does Pixo Fly's machine learning application differ from traditional tracking methods?

    -Traditional tracking methods require physical setup with sensor cameras and markers within the stadium. Pixo Fly eliminates the need for this setup by using machine learning to create a point cloud from the environment, which can be used for tracking and overlaying AR elements.

  • What is the AI Key that Pixotope has developed and how does it function?

    -The AI Key is a new development by Pixotope that allows for chroma key effects without the need for a green screen. It automatically detects people and creates a map to enable the placement of AR elements, allowing presenters to stand in front of and behind AR elements.

  • What are some potential use cases for the AI Key technology?

    -The AI Key can be used in situations where commentators or sports presenters are in an ordinary room, allowing for over-the-shoulder graphics and player elements to be added without the need for a green screen or complex setup.

  • What is the current status of the AI Key technology and when is it expected to be released?

    -The AI Key technology is in its final stages of development, with the AI still learning and being trained. Pixotope expects to release it at the end of summer or the beginning of fall.

  • What are David Dowling's thoughts on the future of virtual production in the next year or two?

    -David Dowling is excited about the future of virtual production, as it is becoming more mainstream and less intimidating. He sees virtual production as just another tool in the production toolkit, with innovations like Pixo Fly making it easier to use and more accessible.

  • How does Pixotope aim to make virtual production more accessible and easier to use?

    -Pixotope aims to make virtual production more accessible by creating easy-to-use interfaces that do not require an engineering degree to operate. They focus on solving problems like tracking outside with user-friendly front-end graphics, allowing operators to press buttons without worrying about the technical complexities.

  • What is the general sentiment towards virtual production among industry professionals according to the video?

    -The general sentiment is shifting towards embracing virtual production as just another part of the production process. The fear factor is being eliminated, and professionals are starting to see virtual production as a valuable tool for enhancing their work.

Outlines

00:00

🎬 Virtual Production Solutions by Pixel Toes

The first paragraph introduces the topic of the video, which is the latest updates in virtual production from Pixel Toes. The video features an interview with David from Pixel Toes, who provides an overview of the company's virtual production solution. Pixel Toes has been in business for five years, initially as a production company before transitioning to a software company. Their software aims to assist studios and broadcasters in realizing their virtual production visions. The discussion covers various applications, including extended reality (XR), the Pixel Toes Pocket application designed for students, and the innovative Pixo Fly technology for markless tracking using drones or steadicams. The paragraph also touches on the use of machine learning in Pixo Fly to enable real-time, low-latency tracking.

05:02

🤖 AI-Powered Innovations in Virtual Production

The second paragraph delves into the advancements and innovations in virtual production, particularly focusing on AI. Pixel Toes has developed an AI Key, which eliminates the need for a green screen and chroma keying, allowing for AR elements to be placed in front of and behind subjects. This technology is expected to be particularly useful for commentators and sports presenters, enabling them to have on-screen graphics without the need for a green screen. The AI technology is still in the learning phase, with the first release anticipated by the end of the summer or early fall. The paragraph concludes with David expressing excitement about the future of virtual production, as it becomes more integrated into standard production workflows, and the company's commitment to making the technology accessible and user-friendly.

Mindmap

Keywords

💡Virtual production

Virtual production refers to the use of virtual environments and computer-generated imagery in the filmmaking process. It allows filmmakers to create and manipulate virtual sets and elements in real-time. In the video, David Dowling discusses the latest innovations in virtual production from Pixotope, which is a company that offers a virtual production solution. The theme of the video revolves around how these solutions are transforming the industry by making it more accessible and efficient.

💡Pixotope

Pixotope is a company that provides software solutions for virtual production. They have been in business for five years and have a background in production, which informs their approach to creating tools that cater to the needs of studios and broadcasters. The video features an interview with David from Pixotope, who shares insights into the company's latest innovations and how they are being applied in various fields.

💡Extended Reality (XR)

Extended Reality (XR) is an umbrella term that encompasses all real-world and virtual environments that are computer-generated and experienced through a device. It includes augmented reality (AR), virtual reality (VR), and mixed reality (MR). In the context of the video, XR is highlighted as a significant application of Pixotope's technology, particularly in the demonstration of their 2.6 pitch LED panel alongside their XR software.

💡PIXO Pocket

PIXO Pocket is an application developed by Pixotope for students. It allows for tracking and video combination using a mobile phone, which can run on both iOS and, soon, Android platforms. This application is significant as it enables students to visualize AR elements without the need for studio space within their educational institutions. It is mentioned in the video as a tool that is gaining popularity and is particularly useful for hands-on learning experiences.

💡Machine Learning

Machine Learning is a subset of artificial intelligence that involves the use of algorithms and statistical models to enable computers to learn from and make predictions or decisions based on data. In the video, it is discussed in the context of Pixotope's Pixo Fly, which uses machine learning to perform markless tracking for drones or steady cams. This innovation allows for real-time, low-latency tracking without the need for traditional sensor cameras and physical markers.

💡Pixo Fly

Pixo Fly is a product developed by Pixotope that enables markless tracking for drones and steady cams. It is popular for its ability to incorporate zoom features and AR markers, especially in sports broadcasting. The video explains how Pixo Fly uses machine learning to develop a point cloud, which can be used for tracking and placing AR elements in real-time, offering a significant innovation in the field of virtual production.

💡AI Keyer

AI Keyer is a term used in the video to describe a new development by Pixotope that eliminates the need for a green screen in chroma keying. It uses AI to detect people and create a map for placing AR elements, allowing presenters to stand in front of and behind AR elements without the need for a green box. This technology is seen as revolutionary as it simplifies the process and reduces the technical requirements for virtual production.

💡Chroma Key

Chroma key is a technique used in video production to superimpose images or scenes onto another through the use of a specific color, typically green or blue, as a backdrop. This technique allows for the removal of the backdrop color and the insertion of a different background, creating a composite image. In the video, the AI Keyer is presented as an advancement that simplifies the chroma key process, making it more accessible and user-friendly.

💡Broadcast Industry

The broadcast industry refers to the business sector involved in the transmission of audio and video content to the public, typically through television and radio. In the video, the broadcast industry is mentioned as one of the primary users of Pixotope's virtual production solutions. The innovations discussed are aimed at improving efficiency and reducing the technical barriers for broadcasters and videographers.

💡Real-time Tracking

Real-time tracking is the ability to follow and monitor the position and movements of objects or subjects in real-time, without significant delay. This is a crucial aspect of virtual production, especially for live broadcasts. The video discusses how Pixotope's Pixo Fly uses machine learning for real-time, low-latency tracking, which is essential for applications like sports broadcasting and election coverage.

💡Low Latency

Low latency refers to the minimal delay between the input and output of data, which is particularly important in live broadcasting and real-time applications. In the context of the video, low latency is highlighted as a key feature of Pixotope's Pixo Fly, allowing for seamless integration of AR elements and accurate tracking during live events, such as sports games or news broadcasts.

Highlights

Pixotope is a virtual production solution that has been in business for five years as a software company.

Pixotope has its roots as a production company before developing software to assist studios and broadcasters with virtual production.

Extended reality (XR) is a key focus for Pixotope, demonstrated at the UN Lum Booth with a 2.6 pitch LED panel.

Pixotope Pocket is a new application designed for students, combining tracking with video using a mobile phone.

Pixotope Pocket is currently available for iOS and will soon be available for Android.

The application is gaining popularity in the broadcast industry, among videographers, and cinematographers.

Pixotope Pocket is used for previs, allowing students to visualize AR elements without studio access.

Pixotope Fly is a system for markless tracking for drones or steady cams, popular for sports broadcasting and election graphics.

Pixotope Fly uses machine learning to develop a point cloud for tracking, eliminating the need for physical markers.

The AI Kia is a new development that removes the need for a green screen, allowing AR elements to be placed in front of and behind people.

The AI Kia automatically detects people and creates a map for AR element placement.

The AI Kia is expected to have its first release at the end of summer or beginning of fall.

Virtual production is becoming more mainstream, with Pixotope helping to eliminate the fear factor associated with it.

Pixotope is focused on making virtual production tools easy to use, without requiring an engineering degree.

The company is excited about the future of virtual production, seeing it as a natural part of the production process rather than a separate entity.

Pixotope's innovations are being used worldwide in various sports and for election coverage.

The company's advancements in virtual production are aimed at solving real-world problems with easy-to-use interfaces.