From XR to AI: David Dowling Shares Pixotope's Latest Innovations
TLDRDavid Dowling from Pixotope shares insights on the company's latest innovations in virtual production. Pixotope, a software company with a background in production, has developed solutions to assist studios and broadcasters in realizing their virtual production visions. The discussion covers various applications, including extended reality (XR), Pixotope Pocket for students, and Pixo Fly for markless tracking with drones. Dowling also highlights the company's AI developments, which enable chroma key without a green screen, allowing for AR elements to be placed in front of and behind subjects. This technology is already in use worldwide across sports and election graphics. The summary concludes with Dowling's excitement about the future of virtual production, emphasizing its evolution into a standard tool in the industry.
Takeaways
- 📈 **Pixotope's Growth**: Pixotope has evolved from a production company to a software company in the virtual production space for five years, aiming to help studios and broadcasters realize their virtual production visions.
- 🎓 **Pixotope Pocket for Education**: A new application designed for students, Pixotope Pocket, allows for tracking and video using mobile phones, currently available on iOS with Android support coming soon.
- 📱 **Mobile Phone Integration**: Students and professionals can use their mobile phones to previs AR elements without needing studio space, making virtual production more accessible.
- 🚀 **Innovations in Tracking**: Pixotope Fly, introduced nearly two years ago, offers markless tracking for drones and steady cams, with new zoom capabilities for sports broadcasting.
- 🤖 **Machine Learning in Pixotope Fly**: The system uses machine learning to develop a point cloud for tracking, eliminating the need for physical markers and allowing for AR integration from a distance.
- 📊 **AI-Powered Solutions**: An upcoming AI feature will enable chroma key without a green screen, allowing talent to stand in front of and behind AR elements with automatic edge detection.
- 🔍 **Low Processing Power Requirement**: Pixotope's software is designed to require minimal processing power, making it suitable for use with gaming engines and accessible to a wider range of users.
- 📹 **Broadcast Industry Application**: Pixotope's tools are gaining popularity in the broadcast industry, used by videographers and cinematographers for various applications.
- 🏈 **Sports Broadcasting**: Pixotope's technology is used in sports broadcasting, including the NFL, for adding AR markers on the field with ease.
- 🌐 **Global Use**: The technology has seen global adoption, being used in soccer, NFL, rugby, cricket, and even for election graphics with CNN.
- ⏱️ **Upcoming Release**: The AI feature for chroma key without a green screen is expected to release at the end of summer or beginning of fall, marking a significant advancement in virtual production.
Q & A
What is Pixotope and how long has the company been in business?
-Pixotope is a virtual production solution that has been in business for five years as a software company. Prior to that, it was a production company specializing in helping studios and broadcasters realize their virtual production visions.
What is the significance of the partnership with UN Lum for Pixotope?
-UN Lum is a strategic partner of Pixotope. They are acknowledged in the video for their contribution, and Pixotope demonstrates their 2.6 pitch LED panel alongside their XR software on the UN Lum Booth.
What is Pixotope Pocket and for whom is it designed?
-Pixotope Pocket is an application designed specifically for students. It allows for tracking and video using a mobile phone, currently running on iOS with Android support coming soon. It enables students to visualize AR elements and previs these elements without needing access to a studio.
How does Pixotope Pocket work in terms of technology?
-Pixotope Pocket works by utilizing a gaming machine, often equipped with an Nvidia GPU, to run Pixotope software. Instead of a traditional broadcast camera, a mobile phone is used for previsualization and incorporating tracking and video directly.
What is Pixo Fly and how does it innovate in the field of virtual production?
-Pixo Fly is a system developed by Pixotope for markless tracking for drones or steady cams. It uses machine learning to develop a point cloud, enabling real-time, low latency tracking without the need for physical markers or sensors in the environment.
How does Pixo Fly's machine learning application differ from traditional tracking methods?
-Traditional tracking methods require physical setup with sensor cameras and markers within the stadium. Pixo Fly eliminates the need for this setup by using machine learning to create a point cloud from the environment, which can be used for tracking and overlaying AR elements.
What is the AI Key that Pixotope has developed and how does it function?
-The AI Key is a new development by Pixotope that allows for chroma key effects without the need for a green screen. It automatically detects people and creates a map to enable the placement of AR elements, allowing presenters to stand in front of and behind AR elements.
What are some potential use cases for the AI Key technology?
-The AI Key can be used in situations where commentators or sports presenters are in an ordinary room, allowing for over-the-shoulder graphics and player elements to be added without the need for a green screen or complex setup.
What is the current status of the AI Key technology and when is it expected to be released?
-The AI Key technology is in its final stages of development, with the AI still learning and being trained. Pixotope expects to release it at the end of summer or the beginning of fall.
What are David Dowling's thoughts on the future of virtual production in the next year or two?
-David Dowling is excited about the future of virtual production, as it is becoming more mainstream and less intimidating. He sees virtual production as just another tool in the production toolkit, with innovations like Pixo Fly making it easier to use and more accessible.
How does Pixotope aim to make virtual production more accessible and easier to use?
-Pixotope aims to make virtual production more accessible by creating easy-to-use interfaces that do not require an engineering degree to operate. They focus on solving problems like tracking outside with user-friendly front-end graphics, allowing operators to press buttons without worrying about the technical complexities.
What is the general sentiment towards virtual production among industry professionals according to the video?
-The general sentiment is shifting towards embracing virtual production as just another part of the production process. The fear factor is being eliminated, and professionals are starting to see virtual production as a valuable tool for enhancing their work.
Outlines
🎬 Virtual Production Solutions by Pixel Toes
The first paragraph introduces the topic of the video, which is the latest updates in virtual production from Pixel Toes. The video features an interview with David from Pixel Toes, who provides an overview of the company's virtual production solution. Pixel Toes has been in business for five years, initially as a production company before transitioning to a software company. Their software aims to assist studios and broadcasters in realizing their virtual production visions. The discussion covers various applications, including extended reality (XR), the Pixel Toes Pocket application designed for students, and the innovative Pixo Fly technology for markless tracking using drones or steadicams. The paragraph also touches on the use of machine learning in Pixo Fly to enable real-time, low-latency tracking.
🤖 AI-Powered Innovations in Virtual Production
The second paragraph delves into the advancements and innovations in virtual production, particularly focusing on AI. Pixel Toes has developed an AI Key, which eliminates the need for a green screen and chroma keying, allowing for AR elements to be placed in front of and behind subjects. This technology is expected to be particularly useful for commentators and sports presenters, enabling them to have on-screen graphics without the need for a green screen. The AI technology is still in the learning phase, with the first release anticipated by the end of the summer or early fall. The paragraph concludes with David expressing excitement about the future of virtual production, as it becomes more integrated into standard production workflows, and the company's commitment to making the technology accessible and user-friendly.
Mindmap
Keywords
Virtual production
Pixotope
Extended Reality (XR)
PIXO Pocket
Machine Learning
Pixo Fly
AI Keyer
Chroma Key
Broadcast Industry
Real-time Tracking
Low Latency
Highlights
Pixotope is a virtual production solution that has been in business for five years as a software company.
Pixotope has its roots as a production company before developing software to assist studios and broadcasters with virtual production.
Extended reality (XR) is a key focus for Pixotope, demonstrated at the UN Lum Booth with a 2.6 pitch LED panel.
Pixotope Pocket is a new application designed for students, combining tracking with video using a mobile phone.
Pixotope Pocket is currently available for iOS and will soon be available for Android.
The application is gaining popularity in the broadcast industry, among videographers, and cinematographers.
Pixotope Pocket is used for previs, allowing students to visualize AR elements without studio access.
Pixotope Fly is a system for markless tracking for drones or steady cams, popular for sports broadcasting and election graphics.
Pixotope Fly uses machine learning to develop a point cloud for tracking, eliminating the need for physical markers.
The AI Kia is a new development that removes the need for a green screen, allowing AR elements to be placed in front of and behind people.
The AI Kia automatically detects people and creates a map for AR element placement.
The AI Kia is expected to have its first release at the end of summer or beginning of fall.
Virtual production is becoming more mainstream, with Pixotope helping to eliminate the fear factor associated with it.
Pixotope is focused on making virtual production tools easy to use, without requiring an engineering degree.
The company is excited about the future of virtual production, seeing it as a natural part of the production process rather than a separate entity.
Pixotope's innovations are being used worldwide in various sports and for election coverage.
The company's advancements in virtual production are aimed at solving real-world problems with easy-to-use interfaces.