Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

MDMZ
15 Apr 202306:52

TLDRThis tutorial demonstrates how to use a smartphone and Luma AI to create cinematic, FPV-like videos by scanning your surroundings. It offers tips for shooting in 4K, disabling HDR and stabilization, and capturing loops from different heights. The video guides you through the process of uploading footage to Luma, editing in a browser-based editor, and manipulating camera movements with keyframes. It also covers workarounds for vertical video export, enhancing motion with focal length changes, and integrating drone footage for unique perspectives.

Takeaways

  • 📱 Use your smartphone to scan surroundings and create cinematic camera movements with Luma AI.
  • 📷 For iPhone users, the Luma app offers real-time guidelines for easier scanning.
  • 🤖 Android users can upload videos to Luma through a browser after recording.
  • 🎥 Record in 4K with HDR and video stabilization turned off for best results.
  • 🔄 Capture video loops from three different heights: chest level, above head, and knee level.
  • 📐 Keep the subject centered in the frame throughout the recording.
  • 💻 Visit lumalabs.ai to create an account and upload your video for processing.
  • 🌐 Download the 3D scene for use in other software or edit camera movements in Luma's browser-based editor.
  • 🎞️ Use camera tools to create custom keyframes for animated camera movements.
  • 🔄 Switch to orbit mode in the motion tab for easier camera control and subject focus.
  • 🛠️ Adjust camera settings, including focal length and roll, between keyframes for dynamic effects.
  • 📹 Fill in unrecorded areas with a solid background color or adjust video resolution before exporting.
  • 📹 Use Luma to process vertical videos for social media after rendering in landscape mode and cropping.
  • 🛸 Scan with a drone by manually orbiting the subject or using the drone's built-in orbit feature.
  • 📈 Upscale video to 4K using AI tools like Topaz Video AI before processing with Luma for better quality.
  • 🎨 Combine Luma scans with other AI video tools for unique and creative video effects.

Q & A

  • What is the main purpose of the video?

    -The main purpose of the video is to demonstrate how to use a smartphone to scan surroundings and create cinematic camera movements in post-production with Luma AI, including creating FPV-like videos with a regular DJI drone.

  • Is there a specific app recommended for iPhone users to use with Luma AI?

    -Yes, for iPhone users, the dedicated Luma app is recommended as it provides real-time guidelines.

  • Can Android users also use Luma AI to scan and upload videos?

    -Yes, Android users can capture their videos and upload them directly to Luma from their browser.

  • What video settings are recommended before shooting with Luma AI?

    -It is recommended to shoot in 4K, disable HDR, and disable video stabilization. Using either a wide or normal focal length is suggested.

  • How many different heights should be used when capturing video loops for Luma AI scanning?

    -Three different heights should be used when capturing video loops: chest level, above the head, and knee level.

  • What should be the focus when capturing the video loops for Luma AI?

    -The subject should be kept in frame and centered throughout the video loops.

  • What is the process after recording the video for Luma AI?

    -After recording, one should go to lumalabs.ai, create an account, upload the video, give the project a descriptive name, and wait for it to process.

  • How can the 3D scene created by Luma AI be used in other software?

    -The 3D scene can be downloaded as an object or mesh scene and used in other 3D software.

  • What are the two different preset trajectories available in Luma AI's browser-based editor for camera movements?

    -The two different preset trajectories are 'orbit' and 'oscillate'.

  • Can the video resolution be changed in Luma AI before exporting?

    -Yes, the video resolution can be changed before exporting in Luma AI.

  • What is a recommended plugin to add motion blur to videos created with Luma AI?

    -The recommended plugin to add motion blur is RSMB, which can be found in the description box of the video.

  • How can one overcome the limitation of not being able to rotate videos in Luma AI?

    -One can edit each keyframe and add 90 degrees to the camera roll setting to simulate rotation, although this process can be time-consuming.

  • What is the workaround for the lower resolution limitation when using the DJI Mini 3 Pro's built-in orbit feature?

    -The workaround is to use Topaz Video AI to upscale the video to 4K before processing it through Luma.

Outlines

00:00

📱 Post-Production Camera Movements with Luma AI

This paragraph introduces the video's focus on using a smartphone to capture surroundings and create cinematic camera movements in post-production with Luma AI. It highlights the potential of using a DJI drone for FPV-style videos and mentions the importance of following specific camera settings for optimal results. The paragraph also advises on shooting techniques, such as capturing loops from different heights, and provides a brief mention of a collaboration with Umar and Tarving from Product Nation, who documented the process and challenges in a separate video. The speaker then guides viewers on how to upload and process their videos using Luma AI's website and editor, emphasizing the importance of editing keyframes and camera settings to achieve desired camera movements.

05:02

🔧 Enhancing Video Quality and Customizing Camera Movements

The second paragraph delves into the technical aspects of enhancing video quality and customizing camera movements using Luma AI. It discusses the process of exporting 3D scenes and editing them in a browser-based editor, as well as the use of camera tools and layers to refine the video's background. The speaker shares tips on adjusting camera angles, focal lengths, and keyframe animations to create dynamic and interesting camera movements. Additionally, it covers the workaround for the inability to rotate videos in Luma AI by editing keyframes to achieve a vertical video output. The paragraph also touches on the use of AI video tools like Topaz Video AI for upscaling and RunwayML's Gen 1 for unique video creations, and it concludes with an encouragement to stay creative and a sign-off for the next video.

Mindmap

Keywords

FPV (First Person View)

FPV refers to the first-person perspective that is achieved in video games, flight simulations, and drone videography. It gives the viewer the sensation of being in the driver's seat or piloting the drone. In the context of the video, the creator is teaching how to use a phone and Luma AI to create videos that mimic the immersive experience of FPV, particularly for drone footage.

Luma AI

Luma AI is a technology or software mentioned in the script that facilitates the creation of cinematic camera movements in post-production by scanning surroundings with a phone. It plays a central role in the video's tutorial, showing how to achieve dynamic and smooth camera paths that enhance the visual storytelling.

DJI Drone

A DJI Drone is a type of unmanned aerial vehicle (UAV) manufactured by the company DJI, renowned for its high-quality cameras and flight stability. In the script, the creator discusses using a DJI drone to capture footage from different heights, which is then processed with Luma AI to create FPV-like videos.

4K

4K is a term used to describe a display resolution of approximately 4,000 pixels horizontally, which is four times that of Full HD. In the video script, the creator recommends shooting in 4K to ensure high-quality footage that can be manipulated effectively in post-production with Luma AI.

HDR (High Dynamic Range)

HDR is a technology that enhances the luminosity range of an image or video, allowing for more detail in both shadows and highlights. The script advises disabling HDR when shooting footage for Luma AI processing, likely to maintain consistency and reduce computational complexity in post-production.

Video Stabilization

Video stabilization is a technique used to reduce the effects of camera shake in video footage. The script suggests disabling this feature when recording, as the intention is to capture raw footage that can be stabilized and manipulated in post-production using Luma AI.

Loops

In the context of the video, loops refer to continuous video recordings taken from different heights while maintaining a consistent path or route. Capturing loops is part of the process of creating a 3D scan of the environment for later manipulation with Luma AI.

3D Scene

A 3D scene in the script refers to the virtual environment created from the phone's video footage after processing with Luma AI. This scene can be downloaded and used in other 3D software or edited within Luma's browser-based editor to create dynamic camera movements.

Keyframes

Keyframes are points in an animation or video editing timeline that define the start and end of a motion or change. The script describes how to use keyframes in Luma AI's editor to animate the camera movement over time, creating a smooth and dynamic visual path.

Orbit Mode

Orbit mode, as mentioned in the script, is a preset trajectory in Luma AI's camera tool that allows the camera to move around a subject in a circular path. This mode simplifies the process of creating a smooth,环绕式 camera movement that focuses on the subject.

Motion Blur

Motion blur is a visual effect that occurs in still images or video when an object in motion is captured, giving the impression of motion. The script recommends adding motion blur in post-production for a more realistic and natural look, using a plugin like RSMB to enhance the renders created with Luma AI.

Highlights

Using a phone to scan surroundings and create cinematic camera movements with Luma AI.

Enhancing regular DJI drone footage to achieve FPV-like videos.

The potential of Luma AI despite average video quality.

iPhone users can utilize the dedicated Luma app for real-time guidelines.

Android users can upload videos to Luma through a browser.

Camera settings recommendations for optimal scanning: 4K, no HDR, no stabilization.

Capturing video loops from three different heights for a complete scan.

Keeping the subject in frame and centered for consistency.

Editing and exporting 3D scenes or using the browser-based editor for camera manipulation.

Using camera tools and layers to refine visibility in post-production.

Exporting video with improved quality over the initial preview.

Utilizing preset trajectories or custom keyframes for camera animation.

Adjusting camera settings for dynamic and interesting motion effects.

Filling unrecorded areas with a solid background color in Luma.

Exporting video at different resolutions and cropping for vertical video platforms.

Maximizing output quality by editing keyframes and adjusting camera roll.

Combining Luma scans with AI video tools like Gen 1 from RunwayML for unique creations.

Staying creative and exploring the possibilities of Luma AI and AI video tools.

Casual Browsing

3D Scan your Environment with AI (Free Tool)

2024-06-18 03:45:00

Create AMAZING 3D Videos With MIDJOURNEY (FULL COURSE!)

2024-06-12 11:30:00

Create Stunning AI Videos for FREE with Luma Labs Dream Machine!

2024-06-18 00:10:00

AI Animation Generator : Create YOUR OWN 3D Movie With AI

2024-04-28 15:50:00

Create Digital Art & 3D Graphics in Your Brand Style with Recraft AI

2024-09-07 03:08:00