超全測評❗️Luma&快手可靈&SORA,誰是最強AI視頻工具?文生視頻/圖生視頻,最強AI生成影片測試|Kling Tutorial|Text to Video & Image to Video

木子AI研究所
12 Jul 202411:22

TLDRThis video offers a comprehensive review of AI video tools, comparing Luma's Dream Machine, Kuaishou's Kelingda, and Sora. The host, Muzi, tests these tools across various scenarios, showcasing their capabilities and limitations in generating realistic videos from text and image prompts. The comparison highlights advancements in AI video generation, noting improved character consistency and action restoration, while also pointing out issues with video definition and detail generation. The review concludes with a look at user-generated content and a table summarizing the features of Dream Machine and Kelingda, suggesting a future where AI could revolutionize video production.

Takeaways

  • 🌟 OpenAI's Sora demo video marked the beginning of a surge in AI video industry advancements.
  • 🚀 Luma's Dream Machine and Kuaishou's Kelingda were released in June and quickly impressed with effects comparable or superior to Sora in some aspects.
  • 🔍 Muzi conducts a comprehensive product test, comparing the top 8 scenes of Vincent Video and the 4 major scenes of Tusheng video, offering an objective view of the AI video generation capabilities.
  • 💻 Dream Machine is accessible to all users without a queue, with a simple interface supporting Vincent Video and Picture Video generation.
  • 📈 Dream Machine offers a free tier with 30 video generations per month, and paid plans range from 24 to 400 'knives' per month.
  • 📱 Kelingda is available on both mobile and web, with certain features like camera movement control exclusive to the web version, and is currently free for a limited time.
  • 🎬 The video script compares Dream Machine, Kelingda, and Sora across 8 AI video-generated scenes, using Sora's official prompts for consistency.
  • 👥 Both Dream Machine and Kelingda show improvements in character and action generation, though some details like hand movements need refinement.
  • 🏆 Sora maintains a strong performance, especially in scenes requiring realistic crowd and character movements.
  • 📹 AI video generation has significantly improved in character consistency and detail restoration, moving from 20% usable results to 80%.
  • 🔮 The future of AI in video production looks promising, with the potential to create blockbuster-quality content in the near future.

Q & A

  • What is the significance of the release of Sora's demo video by Open AI at the beginning of the year?

    -The release of Sora's demo video marked the beginning of a surge in the AI video industry, indicating a significant advancement in AI's capability to generate videos.

  • How do Luma's Dream Machine and Kuaishou's Kelingda compare to previous AI video models?

    -Luma's Dream Machine and Kuaishou's Kelingda are noted for their superior effects, being comparable to and sometimes surpassing Sora in certain scenes, unlike the previous models which were smaller and yielded worse results.

  • What are the main functions of Dream Machine's interface?

    -Dream Machine's interface primarily offers Vincent Video and Picture Video functions, allowing users to generate videos by writing prompts or uploading pictures with specified actions.

  • What elements should be included in the prompts for Dream Machine's Vincent Video?

    -The prompts for Vincent Video should ideally include camera movement, characters, actions, objects, characteristics, scenes, and backgrounds.

  • How many times can an account generate videos for free per month with Dream Machine?

    -An account can generate videos for free 30 times per month with Dream Machine.

  • What are the differences between the web and mobile versions of Keling's functionalities?

    -The web version of Keling offers additional features such as camera movement control and customized first and last frames, which are not available on the mobile version.

  • What is the language preference for Keling's prompt suggestions and why is it beneficial?

    -Keling's prompt suggestions are in Chinese, which is beneficial for users who are not proficient in English, as it allows for better Chinese effects and easier understanding.

  • How does the video generation time differ between Dream Machine and Keling?

    -Dream Machine takes about 2 to 3 minutes to generate a video, while Keling's generation time is slightly longer, around 4-5 minutes for a 5-second video.

  • What is the issue with Dream Machine's generation process as mentioned in the script?

    -Dream Machine has a generation failure issue where the process may fail but still deducts the user's trial points.

  • What is the current status of Keling's availability and pricing?

    -Keling is currently free for a limited time, with no announced charging standards yet. However, based on their existing membership fees, one month is 8 yuan, and one year is 88 yuan.

  • What are the common issues faced by Dream Machine and Keling in video generation?

    -The common issues faced by Dream Machine and Keling include low definition of generated videos and difficulties in generating certain details, such as hand movements.

  • How have the AI video generation capabilities improved over the past year according to the script?

    -AI video generation capabilities have significantly improved in character consistency, detail restoration, and action restoration, moving from a 20% success rate to 80% of results being usable directly.

Outlines

00:00

🚀 Introduction to AI Video Generation Models

The script introduces the advancements in AI video generation with the release of OpenAI's Sora demo video, marking a significant shift in the industry. It highlights the limitations of previous models and the impressive debut of Luma's Dream Machine and Kuaishou's Keling, which have shown capabilities that rival or even surpass Sora in certain aspects. The video aims to provide a comprehensive review and comparison of these models, starting with the top 8 scenes from Vincent Video and the 4 major scenes of Tusheng video, ensuring an objective and fair presentation of their effects. The script also provides a brief on how to access and use Dream Machine and Keling, mentioning their pricing and accessibility.

05:01

📚 Comparative Analysis of Dream Machine and Keling

This section delves into a detailed comparison of the video generation capabilities of Dream Machine and Keling, using 8 common AI video-generated scenes as a benchmark. The script describes the process of generating videos with both platforms, noting the time taken and issues encountered such as generation failures in Dream Machine. It discusses the quality and details of the generated videos, including character consistency, action restoration, and the handling of specific elements like the book in the 'empty mirror' scene. The comparison extends to the generation of multiple characters, animals, and dynamic scenes, concluding with a user's perspective on the overall performance of each model and a call to action for viewers to share their opinions.

10:01

🎨 Exploring AI Video Generation in Various Scenarios

The script continues with an exploration of AI video generation in different scenarios, comparing the performance of Dream Machine and Keling against Sora. It examines the models' ability to generate complex scenes such as a flooded New York, character close-ups, and cartoon animations. The narrative discusses the strengths and weaknesses of each model, including the stability of the generated videos, the accuracy in depicting prompt elements, and the handling of character details. The section also includes a look at user-generated content using these AI models, showcasing the creative potential and the evolving capabilities of AI in video generation.

📊 Final Thoughts and Future of AI Video Generation

In the concluding part of the script, a detailed comparison table is mentioned for Dream Machine and Keling, summarizing their AI video generation functions. The script reflects on the progress made in AI video generation from the beginning of the year to the present, noting significant improvements in character consistency and detail restoration. It acknowledges the current limitations in video definition and detail generation, such as with hands, but expresses optimism about the future of AI in creating blockbuster-quality videos, suggesting that this era is not far off.

Mindmap

Keywords

AI video industry

The AI video industry refers to the sector that utilizes artificial intelligence to create or enhance video content. In the video script, it is mentioned that this industry began to rapidly evolve with the release of the Sora demo video by Open AI. The advancements in AI have made it possible to generate videos that are not only realistic but also capable of surpassing human-made content in certain aspects.

Dream Machine

Dream Machine is a product mentioned in the script that is capable of generating videos using AI. It is compared with other AI video tools like Kuaishou's Kelingda and SORA. The script describes its user interface and functionality, emphasizing its ability to generate Vincent Video and Picture Video, and its current free and paid usage limits.

Kelingda

Kelingda, developed by Kuaishou, is another AI video tool that competes with Luma’s Dream Machine. The script highlights its features, such as camera movement control and customized first and last frames, and notes that it is available for both mobile and web platforms, with certain functions exclusive to the web version.

Vincent Video

Vincent Video, as described in the script, is a type of video generated by writing prompts that include elements like camera movement, characters, actions, objects, and scenes. It is one of the main functions of the Dream Machine and is part of the comparison between different AI video tools in the video.

Tusheng video

Tusheng video, which can be translated as 'image-born video,' is a process where an AI tool generates a video from a single image. The script mentions that users can upload an image and generate a video directly, showcasing the advanced capabilities of AI in creating dynamic content from static images.

Camera movement

Camera movement is a key element in video production that adds dynamism and perspective to the scenes. In the context of AI video generation, as discussed in the script, it is one of the four elements that should be included in the prompts for generating Vincent Videos, indicating the desired motion and perspective of the virtual camera.

Multi-tasking

Multi-tasking, in the script, refers to the ability of AI video tools like Dream Machine and Kelingda to handle multiple video generation tasks simultaneously. This feature is beneficial for users who need to create a batch of videos, enhancing efficiency and productivity.

Character consistency

Character consistency is crucial in video generation, ensuring that characters maintain their visual identity throughout the video. The script discusses how AI models have improved in this aspect, allowing for more realistic and believable video content where characters do not drastically change appearance.

Detail restoration

Detail restoration is the process of enhancing or adding details to video content, particularly in AI-generated videos. The script mentions that AI models have improved in restoring details such as hand movements, which were previously challenging to depict realistically.

AI-generated video results

AI-generated video results refer to the output of video content created by AI tools. The script indicates a significant improvement in the usability of these results, with an increase from 20% to 80% of videos being directly usable without major edits, showcasing the advancement in AI video generation technology.

C-end users

C-end users, short for 'consumer-end users,' are the end consumers who use a product or service. In the script, it is mentioned that Dream Machine and Kelingda are made available to these users, unlike Sora, which has not been open to everyone, highlighting the accessibility of certain AI video tools.

Highlights

Open AI released the Sora demo video, initiating a surge in the AI video industry.

Luma's Dream Machine and Kuaishou's Kelingda models amazed the world with effects surpassing Sora in some scenes.

Dream Machine is open to all users without a queue and offers a simple interface for video generation.

Dream Machine allows free generation 30 times per month and offers paid plans for more frequent use.

Keling is available on both mobile and web, with certain features exclusive to the web version.

Keling offers a limited-time free trial and has a questionnaire link to speed up the application process.

Keling's prompts are in Chinese, catering to non-English speakers and potentially offering better results.

A comparison of 8 common AI video-generated scenes was conducted using Sora's prompts for consistency.

Dream Machine and Keling can extend video duration from 5 to 10 seconds, with Keling extending up to 30 seconds.

Dream Machine encountered generation failures that still deducted trial points.

Keling's video generation is stable with fewer failures and supports multi-tasking for batch video generation.

Sora's video generation is considered the strongest, but may have undergone secondary editing.

Dream Machine and Keling show good performance in generating videos with multiple characters and complex scenes.

Keling's video generation is praised for its detail and realism, despite some minor issues.

Dream Machine and Keling's character generation maintains consistency and can perform movements effectively.

AI video generation has significantly improved in character and detail restoration, moving from 20% to 80% usable results.

The future of AI video generation is anticipated to be capable of creating blockbuster-quality content.