I made 60fps Flipbooks using A.I.

Andymation
22 Apr 202208:04

TLDRIn this video, the creator explores the effects of using AI frame interpolation software to enhance the frame rate of flipbooks from 12 frames per second (fps) to 60 fps. The experiment involves running the flipbooks through AI motion smoothing to see how well the technology performs. The creator expresses initial skepticism about artificial motion smoothing, preferring the original 12 fps animation for its authenticity and impact. After re-filming the flipbooks with a high shutter speed to eliminate blur, the AI-generated 60 fps versions are observed to have some weird frames and a loss of crispness. The creator concludes that while the technology is interesting, it cannot replicate the original animator's intent and prefers the original animation for its snap and timing. The most successful result was with the balloon flipbook, which appeared cleaner. The video ends with a call for viewer opinions on motion smoothing and an encouragement to stay creative.

Takeaways

  • 🎬 The video is an experiment to see if AI frame interpolation software can increase the frame rate of a flipbook from 12fps to 60fps.
  • 🤖 AI motion smoothing can make video appear smoother but is not always preferred, as it can look fake and is often the first feature turned off on TVs.
  • 📚 The process involves taking a 12fps animation and interpolating it to 60fps, which means 80% of the final frames would be artificially generated.
  • 🤔 The creator is skeptical about the outcome, preferring the original animation's intent and timing over the smoothed version.
  • 📸 To achieve the best results, the flipbook needs to be re-filmed with a high shutter speed to avoid blur and duplicate frames.
  • 🖥 Editing the video in software like Final Cut Pro involves removing all blurred or duplicate frames to create a clean 12fps video.
  • 💻 Using AI frame interpolation software requires a decent video card, as it can be very slow without one.
  • 🧐 The final AI-generated video shows some weirdness and loss of crispness compared to the original animation.
  • 🎈 The most successful AI interpolation was with the balloon flipbook, which was relatively clean.
  • 👎 The creator remains a purist, preferring the original animation and finding that motion smoothing turns the movements into 'wobbly Jello'.
  • 💭 The video ends with a call for viewer opinions on whether they prefer the original or AI-smoothed versions and an encouragement to stay creative.

Q & A

  • What is the original frame rate of the flipbook mentioned in the video?

    -The original frame rate of the flipbook is 12 frames per second.

  • What frame rate does the video experiment aim to increase the flipbook animation to?

    -The video aims to increase the flipbook animation to 60 frames per second.

  • Why does the creator not like artificial motion smoothing on TVs?

    -The creator finds artificial motion smoothing on TVs to look fake and terrible, which is why it's the first feature they turn off.

  • What percentage of the final animation would be artificial if the flipbook is increased from 12 to 60 frames per second?

    -If the flipbook is increased from 12 to 60 frames per second, 80 percent of the final animation would be artificial.

  • What software does the creator use for frame interpolation?

    -The creator uses a software called Rife for frame interpolation.

  • What is the main challenge when trying to create a clean video of the flipbook at 12 frames per second?

    -The main challenge is to have a clean video without any blur frames and redundant frames, which requires filming the pages one at a time as stop motion with a high shutter speed.

  • What is the creator's opinion on the final result of the AI-generated 60fps flipbook?

    -The creator finds some frames to be weird and the animation to lose its crispness and original intention, resulting in an overly smoothed and wobbly effect.

  • What does the creator believe is lost in the smoothed versions of the animations?

    -The creator believes that the smoothed versions lose the feelings of snap and impact, mess up the timing of the movements, and overall turn the animations into wobbly Jello.

  • Which of the AI-generated flipbooks did the creator find most successful?

    -The creator found the balloon flipbook to be the most successful and clean in the AI-generated version.

  • What does the creator encourage viewers to do in the comments section?

    -The creator encourages viewers to share their opinions on whether they prefer the original or the AI-smoothed versions and to engage in a discussion about their preferences.

  • What is the creator's final stance on motion smoothing technology?

    -The creator maintains a preference for the original animations and does not favor motion smoothing, despite finding the experiment interesting and acknowledging the technology's potential.

  • What advice does the creator give to the viewers at the end of the video?

    -The creator advises the viewers to stay creative and looks forward to seeing them in the next video.

Outlines

00:00

🎬 Experimenting with AI Frame Interpolation on Flip Books

The speaker discusses an experiment involving the use of AI frame interpolation software to increase the frame rate of flip books from 12 frames per second (fps) to 60 fps. They express skepticism about the quality of motion smoothing on TVs but are curious to see the effect on flip book animations. The process involves using software named Rife to interpolate frames, which is a challenging task due to the need to create many new frames and the presence of blur from page movement. The speaker decides to re-film the flip book with a high shutter speed to create a clean video without blur frames. After running the clean video through the AI software, they observe some weirdness and loss of crispness in the final animation, indicating that 80% of the frames are artificially generated.

05:00

📹 Testing AI-Generated 60fps on Stop-Motion Flip Books

The speaker proceeds to test the AI frame interpolation on stop-motion versions of their flip books. They share the results of running these through the software at an AI-generated 60fps and then conduct a final test on a larger flip book titled 'return of grumpy Cloud.' Upon reviewing the AI versions, they note that while there is some weirdness, it's intriguing to consider that 80% of the content is artificially created. The speaker, identifying as a purist, prefers the original animations and feels that motion smoothing fails to capture the animator's original intent, leading to a loss of impact and timing. They find the balloon animation to be the most successful after smoothing. The speaker concludes by inviting viewers to share their opinions on motion smoothing and encourages them to stay creative.

Mindmap

Keywords

Flipbook

A flipbook is a simple form of animation that consists of a series of pictures, usually drawn on the pages of a small book, that when flipped rapidly produce the illusion of motion. In the video, the creator discusses making flipbooks and enhancing their frames using AI, which is central to the experiment.

Frame interpolation

Frame interpolation is a process that involves generating new frames between existing ones to increase the frame rate of a video or animation. The video script describes an experiment where the creator uses AI software to interpolate frames in a flipbook animation to boost it from 12 to 60 frames per second.

Artificial motion smoothing

Artificial motion smoothing is a technique used to make video content appear smoother by adding frames that were not originally there. The creator expresses their personal dislike for this technique on TVs, as they feel it looks fake and detracts from the original animation's intent.

Frames per second (FPS)

Frames per second (FPS) is a measure of how many images (frames) are displayed in one second of a video or animation. The higher the FPS, the smoother the motion appears. The video discusses increasing the FPS from 12 to 60 to see the effect on the flipbook animation.

AI motion smoothing

AI motion smoothing refers to the use of artificial intelligence to create the appearance of smoother motion by generating additional frames. The video is an experiment with AI motion smoothing on flipbook animations to see how it affects the final product.

Stop motion

Stop motion is a type of animation technique where objects are physically manipulated in small increments between individually photographed frames, creating the illusion of movement when the series of frames is played as a continuous sequence. The creator discusses re-filming the flipbook using stop motion to create a clean video for the AI frame interpolation.

Shutter speed

Shutter speed is the length of time that a camera's shutter is open during a single shot, which affects the amount of light that reaches the camera sensor and can influence the sharpness of an image. The script mentions using a high shutter speed to ensure crisp frames for the flipbook animation.

Video card

A video card, also known as a graphics card, is a type of computer hardware that processes and outputs images to a display. The script notes that running AI frame interpolation software requires a decent video card, as the process can be slow without one.

Jiggliness

Jiggliness refers to the unsteady or shaky movement of an image. In the context of the video, the term is used to describe the unnatural movement that can occur when too much artificial motion smoothing is applied to an animation.

Snap and impact

Snap and impact refer to the sharpness and forcefulness in an animation's movement. The creator argues that AI motion smoothing can cause a loss of these qualities, making the animation feel less dynamic and more like 'wobbly Jello'.

Purist

A purist is someone who strongly adheres to traditional or original forms and methods. The creator identifies as a purist, preferring the original, unaltered animation over the AI-smoothed versions, as they believe the latter lacks the original intent and timing of the animator.

Highlights

The experiment involves using AI frame interpolation to increase the frame rate of flipbooks from 12fps to 60fps.

AI motion smoothing is used to artificially increase frame rates, but it's not always preferred due to a fake appearance.

The creator expresses a personal dislike for artificial motion smoothing on TVs, considering it to look fake and terrible.

Interpolating from 12fps to 60fps involves creating four artificial frames for every real frame, resulting in 80% of the final animation being fake.

The use of frame interpolation software called Rife to process the flipbook animations.

Challenges faced include redundant frames and blur from page movement in the original 24fps video footage.

The need for a clean video at 12fps without blur frames for effective AI processing.

Re-filming the flipbook with a high shutter speed to eliminate blur and duplicate frames.

The process of editing the video in Final Cut Pro to remove blur and duplicate frames, resulting in a clean 12fps video.

The AI software's requirement for a decent video card for efficient processing, as it can be very slow otherwise.

Observations of the AI-generated video showing some weird frames and a loss of the original animation's crispness.

The creator's preference for the original animation over the smoothed versions, due to the loss of snap and impact.

The belief that fake motion smoothing cannot match the original animator's intention and disrupts the timing of movements.

The most successful AI interpolation was with the balloon flipbook, which was noted to be pretty clean.

An invitation for viewers to disagree with the creator's opinion on motion smoothing and share their thoughts in the comments.

The conclusion that despite the interesting results, the creator still does not favor motion smoothing.

A call to stay creative and an anticipation for the next video.

Casual Browsing

I Made MIDJOURNEY in SCRATCH 🌄🔥

2024-06-11 18:50:01

How I made $170K selling stock photos.

2024-09-25 17:28:00

I made $11K Selling BASIC Digital Products on Etsy

2024-05-17 11:25:03

Creating Realistic Renders from a Sketch Using A.I.

2024-05-07 06:15:01

How I Made AI Assistants Do My Work For Me: CrewAI

2024-05-17 19:30:03