The film industry has always been a space of innovation, creativity, and technological advancements. In recent times, artificial intelligence has emerged as a powerful tool, contributing to a fascinating revolution in how we experience and create cinematic content. This article explores two distinct but interconnected trends that showcase the transformative impact of AI on the film industry: the rise of #verticalmovies on TikTok and the application of Photoshop’s Generative AI to extend vertical videos.

#VerticalMovies on TikTok

Social media platforms have become breeding grounds for creative experimentation, and TikTok is at the forefront of this trend. Creators like @artstuffandthings and @walidfatam are using AI to reimagine iconic and nostalgic cinema originally filmed in traditional horizontal format for the vertical screen. One example is the adaptation of “The Land Before Time”, a beloved classic.

Under the hashtag #verticalmovies, these creators use AI to fill out the image, reformatting scenes to take up a whole vertical phone screen. The response on social media has been nothing short of emotional, with users expressing emotions like “You made me cry again like I was watching it for the first time.” This trend is not just about a format tweak; it’s a powerful example of using AI to bridge the gap between the past and the future. In a digital culture torn between nostalgia and the quick evolution of technology, #verticalmovies demonstrates how AI can be a tool for preserving and reconnecting with cherished moments from the past.

Extending Vertical Videos with Photoshop’s Generative AI

Another intriguing development involves using Photoshop’s Generative AI to extend vertical videos. This trend looks into the process of taking a 16x9 film in its original widescreen horizontal format and fitting it into a 9x16 vertical social media composition.

The process involves selecting static video clips with a locked-off camera, taking screenshots, and pasting them into Photoshop beta for resizing. In simpler terms, it consists of leaving the top and bottom of the video blank and using Photoshop’s Generative AI to fill these spaces. 

Using the “generative fill” feature, Photoshop’s Generative AI provides creative prompts for refining the AI-generated content. After disabling the original video and background layers, the result is a seamlessly extended vertical video that can be saved as a PNG file.

Back in DaVinci Resolve, the timeline and the PNG file are imported to fit the vertical frame. Despite potential minor blurriness, these issues are often undetectable once the video is compressed for social media. Adding a finishing touch involves combining layers into a compound clip and introducing grain for a seamless blend.

The result is a visually striking vertical video that adds a unique twist to the viewing experience. Additionally, it highlights the adaptable and versatile nature of AI in creative efforts. While some may question the fidelity to the filmmaker’s original vision, it’s an undeniable example of the playful and creative applications of AI in the film industry. 

AI’s Magic in Filling Cinematic Gaps

The intersection of AI and the film industry reaches new heights with the ingenious use of StableDiffusion. Reddit users have shared a video showcasing the application of StableDiffusion to fill in the tops and bottoms of shots from the Harry Potter film series. What sets this apart is the level of authenticity achieved, making it appear as though these scenes were originally filmed in a vertical orientation. 

In the video, only a fraction of the image is sourced from the actual movie, while the rest is seamlessly generated by StableDiffusion. Scenes ranging from hospital rooms to the iconic Hogwarts school hall are transformed with an uncanny realism that has left viewers impressed. AI’s ability to generate believable sets from the film franchise demonstrates its capability to understand the visual elements and maintain the aesthetic integrity of the original content.

While the footage has created admiration for its elegant implementation of AI in content creation, users have raised valid points about potential limitations. Some users note that the effectiveness of StableDiffusion may vary depending on the type of scenes it encounters. It works beautifully on static or locked camera shots, or those that can be tracked and stabilised. However, challenges may arise with scenes involving dynamic movement or subjects crossing the edges of what’s being outpainted, leading to potential flickering and inconsistency issues.

As AI continues to make its mark on the film industry, we witness a blend of creativity, nostalgia, and technology. From #verticalmovies on TikTok to extending videos with Photoshop’s Generative AI, and creating cinematic magic with Stable Diffusion, AI is proving to be a dynamic force shaping the future of filmmaking. These trends not only highlight the technical capabilities of AI but also emphasise its emotional resonance, as it becomes a bridge between cinematic heritage and the evolving landscape of digital storytelling.

Check out our AI Hub to learn more about how AI is shaping all kinds of industries!