ΑΙhub.org
 

Using neural networks to “upscale” old films


by
06 February 2020



share this:

The famous short, silent film L’arrivée d’un train en gare de La Ciotat, produced by Auguste and Louis Lumière in 1896, hit the news this week. AI developer Denis Shiryaev used a combination of Gigapixel AI and depth-aware video frame interpolation (DAIN) to “upscale” the film to 4k, 60 frames-per-second quality.

You can watch the upscaled video here:
https://www.youtube.com/watch?v=3RYNThid23g

Here is the original version for comparison:

There were two parts to creating this upscaled video. Firstly, the enhancement to 4k resolution. The algorithm used for this is based on neural networks and was trained with millions of photos. The training process helped to create a sophisticated network that learned the best way to enlarge, enhance, and create natural details.

In addition to the enhanced resolution, Shiryaev utilised DAIN to add frames per second. This video frame interpolation method was developed by Wenbo Bao and colleagues (Shanghai Jiao Tong University, University of California, Merced, and Google) and aims to synthesize new frames in between the original frames. In their arXiv article from April 2019 they propose a novel depth-aware video frame interpolation algorithm which explicitly detects occlusion (when one object in a 3D space is blocking another object from view) using depth information. They developed a depth-aware flow projection layer to synthesize intermediate flows that preferentially sample closer objects rather than those further away. Their algorithm also learns hierarchical features to gather contextual information from neighbouring pixels. The model then warps the input frames, depth maps, and contextual features within an adaptive warping layer. Finally, a frame synthesis network generates the output frame using residual learning.

Shiryaev has also added a colour version which was made using DeOldify. DeOldify was created by Jason Antic and employs Generative Adversarial Networks (GANs) to colorize black and white images.
https://youtu.be/EqbOhqXHL7E




Lucy Smith is Senior Managing Editor for AIhub.
Lucy Smith is Senior Managing Editor for AIhub.




            AIhub is supported by:


Related posts :



#ICRA2025 social media round-up

  23 May 2025
Find out what the participants got up to at the International Conference on Robotics & Automation.

Interview with Gillian Hadfield: Normative infrastructure for AI alignment

  22 May 2025
Kumar Kshitij Patel spoke to Gillian Hadfield about her interdisciplinary research, career trajectory, path into AI alignment, law, and general thoughts on AI systems.

PitcherNet helps researchers throw strikes with AI analysis

  21 May 2025
Baltimore Orioles tasks Waterloo Engineering researchers to develop AI tech that can monitor pitchers using low-resolution video captured by smartphones

Interview with Filippos Gouidis: Object state classification

  20 May 2025
Read the latest interview in our series featuring the AAAI/SIGAI Doctoral Consortium participants.

#AAAI2025 workshops round-up 3: Neural reasoning and mathematical discovery, and AI to accelerate science and engineering

  19 May 2025
We find out about three more of the workshops that took place at AAAI 2025.

What’s coming up at #ICRA2025?

  16 May 2025
Find out what's in store at the IEEE International Conference on Robotics & Automation, which will take place from 19-23 May.

AI Song Contest returns for 2025

  15 May 2025
This year's competition will culminate in a live award show in November.

Robot see, robot do: System learns after watching how-tos

  14 May 2025
Researchers have developed a new robotic framework that allows robots to learn tasks by watching a how-to video



 

AIhub is supported by:






©2025.05 - Association for the Understanding of Artificial Intelligence


 












©2025.05 - Association for the Understanding of Artificial Intelligence