The Dream Within Pictures
Follow TheDreamWithinPictures on Twitter

Using AI to Colorize and Upscale a 109-Year-Old Video of New York City to 4K and 60fps

After the success of his last attempt at using AI to upscale a classic short film to 4K and 60fps, YouTuber Denis Shiryaev decided to take this experiment one step further. He took this well-known film of New York City in 1911, and used publicly available neural networks to upscale it to 4K, increase the frame rate to 60fps, and colorize the video.

As with his previous attempt, we expect that the frame interpolation and upscaling were done using Google’s DAIN and Topaz Labs’ Gigapixel AI. That got Shiryaev to 4K and 60fps. Then he “restored the video’s sharpness”—though he doesn’t say what he used—and due to popular demand, he enlisted the “DeOldify” Neural Network to automatically colorize the footage.

Here’s the original, which we actually shared with our readers back in April of 2018:

And here’s the upscaled and colorized version version:

Unlike the short video he attempted first, this is over 8 minutes of footage, but the results are once again surprisingly good—as long as you don’t punch in too close. The biggest disappointment is probably the colorizing, which is okay for some parts and abysmal for others.

Still, the fact that all of this was automatically, and produced such a surprisingly watchable result—creating frames, resolution, and color out of thin air—is mind-blowing in and of itself.

(via Reddit)

[via PetaPixel]

Visitors: 154

Comments are closed.

comments-bottom

Featured Photos

A Rose… Posted by author icon The Dream Within Jan 16th, 2012 | no responses
Eclipse Posted by author icon The Dream Within Dec 9th, 2011 | no responses
”In a strange land” Exhibi... Posted by author icon Jean-Luc Dushime Sep 24th, 2011 | no responses

Random Photos

The Dream Within Pictures ... Posted by author icon The Dream Within May 24th, 2014 | Comments Off on The Dream Within Pictures is on see | me… Please show your support…
Burning Sky Posted by author icon The Dream Within Dec 25th, 2012 | Comments Off on Burning Sky
Monkey Forest Posted by author icon The Dream Within Dec 25th, 2012 | Comments Off on Monkey Forest
“In a strange land” Exhibi... Posted by author icon Jean-Luc Dushime Sep 30th, 2011 | no responses
The Mexican Posted by author icon The Dream Within Mar 21st, 2011 | no responses
Sunset Tower Posted by author icon The Dream Within Dec 25th, 2012 | Comments Off on Sunset Tower
Butterfly Posted by author icon The Dream Within Dec 25th, 2012 | Comments Off on Butterfly
Shutters 1 Posted by author icon The Dream Within Mar 24th, 2011 | no responses
Sparkle Posted by author icon The Dream Within Dec 25th, 2012 | Comments Off on Sparkle
The Man Posted by author icon The Dream Within Mar 19th, 2012 | no responses

Top Rated

A Rose… Posted by author icon The Dream Within
1 Star2 Stars3 Stars4 Stars5 Stars (8 votes, avg: 3.75 out of 5)
Loading...
Lovers #2 Posted by author icon The Dream Within
1 Star2 Stars3 Stars4 Stars5 Stars (4 votes, avg: 3.75 out of 5)
Loading...
Lovers #1 Posted by author icon The Dream Within
1 Star2 Stars3 Stars4 Stars5 Stars (6 votes, avg: 3.00 out of 5)
Loading...