Old game's CGI upscaled Machine Learning AI

[R.T Straker]

So this guy has an amazing youtube channel in which he uploads old game's cinematics and bring them to much higher qualtiy using some sort of machine learning tehnuqie. You can find some from Warcraft, Diablo, FF, Dino Crisis, PoP and many more.

https://www.youtube.com/channel/UC33rC3GO1UZFAkMcCCwjyWg/videos

That's pretty amazing.

 

[wwm0nkey]

Did this one myself, big spoilers for Phantom Dust



Trying to do Namco vs Capcom OP right now.

 

[R.T Straker]

Did this one myself, big spoilers for Phantom Dust



Trying to do Namco vs Capcom OP right now.

Click to shrink...

That looks spectacular.

How hard is it do actually do one of those?

 

[PLASTICA-MAN]

Wow even CGI gets improved with AI ? AI is scary. Don't let it sprawl over everything. :p

 

[wwm0nkey]

That looks spectacular.

How hard is it do actually do one of those?

Click to shrink...

Not too bad, ffmpeg to get all frames > gigapixel the games (500 at at time for me) > reassemble in ffmpeg

 

[jett]

This is not CGI, but it's one of the most impressive results I've seen yet.



Made by Laserschwert

 

[BakedTanooki]

Wow, this makes me want to rewatch like thousands of PS1 and PS2 openings.
Super impressive.

 

[UnluckyKate]

I wonder how this would work on pixel art games like 3rd strike, it has superb animations but SD resolution

 

[Jaoox]

Wow this is so cool.

Can you imagine if Square actually put effort in those PS1 FF releases. Thanks for modders I guess

 

[RestEerie]

Can anyone do those for the ps1 final fantasy, especially 9?

Imagine that bahamut vs alexander fight in 4k

 

[Mars People]

Wow this is so cool.

Can you imagine if Square actually put effort in those PS1 FF releases. Thanks for modders I guess

Click to shrink...

Yeah thankfully modders have done great work trying to fix Square's sub par rereleases.
Like how is it modders can produce amazing results at home where billion dollar companies cannot?

 

[Deleted member 2507]

Fucking magic

 

[R.T Straker]

Not too bad, ffmpeg to get all frames > gigapixel the games (500 at at time for me) > reassemble in ffmpeg

Click to shrink...

That's actually quite simple.

Thanks!

 

[Jazzem]

This makes the next few years of texture+FMV mods so darn exciting. Hopefully the same for official remasters or rereleases of games too

 

[Tizoc]

Some of these could do with some more work or improvement but their effort is commendable

 

[Hanbei]

Yes

 

[BlueManifest]

If regular people are using this why aren't devs?

 

[halfjoey]

Are there any devs here who can give insight as to why more companies arent using this for their remasters?

FF8 and FF9 modern console releases would have much better backgrounds.

 

[Deleted member 37739]

It's fantastic tech - modders have been using these to completely upscale pre-rendered backgrounds and textures from PS1/PS2 games with some fantastic results. The RE2 work is great.

 

[Tedmilk]

Oh man, this makes me want a COMI remaster even more!

 

[SunBroDave]

There's a thread already:
https://www.resetera.com/threads/ai...for-older-games-you-can-do-it-yourself.88272/

 

[R.T Straker]

There's a thread already:
https://www.resetera.com/threads/ai...for-older-games-you-can-do-it-yourself.88272/

Click to shrink...

Not the same thing.

 

[kvetcha]

someone do all the FMVs from The Horde. tia.

 

[Wetalo]

There was a thread about this a few months ago, the Solatorobo opening was the one that really blew me away. Has a huge impact on DS and PS1 FMV's.

https://www.youtube.com/watch?v=stI_G2DBWUk

 

[Deleted member 20297]

I wonder what it can do to Saturn videos. These were horribly low bitrate because Sega didn't use mjpeg like Sony did :(

 

[Psychotron]

That's amazing. Also, I want a Soul Reaver remaster/remake so bad.

 

[Het_Nkik]

Trying to do Namco vs Capcom OP right now.

Click to shrink...

Please! That opening is so hype I watched it every time I turned the game on to play it.

 

[mute]

Yeah thankfully modders have done great work trying to fix Square's sub par rereleases.
Like how is it modders can produce amazing results at home where billion dollar companies cannot?

Click to shrink...

My uneducated guess is Square is worried about who would come asking for money if they used the tech

 

[HanSoloCup]

Can anyone do those for the ps1 final fantasy, especially 9?

Imagine that bahamut vs alexander fight in 4k

Click to shrink...

YES! That would be awesome.

 

[HighlanderCZ]

Huh, so in theory, could someone upscale the entirety of an FMV game using this? I'd play Phantasmagoria 2 again in 4K…

 

[JoJo'sDentCo]

I wanna see the Demon's Souls introCG!

edit: Found it!

 

[Deleted member 49535]

If regular people are using this why aren't devs?

Click to shrink...

I was wondering the same thing.

 

[Garlador]

Huh, so in theory, could someone upscale the entirety of an FMV game using this? I'd play Phantasmagoria 2 again in 4K…

Click to shrink...

In theory... yeah. I imagine that'd be possible.

 

[MP!]

Do we know what AI is being used here?

 

[Quantza]

Is this done per frame, or is there some kind of neural net for super-resolution video?
EDIT: Crono's face at 2:14 tho.

 

[harry the spy]

Do we know what AI is being used here?

Click to shrink...

GANs, I'm pretty sure

 

[Horp]

Nah sorry looks pretty garbage.

 

[Deleted member 12790]

If regular people are using this why aren't devs?

Click to shrink...

Developers use interpolation techniques all over gamedev. Interpolation is one of the primary tasks of GPU programming.

 

[harry the spy]

Developers use interpolation techniques all over gamedev. Interpolation is one of the primary tasks of GPU programming.

Click to shrink...

This is not really interpolation in the traditional sense though.

 

[residentgrigo]

The Gaming Restoration´s work:

RESIDENT EVIL OUTBREAK Intro (Remastered in 4K using AI Machine Learning) [IMPRESSIVE RESULTS]

Resident Evil Outbreak Opening FMVRemastered in 4K using ESRGAN [AI Machine Learning]2nd Attempt [IMPRESSIVE RESULTS]ESRGAN is an AI Neural Network software ...

www.youtube.com

The RE Outbreak intro is KINO.

 

[jenya]

The games look just like I remember they looked like many moons ago, I love it.

 

[Deleted member 54292]

This stuff is so amazing. Machine learning blows my mind with the results it produces.

 

[Acidote]

I spent a lot of time today there. I actually posted the Diablo IV in 8k upscale in the Diablo IV thread.

 

[EvilBoris]

Developers use interpolation techniques all over gamedev. Interpolation is one of the primary tasks of GPU programming.

Click to shrink...

Is this Machine learning based approach quite different to what you are describing?

 

[tr1b0re]

Developers use interpolation techniques all over gamedev. Interpolation is one of the primary tasks of GPU programming.

Click to shrink...

Well I think he more meant why don't they use it when doing game remasters for their CG scenes/backgrounds (which is something I've oft wondered myself)

 

[residentgrigo]

This one is also pretty out there:

https://www.youtube.com/watch?v=gYNajpnyZiM

Giorgio Moroder Presents Metropolis meets Fallout. Minus the music.

 

[ss_lemonade]

Are there any devs here who can give insight as to why more companies arent using this for their remasters?

FF8 and FF9 modern console releases would have much better backgrounds.

Click to shrink...

My guess is it will still require a bit of work to make sure all scenes look right, as opposed to just slapping a filter on top of the original assets (which admittedly looks awful)

 

[Quantza]

If regular people are using this why aren't devs?

Click to shrink...

Don't think it can run in real-time - that's just a guess though.
Thinking back to Nvidia's DLSS (probably similar), it requires a lot of resources to train their models, which can then be sent to users to run in real-time across different games.

Maybe a different super-resolution model could be created per game, at least?
But that might depend on the complexity of the shading. So cel-shaded images could be easier to deal with than physically-based renders.

 

[Carn]

They should redo all the Babylon 5 CGI like this and finally produce a proper HD version that way :P

 

[mrprime]

I'll give whoever does these a quid if they do MechWarrior 2 intro.