Dege wrote on 2023-06-28, 09:02:
And yes, I can see the difference on the attached pictures. Having a general (not game-specific) solution for an AI-based texture improvement combined with the existing forced high resolution rendering for old games is a wet dream, I must admit 😀.
Some games could look really cool, like a remake.
EXACTLY!!! That's the exact idea: instant remakes, in realtime! For now, nothing can be done about the 3d models, but textures and resolution (and antialiasing) CAN be improved, and that's almost enough to make an old game look like a remake! (EDIT: this would be a realtime remaster)
When I was getting the links for RealESRGAN, something came to me: RealESRGAN (and other AI upscalers) are being used to upscale VIDEOS in realtime, at 60 fps. They get great results in animes. What if we used RealESRGAN (or any other FAST upscaler) and a compact model to upscale GAMES in realtime? I mean, upscaling the entire FRAME like they do with anime, not the textures. Got really curious to see something like this working, to see how it would look. Maybe if I capture a movie of a game and apply the upscaling, I can get an idea? 😄
EDIT: Well, I just upscaled these pics I posted, there's really no noticeable difference unless you zoom a lot. Looks like its too much information for the AI, it only adds some kind of antialiasing to some of the edges. Upscaling the textures individually is the way to go. Maybe the NVIDIA RTX Video Super Resolution could get better results, but I don't feel like testing that.