• Hey, guest user. Hope you're enjoying NeoGAF! Have you considered registering for an account? Come join us and add your take to the daily discourse.
  • The Politics forum has been nuked. Please do not bring political discussion to the rest of the site, or you will be removed. Thanks.

Opinion Cringe Hardware A wild idea about game file sizes

Elektro Demon

Shits and Giggles
Nov 9, 2019
4,600
8,085
815
Croatia
www.youtube.com
So hear me out. Game file sizes are just insane nowadays. They're just too big. But why don't we use some insane compression technique that is able to shrink 100gb file into a 10 gb one? I'm not sure if this is possible but I think it is. Or it could be developed. If you shrink your game dramatically like this, when you're installing the game/unpacking it, it would take a heavy toll on the cpu. But the cpu tech nowadays is not like it used to be, cpu's today have many cores and threads so pegging an 8 core cpu at 100% would get that file unpacked fairly quickly. It just makes more sense to me then to needlessly download huge files.
What do you think? Is this kind of tech possible? If so, why don't devs or online storefronts use it?
 

Jethalal

Banned
Dec 19, 2020
912
1,690
420
Boy do I have a show for you:
confused kumail nanjiani GIF by Silicon Valley
 

Magog.

Banned
Dec 31, 2020
302
796
265
Oodle Kraken compression on PS5 is already doing this. They also don't have to use repeated assets like they did when HDDs were standard so file sizes can be smaller.
 
Last edited:

M1chl

Currently Gif and Meme Champion
Dec 25, 2019
11,777
22,558
1,025
Prague, Czech Republic
This stuff is probably at hand of some really tight Neural Network, I work in this field, however I cannot imagine such Network, whoever comes with this it's going to be for Nobel Price, it's really one thing which I can think it could shrink file size that much. But with my limited knowledge, I somewhat doubt it...
 
  • Like
Reactions: Elektro Demon

ZoukGalaxy

Member
Oct 3, 2017
598
1,100
435
It's a little more complicated than that actually, and pretty long to explain everything.
There is not "magic" compression. Also, compression is already used but it costs CPU/GPU ressources, loading time, etc..
 
Dec 4, 2019
3,172
4,719
545
Good ol' not really understanding compression.

If you compress something to n (=a number of) bits, you can only have 2^n possible uncompressed things.

Say if you compress to 2 bits, you can only have 4 possible uncompressed things.
 
  • Thoughtful
Reactions: Elektro Demon

RedVIper

Banned
Jun 13, 2017
2,997
4,183
465
Whatever compression you're talking about needs to be lossless, and I really doubt any form of lossless compression could ever be that good, read https://en.wikipedia.org/wiki/Pigeonhole_principle#Uses_and_applications

There are games that are poorly compressed, they ship uncompressed (Or poorly compressed), audio, textures, video, and they absolutely should work to make their file sizes smaller, but it's just not always possible.

A lot of games will ship uncompressed audio to reduce CPU load for example.

A lot of games ship unused assets.

A lot of games have redundant textures.

There's tons of things game developers can do to shave off a few % of the games size, but it can take a lot of time, and they probably just don't find it worth spending 1 month trying to reduce the game from 100gb to 80gb when most people don't seem to care.
 
Last edited:

Patrick S.

Amiga Forever
May 4, 2013
5,354
2,740
1,035
Germany
SSDs are cheaper than CPU power, it's simply not worth the trouble. Have you ever been naughty and installed a FitGirl repack? The installation of a highly compressed game takes several hours.
 
  • Thoughtful
Reactions: Elektro Demon

Fuz

Member
Jun 8, 2009
9,965
12,754
1,445
Cagliari, Italy
So hear me out. Game file sizes are just insane nowadays. They're just too big. But why don't we use some insane compression technique that is able to shrink 100gb file into a 10 gb one? I'm not sure if this is possible but I think it is. Or it could be developed. If you shrink your game dramatically like this, when you're installing the game/unpacking it, it would take a heavy toll on the cpu. But the cpu tech nowadays is not like it used to be, cpu's today have many cores and threads so pegging an 8 core cpu at 100% would get that file unpacked fairly quickly. It just makes more sense to me then to needlessly download huge files.
What do you think? Is this kind of tech possible? If so, why don't devs or online storefronts use it?
Don't smoke and post.
 
  • Thoughtful
Reactions: Elektro Demon

RoboFu

One of the green rats
Oct 10, 2017
4,457
7,112
685
Lets say that was possible. the amount of time to unpack that would be great making the installation much much longer and not doing anything to disk space but confusion for the users who wondered where all that space went for 10 gig download?
 

Magog.

Banned
Dec 31, 2020
302
796
265
Kraken is at most a 50% compression on best case as seen on their website

I dug into it a little more and they can actually get better than 3:1 compression when combined with Oodle texture and still are able to decompress almost instantly.

 

Elektro Demon

Shits and Giggles
Nov 9, 2019
4,600
8,085
815
Croatia
www.youtube.com
SSDs are cheaper than CPU power, it's simply not worth the trouble. Have you ever been naughty and installed a FitGirl repack? The installation of a highly compressed game takes several hours.
I have been naughty. It did take 4 hours on my i5 sandy bridge but honestly on my ryzen 3700x it's quite fast.
 
Last edited:
  • Thoughtful
Reactions: Jethalal

bitbydeath

Member
Nov 25, 2015
16,466
28,527
1,285
Better to go the nanite route and avoid duplication by having your engine apply the differences required on the fly. What can be done in that space if seriously worked on can change overall file sizes dramatically.
 
  • Thoughtful
Reactions: Jethalal

Life

Member
Jul 25, 2019
720
779
455
Great idea. And then, we can come up with a compression technique that reduces the size AGAIN: so from 100 GB to 10GB, which is your original idea (make sure you patent that) - and then again from 10GB to 1GB!
 

Miles708

Member
Sep 11, 2019
1,769
2,383
435
I love the idea being: keep doing whatever you're already doing now, but better!

That said, even if you're over-simplifying you're right, compression techniques are needed today more than ever because games have ridiculous file sizes. Also console manufacturers had the brilliant idea to give us not even 1 TB to store them.
Not to mention download time and patches size.

This is kind of a serious matter and I would love to see some breakthrough in this field.
 
  • Like
Reactions: Elektro Demon

Black_Stride

do not tempt fate do not contrain Wonder Woman's thighs do not do not
Mar 31, 2011
6,681
5,104
1,130
100GB -> 30GB is about as good as you can get right now without having to wait a long time to actually decompress.

So yeah Im expecting games to actually fit on a single Blu Ray without needing to download another 60GB day one patch.

Hopefully Day One patches can also go back to being sub 5GB regardless of how much work said patch actually does.

But 100GB -> 10GB and then actually be able to decompress the assets at run time.....I dont think we are going to see that this generation.
 
  • Like
Reactions: Elektro Demon

Miles708

Member
Sep 11, 2019
1,769
2,383
435
I wonder if it would be possible to make a way more aggressive compression for downloading purposes, and then de-compress the files at time of install.
At least download size/disc storage would be much more efficient.
 
Last edited:

jakinov

Member
Nov 19, 2008
1,102
1,231
1,260
Game console and games already leverage compression this gen whether it’s how games are stored when saved on your SSD or the individual assets that make up your game.

The problem is you just arbitrarily picked some dream goal and asked “why don’t they just do that?”. It’s like saying “instead of the whatever percent effective covid vaccine out now why don’t they just give people covid vaccine that’s 100% effective, no side effects and works for every mutation” or saying “why don’t they just make GPUs that are a billion times faster than the one they have today instead of the ones actually out today”.