what constitutes incompressible data?

The place for all kinds of software for all kinds of operating systems.

Moderator: Dposcorp

what constitutes incompressible data?

Postposted on Thu Apr 26, 2012 9:03 pm

I have seen plenty of ssd reviews and they all say sandforce drives are slower with incompressible data than compressible data.

So what types of files are incompressible data?

Jpegs?
Mp3s?
.dll's?
????
Life doesn't change after marriage, it changes after children!
anotherengineer
Gerbil Elite
 
Posts: 551
Joined: Fri Sep 25, 2009 1:53 pm
Location: Timmins, ON Canada, Yes I know, Up in the sticks

Re: what constitutes incompressible data?

Postposted on Thu Apr 26, 2012 9:10 pm

Since you don't need a CS explanation, they just mean things that are already compressed, since it's unlikely adding more compression will do much to the filesize as it's already close to optimal.

jpeg and mp3, but not png or wav
rar but not tar

et cetera
Game_boy
Gerbil Elite
 
Posts: 564
Joined: Mon Aug 06, 2007 12:46 pm

Re: what constitutes incompressible data?

Postposted on Thu Apr 26, 2012 9:25 pm

Some file formats are more compressible (wav more than mp3) but compresible itself means that the data has a lot of repeating patterns in it that can be substitutes for shorter patterns, or represented in a more compact form.

ie; for an image of 100 by 100 pixels of all the same color, its more efficient to store the image as "100 by 100 of color code" than color code, color code, color code etc... 10000 times.

I have two sandforce drives, and on a practical note, in day to day work, they are much faster than HDD and almost no one would notice the difference in compressed vs, uncompressed files unless they were benchmarking.
The finest tools are forged from the hottest fires
ShadowEyez
Gerbil XP
 
Posts: 338
Joined: Wed Dec 03, 2003 12:31 pm

Re: what constitutes incompressible data?

Postposted on Wed May 16, 2012 6:43 pm

Mp3, Ogg, FLAC, etc are forms of audio compression. Those files are already compressed, so you're not going to get much more (if any) compression on them. Same goes for Jpegs, PNG, and TIFF (image compression formats); rar, tar, zip (general file compression) and most any other media format------unless you know that it's in a raw, uncompressed form (like a .wav).
i5 2500k - P67 - GTX660 - 840 Pro 256GB - Xonar Essence STX - Senn HD595's
The Egg
Gerbil XP
 
Posts: 440
Joined: Sun Apr 06, 2008 4:46 pm

Re: what constitutes incompressible data?

Postposted on Wed May 16, 2012 9:26 pm

@Egglick - Nit-pick: The most common compression algorithms used by TIFF are not very efficient, so the files may still qualify as compressible. I agree with you on the rest.
(this space intentionally left blank)
just brew it!
Administrator
Gold subscriber
 
 
Posts: 37677
Joined: Tue Aug 20, 2002 10:51 pm
Location: Somewhere, having a beer

Re: what constitutes incompressible data?

Postposted on Wed May 16, 2012 9:53 pm

One of the dumb things that is quite common is rar compressing video files. They almost invariably end up being larger than the original file.
Fuji X-E1 Leica Elmar 135 4 XF60mm 2.4 Macro | Zeiss FE 35mm 2.8
http://carnagepro.com
"Everything ... they eat everything, and fear is their bacon bits."
PenGun
Gerbil Elite
 
Posts: 791
Joined: Fri Jun 18, 2004 1:48 pm
Location: BC Canada

Nitpick…

Postposted on Wed May 16, 2012 11:28 pm

Game_boy wrote:…jpeg and mp3, but not png or wav…

Actually, hi–quality JPEGs are compress–able (using general purpose, loss–less algorithms, like the ones used in ZIP, RAR, and 7zip files); PNG are not compress–able (unless they were created using a lousy application/library).

Try it for yourself.
Ziyad.
zamb
Gerbil
 
Posts: 12
Joined: Wed Nov 26, 2008 9:38 am

Re: what constitutes incompressible data?

Postposted on Thu May 17, 2012 12:02 am

Stuff that IS compressible:

Executable files (EXE, DLL)
Text (html, code, documents, logs)
WAV
BMP
Disk images (some ISOs, others already ARE compressed)
TwistedKestrel
Gerbil Team Leader
 
Posts: 245
Joined: Mon Jan 06, 2003 4:29 pm


Return to General Software

Who is online

Users browsing this forum: No registered users and 2 guests