VOGONS

Common searches


7-Zip Benchmark, DOS Edition

Topic actions

First post, by clueless1

User metadata
Rank l33t
Rank
l33t
2016-11-09 20_02_04-7-Zip Benchmark, DOS Edition - Google Sheets.jpg
Filename
2016-11-09 20_02_04-7-Zip Benchmark, DOS Edition - Google Sheets.jpg
File size
84.28 KiB
Views
5658 views
File license
Fair use/fair dealing exception

Following in the footsteps of the original 7-Zip Benchmark database for Windows and Linux, I did some research on how to run this benchmark on real DOS PCs, in order to be able to test more vintage CPUs, but I hit a few snags...
-I first tried running the existing 7-Zip 9.20 executable with the HX DOS Extender, using the directions in the included readme file, but it would not work.
-next I tried to follow this HOWTO, but encountered the same errors I did above.
-After this, I found a repository of old Linux programs ported to DOS. Among them was 7za.exe, version 4.53a. This is the barebones 7-Zip archiver. The benchmark ran great under DOS, but the results were not comparable to 7-Zip 9.20, hence a new database.
-EDIT: DosFreak found a link below that led to a more current version of 7-Zip (16.02) that someone recompiled to work under DOS. Tests of both versions lead us to switch to this version, as it appears to recognize and optimize for cpus newer than Pentium I. I am replacing the attached version to 16.02 to avoid confusion.

DIRECTIONS:
In order to be as compatible with as many systems as possible, we are using a dictionary size of 256KB, which means your DOS machine will need at least 8MB of RAM to complete the benchmark.
Download the file attachment 7za.zip at the bottom of this post and extract the single file 7za.exe. The file is a little over 500KB and is the only file you need. Copy it to a DOS machine or MS-DOS boot floppy and run the benchmark with the command

C:\>7za b -md18

The switch 'b' runs the benchmark, and '-md18' uses a dictionary size of 2^18 (256KB)
If you'd like to output the results to a text file, then run this instead:

C:\>7za b -md18>7zip.txt

The output will look like this

7-Zip (a) [32] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=C,Utf16=off,HugeFiles=off,32 bits,1 CPU GenuineIntel (1543),ASM)

GenuineIntel (1543)
CPU Freq: 193 193 193 193 193 203

RAM size: 53 MB, # CPU hardware threads: 1
RAM usage: 6 MB, # Benchmark threads: 1

Compressing | Decompressing
Dict Speed Usage R/U Rating | Speed Usage R/U Rating
KiB/s % MIPS MIPS | KiB/s % MIPS MIPS

18: 76 100 68 68 | 1327 100 107 107
---------------------------------- | ------------------------------
Avr: 100 68 68 | 100 107 107
Tot: 100 88 88

Here are the values that get added to the database:

7-Zip DOS.jpg
Filename
7-Zip DOS.jpg
File size
28.98 KiB
Views
5780 views
File license
Fair use/fair dealing exception

If you'd like to test your DOS systems, please add them to the database here:

https://docs.google.com/spreadsheets/d/ ... 09577[b][i]
Please do not reorganize the spreadsheet, sort by different columns, etc. If you want to do this, download it and change your copy of it.[/i][/b]

I've already added results for my DOS systems. Note the Read Me tab on the spreadsheet with directions.

The benchmark was tested and confirmed to work with MS-DOS 6.22. Newer versions of MS-DOS may have issues running the executable.

The benchmark can be run either from HDD or boot floppy, so even systems without a HDD can run the test, presuming a minimum of 8MB of RAM.

Interestingly, 7za.exe can also actually compress and decompress files in both .7z and .zip. I tested by compressing a file in DOS, copying to Windows, and decompressing with the Windows version of 7-Zip 9.20. I also compressed a file in Windows and decompressed it in DOS. It works, but the command format is a bit confusing. See this page for examples.

Thanks for reading!

Attachments

  • Filename
    7za.zip
    File size
    505.96 KiB
    Downloads
    705 downloads
    File comment
    Version 16.02 recompiled to work under MS-DOS
    File license
    Fair use/fair dealing exception
Last edited by clueless1 on 2017-04-24, 19:18. Edited 3 times in total.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 1 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

I added a Pentium III 933Mhz and Pentium II 400Mhz to the spreadsheet. Here's the Pentium II result:

7-Zip (A)  4.58 beta  Copyright (c) 1999-2008 Igor Pavlov  2008-05-05
p7zip Version 4.58 (locale=C,Utf16=off,HugeFiles=off,1 CPU)

RAM size: 128 MB, # CPU hardware threads: 1
RAM usage: 6 MB, # Benchmark threads: 1

Dict Compressing | Decompressing
Speed Usage R/U Rating | Speed Usage R/U Rating
KB/s % MIPS MIPS | KB/s % MIPS MIPS

18: 278 100 245 247 | 2673 100 227 227
----------------------------------------------------------------
Avr: 100 245 247 100 227 227
Tot: 100 237 237

I've still got a K6-2, Celeron 333 and Pentium II 333 to test.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 2 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie

I might test some computers when i have time, i have been busy lately. I've got here an old 486 SX 25 and a old Pentium MMX Packard Bell to test.

I have the feeling some CPUs like the Pentium Pro will underperform due to no begin optimized for 16 bit code

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 3 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie

Tried DOS version in some PCs, i tried on my HP DC7800 which i used to write the floppy and my AMD K6-2 build, also tried on my 486-SX 25, but it crashed, i guess 7 Zip needs FPU acording to the errors

Attachments

  • 20161219_212914.jpg
    Filename
    20161219_212914.jpg
    File size
    1.12 MiB
    Views
    5517 views
    File comment
    error on the 486-SX
    File license
    Fair use/fair dealing exception

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 4 of 54, by vladstamate

User metadata
Rank Oldbie
Rank
Oldbie

386DX @40Mhz

7-Zip (A)  4.58 beta  Copyright (c) 1999-2008 Igor Pavlov  2008-05-05
p7zip Version 4.58 (locale=C,Utf16=off,HugeFiles=off,1 CPU)

RAM size: 128 MB, # CPU hardware threads: 1
RAM usage: 6 MB, # Benchmark threads: 1

Dict Compressing | Decompressing
Speed Usage R/U Rating | Speed Usage R/U Rating
KB/s % MIPS MIPS | KB/s % MIPS MIPS

18: 6 100 5 5 | 75 100 6 6
----------------------------------------------------------------
Avr: 100 5 5 100 6 6
Tot: 100 6 6

486 DX2 @66Mhz

7-Zip (A)  4.58 beta  Copyright (c) 1999-2008 Igor Pavlov  2008-05-05
p7zip Version 4.58 (locale=C,Utf16=off,HugeFiles=off,1 CPU)

RAM size: 128 MB, # CPU hardware threads: 1
RAM usage: 6 MB, # Benchmark threads: 1

Dict Compressing | Decompressing
Speed Usage R/U Rating | Speed Usage R/U Rating
KB/s % MIPS MIPS | KB/s % MIPS MIPS

18: 19 100 17 17 | 249 100 21 21
----------------------------------------------------------------
Avr: 100 17 17 100 21 21
Tot: 100 19 19

YouTube channel: https://www.youtube.com/channel/UC7HbC_nq8t1S9l7qGYL0mTA
Collection: http://www.digiloguemuseum.com/index.html
Emulator: https://sites.google.com/site/capex86/
Raytracer: https://sites.google.com/site/opaqueraytracer/

Reply 5 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie

Added some more computers, somehow, my IBM Thinkpad A21m got an incredibly high score compared to my other P3s in 7-Zip DOS, it also even outperformed my P4 based Celeron 2.6 GHz despite the huge clock disavantage, idk if it was something on the CPU, BIOS or the motherboard/chipset (i know this laptop uses i440BX as chipset)

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 6 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

I'm in the process of adding every official K6-2 speed except for the 533 @ 97FSB. Also added an underclocked K6-2 @ 166 for comparisons to other cpus at the same clock. Motherboard is SiS 530 chipset with 512KB L2. I noticed Carlos K6-2 @ 500Mhz is faster than mine @ 550. He's on the MVP3 chipset with 1024KB L2, so that explains it. Looking at the compress and decompress scores, that validates it. My 550 has a higher decompress score, which depends on integer performance. His 500 has a higher compress score, which depends on memory speed and latency.

Also adding Pentium II from 166 to 333. I'm the lucky owner of an unlocked PII-333. 😉 Tested on a 440LX chipset with 512KB L2.

Thank you for adding your results, guys.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 8 of 54, by vladstamate

User metadata
Rank Oldbie
Rank
Oldbie

I have a PII 400Mhz however when I ran the test in DOS mode it hangs. It works fine from dos from within Win95 but I do not trust those results. I'll try getting into DOS before getting into Win95.

YouTube channel: https://www.youtube.com/channel/UC7HbC_nq8t1S9l7qGYL0mTA
Collection: http://www.digiloguemuseum.com/index.html
Emulator: https://sites.google.com/site/capex86/
Raytracer: https://sites.google.com/site/opaqueraytracer/

Reply 9 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t
DosFreak wrote:

Thanks! I'll check it out. It would suck to have to run our benchmarks all over again, though. 😒

vladstamate wrote:

I have a PII 400Mhz however when I ran the test in DOS mode it hangs. It works fine from dos from within Win95 but I do not trust those results. I'll try getting into DOS before getting into Win95.

I only tested under DOS 6.22. It works from a DOS 6.x boot disk as well if you don't want to install a new DOS. Plus, see DosFreak's post above. He may have found a more recent 7-Zip that will work in DOS. If that's the case, we might end up starting over.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 10 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

I tested the recompiled-for-DOS version 16.02 of 7-Zip from the link DosFreak posted. It works perfectly in DOS but does give significantly different (higher) results. If we decide to switch to it, we will have to dump the results we've made so far and start over. Carlos, if you have time, would you test out version 16.02 and provide feedback? I'm attaching to this post.

Thanks

Attachments

  • Filename
    7za.zip
    File size
    505.96 KiB
    Downloads
    337 downloads
    File comment
    7za.exe version 16.02
    File license
    Fair use/fair dealing exception

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 11 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie
clueless1 wrote:

I tested the recompiled-for-DOS version 16.02 of 7-Zip from the link DosFreak posted. It works perfectly in DOS but does give significantly different (higher) results. If we decide to switch to it, we will have to dump the results we've made so far and start over. Carlos, if you have time, would you test out version 16.02 and provide feedback? I'm attaching to this post.

Thanks

Idk if it will be a good idea redo all results, there are already 40 results on the sheet and redoing all of these 40 is gonna take some time

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 12 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie

Also, added some more P3s on the Biostar M6VCG mobo atm

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 13 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

I added another tab and kept the existing results. If it's something we have time for we can slowly add them. If not, then we'll just keep using 4.53a version and ignore the other tab. That keeps our options open.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 14 of 54, by vladstamate

User metadata
Rank Oldbie
Rank
Oldbie

I'll test that new version too on my machines. I have 386, 486, P180MMX, PII 400, P3 866, P4 2.6Ghz.

YouTube channel: https://www.youtube.com/channel/UC7HbC_nq8t1S9l7qGYL0mTA
Collection: http://www.digiloguemuseum.com/index.html
Emulator: https://sites.google.com/site/capex86/
Raytracer: https://sites.google.com/site/opaqueraytracer/

Reply 15 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

There's definitely a difference between version 4.53a and 16.02. 16.02 recognizes specific cpus (for example, K6 3DNow!), so it may have optimizations for different cpus. I also see a big difference when comparing between K6-2 and Pentium II. With 4.53a, the PII-333 is 2% faster than the K6-2 300/100. With 16.02, the PII is 35% faster than the K6-2.
So it looks like PII scores are about 40% higher in 16.02 vs 4.53a, where the K6-2 scores are about 10% higher. It seems to be taking advantage of some PII optimizations in 16.02?

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 16 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie

Just a question, should stil continue with 4.53a scores, or migrate to 16.02 completely? i can also do both, but is gonna take the double of the time per CPU/PC

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 17 of 54, by clueless1

User metadata
Rank l33t
Rank
l33t

If I had to choose, it seems 16.02 would be the more accurate. But if you can, it would be nice to replicate all your 4.53a entries to 16.02. Once that is finished, we can switch to 16.02 exclusively. I think there may be some good information in comparing them, information that would explain the different results in a way that makes sense.

The more I learn, the more I realize how much I don't know.
OPL3 FM vs. Roland MT-32 vs. General MIDI DOS Game Comparison
Let's benchmark our systems with cache disabled
DOS PCI Graphics Card Benchmarks

Reply 18 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie
clueless1 wrote:

If I had to choose, it seems 16.02 would be the more accurate. But if you can, it would be nice to replicate all your 4.53a entries to 16.02. Once that is finished, we can switch to 16.02 exclusively. I think there may be some good information in comparing them, information that would explain the different results in a way that makes sense.

I'll will redo all scores to 16.02 and ditch 4.53a

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems

Reply 19 of 54, by Carlos S. M.

User metadata
Rank Oldbie
Rank
Oldbie
Carlos S. M. wrote:
clueless1 wrote:

If I had to choose, it seems 16.02 would be the more accurate. But if you can, it would be nice to replicate all your 4.53a entries to 16.02. Once that is finished, we can switch to 16.02 exclusively. I think there may be some good information in comparing them, information that would explain the different results in a way that makes sense.

I'll will redo all scores to 16.02 and ditch 4.53a

Somehow, i can't run 16.02, i get the follwing error:

A:\>7za b -md18
Load error: no DPMI - Get csdpmi*b.zip

A:\>

What is your biggest Pentium 4 Collection?
Socket 423/478 Motherboards with Universal AGP Slot
Socket 478 Motherboards with PCI-E Slots
LGA 775 Motherboards with AGP Slots
Experiences and thoughts with Socket 423 systems