I think drivers are always a problem when benchmarking a lot of cards. It's never right or perfect.
Example: I did some benchmarking of my fastest agp cards (windows xp). I wanted to bench the fastest from each series from Nvidia (TNT, TNT2ultra, Gf3Ti, Gf4Ti, Gf5ultra etc. etc.) but i could only find one driver for cards from gf4 up to gf7. I wanted to use a single driver just to make it easier and to keep things equal. Older driver would drop support for gf7 and later drivers had no support for gf4.... 😐
So i dropped gf3 and lower and went testing. All went well but after the results (which looked fine) i kept thinking: gf4 might be faster with older drivers and gf7 with later ones.... 😢
So i tested an older driver and indeed the gf4 was quicker... i didn't test it with all the other cards but probably every single series has their own ''perfect driver'' (would be logical anyway).
So to run the ''perfect benchmarks'' i would have to figure out first which driver is the absolute best overall. It needs to be done for every single card to give them the most speed. 😵
That is a LOT of work but i think it is the only way to do it right, am i wrong?
The only problem with it maybe is that a driver for example can be the absolute fastest in 3dmark99 and it can be a bad driver for 3dmark2000 (or any other title).
Also, a too high resolution is a bit unfair for an older card like for example a TNT1 but a low resolution creates a bottleneck for a higher end card and it can not stretch it's legs.
Since we all are using and testing cards that have many years between them this will always be a problem driver-wise.
asus tx97-e, 233mmx, voodoo1, s3 virge ,sb16
asus p5a, k6-3+ @ 550mhz, voodoo2 12mb sli, gf2 gts, awe32
asus p3b-f, p3-700, voodoo3 3500TV agp, awe64
asus tusl2-c, p3-S 1,4ghz, voodoo5 5500, live!
asus a7n8x DL, barton cpu, 6800ultra, Voodoo3 pci, audigy1