Summary metrics and deep voodoo
Let's see how the move to Windows 7 affects the 7950's placement on our famous value scatter plots. As ever, we've converted our 99th percentile frame time results into FPS, so both of the plots below can be read the same, with the best values being closer to the top left corner of the plot area.
Predictably, there's not much movement, because the 7950's performance doesn't change much from Win8 to Win7. Also, since Windows 7 doesn't alleviate the latency spikes that plague the 7950 in many of these newer games, the Radeon continues to drop into a much less desirable position on the 99th-percentile plot than the GTX 660 Ti.
We should note that the overall performance number above is a geometric mean of the results from our seven game test sequences. (We've excluded Whiterun since we didn't use it last time around.) We started using the geomean back in August in order to reduce the impact of outliers on our overall performance scores. In the past, games with vendor-friendly optimizations like HAWX 2 and DiRT Showdown tended to push the average a long way in one direction, so we excluded them from our calculations, prompting controversy. We were hopeful the switch to the geometric mean would curb outliers without manual intervention.
That said, some folks still objected to our inclusion of Assassin's Creed III in our overall index, since it performs so much better on the GeForce than on the Radeon. I figured we might as well oblige them by taking a look at the overall scores with AC3 excluded, to see whether it moves the needle.
Well, things don't change drastically, but excluding AC3 allows the 7950 to pull ahead of the GTX 660 Ti in our overall FPS average. In fact, that change produces virtually the same sort of outcome in the overall FPS numbers as we saw back in August, when the Radeon HD 7950 reference card with Boost edged out this same Zotac GTX 660 Ti AMP! card by a margin of several frames per second.
Trouble is, that doesn't really matter. A moral victory in the borderline-meaningless FPS sweeps doesn't overcome the fact that the Radeon HD 7950 has a persistent problem with high-latency frames across a range of test scenarios based on the latest games. The 99th-percentile frame times reflect that reality. Our latest round of tests shows that Windows 8 is not the problem. On the contrary, Windows 8 generally improves the latency picture somewhat.
When we first published our rematch between the 7950 and the GTX 660 Ti, we pinged AMD to ask if they could explain the Radeon's struggles in recent games. AMD spokesman Antal Tungler told us that our article had "raised some alarms" internally at the company, and he said they hoped to have some answers for us "before the holiday." He also noted that AMD is continually working to improve its drivers and that the 7950 does perform well in FPS-based benchmarks.
We're hopeful that we may have a more detailed answer from AMD before too long, but in the interim, we have an even firmer grasp of the reality that caused us to recommend the GeForce GTX 660 Ti over the Radeon HD 7950 in our last article. Again, the outcome of our testing may be counter the expectations of many folks; they certainly weren't what we expected when we set out to stage this rematch.
The tragedy here is one of wasted potential. The Radeon HD 7950 is, on paper, clearly a more powerful GPU than the GTX 660 Ti, with double the memory interface width and a theoretical edge in peak ROP rate and shader flops. AMD is giving you more hardware for your money when you buy a 7950. For whatever reason—and we suspect the main culprit is graphics driver software—the 7950 can't convert that advantage into consistently smoother in-game animation. As one of my fellow TR editors pointed out to me the other day, this wouldn't be the first time Radeon owners were let down by driver issues during the holiday rush. AMD was plagued by a painful series of driver issues last year, too.
To those who would claim that other "professional" review sites haven't seen results like ours in their comparisons of the 7950 and GTX 660 Ti, I would simply respond: of course not. Virtually nobody else tests like we do. We're working on persuading folks to focus on latency, to use a timer with finer granularity, but such changes are hard. They take time and effort. Heck, we may be nearly alone in using this approach for a long time yet.
The question you have to ask is what matters to you. Do you want the graphics card that scores best in the FPS beauty pageant, or do you want that one that gives you the smoothest gaming experience when you fire up a freshly downloaded game this Christmas? If you just want bragging rights, by all means, choose the Radeon HD 7950. If you're looking for the friction-free fluidity that only comes from consistently quick frame delivery, though, our recommendation remains the GeForce GTX 660 Ti.
213 comments — Last by Rigel84 at 8:00 AM on 01/02/13
|1. Hdfisise - $600||2. Ryszard - $503||3. punkUser - $502|
|4. the - $306||5. SomeOtherGeek - $300||6. Ryu Connor - $250|
|7. doubtful500 - $200||8. Anonymous Gerbil - $150||9. webkido13 - $135|
|10. cygnus1 - $126|
|BenQ's XL2730Z 'FreeSync' monitor reviewedFirst of its breed and 144Hz speed||239|
|EVGA's Torq X5 and X10 mice reviewedRodentia evgae||36|
|Nvidia's GeForce GTX Titan X graphics card reviewedYour GTX 980 is puny. I spit on it. Ptoo.||444|
|Five GeForce GTX 960 cards overclockedHow do I compare thee? Dunno, really||189|
|The TR Podcast 169.5 bonus edition: Q&A intensifiesYou ask, we attempt to answer||5|
|BenQ's XL2420G G-Sync monitor reviewedTwo scalers, one monitor, zero tearing||54|
|Samsung's Galaxy Note 4 with the Exynos 5433 processorA Korean import gives us a look at ARM's latest tech||110|
|We discuss the GeForce GTX 970 memory controversyDissecting the issue||94|
|Report: Comcast will abandon Time Warner acquisition||59|
|Friday Night Shortbread||39|
|Acer's Switch 10 is a svelte, Atom-powered convertible||16|
|Hardware makers want to standardize the stylus||42|
|Deal of the week: The M500 960GB for $290, Battlefield Hardline for $36, and lots more||18|
|Thermaltake's Pacific radiators come in all the sizes||9|
|Modders can now charge for their work on Steam Workshop||236|
|Samsung's new 840 EVO fix starts trickling out||26|
|Arkham Knight requires at least 2GB of graphics memory||115|