Summary metrics and deep voodoo
Let's see how the move to Windows 7 affects the 7950's placement on our famous value scatter plots. As ever, we've converted our 99th percentile frame time results into FPS, so both of the plots below can be read the same, with the best values being closer to the top left corner of the plot area.
Predictably, there's not much movement, because the 7950's performance doesn't change much from Win8 to Win7. Also, since Windows 7 doesn't alleviate the latency spikes that plague the 7950 in many of these newer games, the Radeon continues to drop into a much less desirable position on the 99th-percentile plot than the GTX 660 Ti.
We should note that the overall performance number above is a geometric mean of the results from our seven game test sequences. (We've excluded Whiterun since we didn't use it last time around.) We started using the geomean back in August in order to reduce the impact of outliers on our overall performance scores. In the past, games with vendor-friendly optimizations like HAWX 2 and DiRT Showdown tended to push the average a long way in one direction, so we excluded them from our calculations, prompting controversy. We were hopeful the switch to the geometric mean would curb outliers without manual intervention.
That said, some folks still objected to our inclusion of Assassin's Creed III in our overall index, since it performs so much better on the GeForce than on the Radeon. I figured we might as well oblige them by taking a look at the overall scores with AC3 excluded, to see whether it moves the needle.
Well, things don't change drastically, but excluding AC3 allows the 7950 to pull ahead of the GTX 660 Ti in our overall FPS average. In fact, that change produces virtually the same sort of outcome in the overall FPS numbers as we saw back in August, when the Radeon HD 7950 reference card with Boost edged out this same Zotac GTX 660 Ti AMP! card by a margin of several frames per second.
Trouble is, that doesn't really matter. A moral victory in the borderline-meaningless FPS sweeps doesn't overcome the fact that the Radeon HD 7950 has a persistent problem with high-latency frames across a range of test scenarios based on the latest games. The 99th-percentile frame times reflect that reality. Our latest round of tests shows that Windows 8 is not the problem. On the contrary, Windows 8 generally improves the latency picture somewhat.
When we first published our rematch between the 7950 and the GTX 660 Ti, we pinged AMD to ask if they could explain the Radeon's struggles in recent games. AMD spokesman Antal Tungler told us that our article had "raised some alarms" internally at the company, and he said they hoped to have some answers for us "before the holiday." He also noted that AMD is continually working to improve its drivers and that the 7950 does perform well in FPS-based benchmarks.
We're hopeful that we may have a more detailed answer from AMD before too long, but in the interim, we have an even firmer grasp of the reality that caused us to recommend the GeForce GTX 660 Ti over the Radeon HD 7950 in our last article. Again, the outcome of our testing may be counter the expectations of many folks; they certainly weren't what we expected when we set out to stage this rematch.
The tragedy here is one of wasted potential. The Radeon HD 7950 is, on paper, clearly a more powerful GPU than the GTX 660 Ti, with double the memory interface width and a theoretical edge in peak ROP rate and shader flops. AMD is giving you more hardware for your money when you buy a 7950. For whatever reason—and we suspect the main culprit is graphics driver software—the 7950 can't convert that advantage into consistently smoother in-game animation. As one of my fellow TR editors pointed out to me the other day, this wouldn't be the first time Radeon owners were let down by driver issues during the holiday rush. AMD was plagued by a painful series of driver issues last year, too.
To those who would claim that other "professional" review sites haven't seen results like ours in their comparisons of the 7950 and GTX 660 Ti, I would simply respond: of course not. Virtually nobody else tests like we do. We're working on persuading folks to focus on latency, to use a timer with finer granularity, but such changes are hard. They take time and effort. Heck, we may be nearly alone in using this approach for a long time yet.
The question you have to ask is what matters to you. Do you want the graphics card that scores best in the FPS beauty pageant, or do you want that one that gives you the smoothest gaming experience when you fire up a freshly downloaded game this Christmas? If you just want bragging rights, by all means, choose the Radeon HD 7950. If you're looking for the friction-free fluidity that only comes from consistently quick frame delivery, though, our recommendation remains the GeForce GTX 660 Ti.
213 comments — Last by Rigel84 at 8:00 AM on 01/02/13
|1. GKey13 - $650||2. JohnC - $600||3. davidbowser - $501|
|4. cmpxchg - $500||5. DeadOfKnight - $400||6. danny e. - $375|
|7. the - $360||8. Ryszard - $351||9. rbattle - $350|
|10. Ryu Connor - $350|
|Asus' ROG Swift PG278Q G-Sync monitor reviewedEverything is awesome when you're part of a team||103|
|Nvidia's Shield Tablet reviewedA whole other kind of Android tablet||28|
|First impressions of Nvidia's Shield TabletMobile gaming done right||43|
|Video review: Corsair Raptor M45, Vengeance M65 & M95Gaming mice from simple to complex||41|
|Custom-cooled Radeon R9 290X cards from Asus and XFX reviewedMore fans and pipes than a Phish concert||73|
|AMD's Radeon R9 295 X2 graphics card reviewedHawaii is surrounded by water, right?||251|
|A closer look at DirectX 12...or, rather, at Direct3D 12||114|
|Nvidia's GeForce GTX 750 Ti 'Maxwell' graphics processor...takes on the Radeon R7 265 and friends||202|
|Only a few hours remain to win ~$1k of hardware via haiku||15|
|Thursday Evening Shortbread||0|
|Specs for upcoming FX-8300 chips leak out||27|
|Report: Windows Threshold preview planned for Sept 30||23|
|Browser plugin identifies advertorial content||7|
|HP's Q3 financials driven by strong notebook, desktop sales||25|
|Wednesday Night Shortbread||15|
|Zotac's Zbox ID92 mini-PC reviewed||9|
|Some popular Chrome extensions are misbehaving||32|