Developers take on synthetic benchmarks
Since I'm in the middle of a marathon graphics card testing session, Beyond3D's The Way It's Meant To Be Reviewed article piqued my interest. The article examines the challenges reviewers face when evaluating graphics card and asks several prominent game developers for their opinion on the use of synthetic benchmarks in reviews. Overall, developers come out in favor of the selective use of synthetic benchmarks where current games don't take advantage of more advanced hardware features and capabilities. John Carmack chimes in to suggest that synthetic benchmarks should be open source, too.