Consumer Reports (CR) has generally been a fan of the build quality and performance of Apple's computers. However, the consumer watchdog recently cautioned its readers against purchasing Apple's newest MacBook Pro due to discrepancies between Cupertino's published battery life specifications and the figures CR derived in its lab.
Apple and CR were eventually able to pin down and correct a bug related specifically to CR's testing methods, and the nonprofit agreed to rerun its tests. The results of the second round of tests are right in line with Apple's claims. One of CR's test machines even turned a battery life of over 18 hours with the corrections. With the new results in hand, CR now recommends the latest MacBook Pros to consumers.
For the unfamiliar, the issue arose from the fact that Consumer Reports disables browser caching on all machines it tests for battery life. That scenario inadvertently triggered a bug in Safari, which Apple has now fixed. Apple still doesn't believe that CR's testing methods are representative of real-world use, but it seems the sparring partners can at least expect mutually agreeable results from the testing firm's methods for now.
Having had to issue a mea culpa regarding test results ourselves last year, we'd hope this experience leads CR to exercise more caution about presenting wildly variable test numbers as conclusive evidence. Though the initial controversy may have led to a large upswell of interest, it ultimately seems harmful to CR's reputation for rigorous and data-driven testing. Perhaps this fiasco will result in a more conservative approach for the consumer watchdog in the future.
|The Tech Report System Guide: September 2017 edition||8|
|Intel shows off 10-nm Cannon Lake wafer and talks process tech||18|
|AOC Agon AG322QCX offers 32" of gaming goodness on the cheap||10|
|Aqua Computer Cuplex Kryos Next block is ready for Threadripper||8|
|Amazon's Kindle Fire HD 10 gets a meaty hardware upgrade||19|
|Noctua NH-L9a-AM4 and NH-L12S are ready for little boxes||8|
|Gigabyte's X399 Designare-EX adds Thunderbolt to Threadripper||14|
|No, you can't enable Threadripper's extra two dice||52|
|International Talk Like a Pirate Day Shortbread||29|
|For some users, though, Apple's commitment to maintaining the software on its devices as they age is an even more compelling reason than hardware for...||+37|