MediaTek defends itself after benchmark cheating accusations

After reports emerged suggesting MediaTek has been cheating the benchmarking system, the chipset manufacturer has vehemently defending its position.

It has been alleged in AnandTech that MediaTek has been cheating the mobile enthusiasts with some clever code. In the firmware files, references were found tying benchmark apps to a so-called ‘sports mode’. When triggered (if a benchmark app has been initiated), features on the phone were ramped up to give the impression of better performance.

AnandTech claims the cheating was brought to light thanks to testing two different OPPO Reno 3 devices. The Reno 3 Pro (the European version) beat the Reno 3 (the Chinese version) in the PCMark benchmark utility, despite its Helio P95’s Cortex-A75 CPU cores being two generations older than the Dimensity 1000L’s Cortex-A77 CPU cores. And not only did the Reno 3 Pro has older MediaSet chipsets than the Reno 3 devices, it had half as many.

The difference in the test results were slightly unusual, though when a ‘stealth’ benchmark apps were used, the lower results were confirmed.

Why those in the industry feel it is necessary to cheat benchmarking tests is anybody’s guess. The negatives of being caught far outweigh the gains of impressing a few hyper-geeks, and the cheaters eventually get caught. It is embarrassing and some might ask whether they are a reliable partner. The chipsets in questions have been used in OPPO, Vivo, Xiaomi and Sony devices.

Following the original statement, which you can see at the foot of the article, an expanded blog post was offered to the industry.

“We do find it interesting that AnandTech has called into question the benchmarking optimizations on MediaTek powered devices, when these types of configurations are widely practiced across the industry,” MediaTek said. “If they were to review other devices, they would see, as we have, that our key competitor has chipsets that operate in the exact same way – what AnandTech has deemed cheating on device benchmarking tests.”

Although this is a very reasonable explanation, it is still a bit fishy. It is perfectly understandable for performance to be ramped up for some applications, but the fact the ‘sports mode’ has been linked to the initiation of a benchmarking app as well as other functions (gaming for instance) suggests the aim is to fool the tests. Most reasonable individuals would assume these tests are performed in ‘normal’ mode.

Whether this is an adequate explanation, we’ll let the court of public opinion decide, but it is somewhat of a flimsy excuse.

Original MediaTek statement:

MediaTek follows accepted industry standards and is confident that benchmarking tests accurately represent the capabilities of our chipsets. We work closely with global device makers when it comes to testing and benchmarking devices powered by our chipsets, but ultimately brands have the flexibility to configure their own devices as they see fit. Many companies design devices to run on the highest possible performance levels when benchmarking tests are running in order to show the full capabilities of the chipset. This reveals what the upper end of performance capabilities are on any given chipset.

Of course, in real world scenarios there are a multitude of factors that will determine how chipsets perform. MediaTek’s chipsets are designed to optimize power and performance to provide the best user experience possible while maximizing battery life. If someone is running a compute-intensive program like a demanding game, the chipset will intelligently adapt to computing patterns to deliver sustained performance. This means that a user will see different levels of performance from different apps as the chipset dynamically manages the CPU, GPU and memory resources according to the power and performance that is required for a great user experience. Additionally, some brands have different types of modes turned on in different regions so device performance can vary based on regional market requirements.

We believe that showcasing the full capabilities of a chipset in benchmarking tests is in line with the practices of other companies and gives consumers an accurate picture of device performance.

MWC cancellations snowball as show implements strict coronavirus precautions

At least four more major participants pulled out of MWC 2020 over the weekend, while restrictions on visitors from China have been tightened.

Amazon, Nvidia, Sony and Viavi have now all confirmed they’ve decided the risk of coronavirus infection is too great for them to allow their formal presence to go ahead. Here are their statements.

Amazon: “Due to the outbreak and continued concerns about novel coronavirus, Amazon will withdraw from exhibiting and participating in Mobile World Congress 2020, scheduled for Feb. 24-27 in Barcelona, Spain.”

Nvidia: “We’ve informed GSMA, the organizers of MWC Barcelona, that we won’t be sending our employees to this year’s event. Given public health risks around the coronavirus, ensuring the safety of our colleagues, partners and customers is our highest concern.

“MWC Barcelona is one of the world’s most important technology conferences. We’ve been looking forward to sharing our work in AI, 5G and vRAN with the industry. We regret not attending, but believe this is the right decision. We’re grateful for GSMA’s leadership and continued efforts to ensure the safety of all attendees.”

Sony: “Sony has been closely monitoring the evolving situation following the novel coronavirus outbreak, which was declared a global emergency by the World Health Organization on January 30th, 2020. As we place the utmost importance on the safety and wellbeing of our customers, partners, media and employees, we have taken the difficult decision to withdraw from exhibiting and participating at MWC 2020 in Barcelona, Spain.

“The Sony press conference will now instead take place at the scheduled time of 8:30am (CET) on February 24, 2020 as a video via our official Xperia YouTube channel to share our exciting product news. https://www.youtube.com/user/sonyxperia. Sony would like to thank everyone for their understanding and ongoing support during these challenging times.”

Viavi: “After reviewing all available data, VIAVI has chosen to cancel participation in this year’s Mobile World Congress in Barcelona out of an abundance of caution and concern for our employees, customers and partners.”

There are, of course, rumours of other cancellations, but none confirmed at time of writing. Cnet reports that Samsung is still exhibiting, but is acting to protect just its senior execs, which isn’t a great look if it’s true. We asked Samsung for comment and were told that, while there is no official statement, the company is still attending.

Meanwhile the organisers of MWC 2020, the GSMA, issued another update over the weekend, affirming once more that the event is still going ahead, but announcing a raft of new precautions and restrictions designed to mitigate the risk of coronavirus infection to exhibitors and attendees.

  • All travellers from the Hubei province will not be permitted access to the event (MWC Barcelona, Four Years From Now (4YFN), xside and YoMo)
  • All travellers who have been in China will need to demonstrate proof they have been outside of China 14 days prior to the event (passport stamp, health certificate)
  • Temperature screening will be implemented
  • Attendees will need to self-certify they have not been in contact with anyone infected.

While it’s totally understandable that the GSMA will do everything in its power to make the show as safe as possible, it’s hard to se how some of those measures will be enforceable. What does ‘self-certify’ even mean? Also this advice was issued yesterday, 15 days before the official start of the event. So, essentially, if you haven’t left China for the event already, don’t bother.

The whole event feels like it’s balancing on a knife-edge, with just one more negative development potentially enough to tip the balance towards outright cancellation. We understand many companies are following Ericsson’s lead and conducting formal risk assessments, the results of which are probably already being analysed. The smart money was on Nokia pulling out after the Ericsson decision, but we’ve heard nothing from them yet. The biggest exhibitor, however, is Chinese firm Huawei, and the fate of MWC could lie in their hands.

Sony puts smartphones on the back burner as it doubles down on music

Japanese technology and media conglomerate Sony has announced its latest cunning plan and it involved focusing on content and content creators.

At the same time Sony announced it is acquiring 60% of EMI Music Publishing from Mubadala for $2.85 billion, which means it now owns 90% of EMI and, when combined with its own music publishing business, makes Sony the world’s biggest music publisher.

“The music business has enjoyed a resurgence over the past couple of years, driven largely by the rise of paid subscription-based streaming services,” said Sony CEO Kenichiro Yoshida. “In the entertainment space, we are focusing on building a strong IP portfolio, and I believe this acquisition will be a particularly significant milestone for our long-term growth.”

Sony’s new strategy focuses on investing in content and content creation, while making sure the hardware business doesn’t go down the toilet. This is an extension of the Kando philosophy Sony has been banging on about for a few years now – a Japanese word that seems to mean the excitement you get when you encounter something exceptional.

It’s all about getting closer to people, apparently, and appealing to their emotional side. This seems to be a desire to restore the Sony brand to its former highs, perhaps last experienced in the 1980s through products such as the Walkman. This would be difficult to achieve through just hardware as Apple has that crown and seems unlikely to relinquish it anytime soon, so Sony is focusing on providing people with content and helping them create their own.

So you can effectively divide Sony into three main silos now: content IP (video, music, games), branded hardware (smartphones, consumer electronics) and consumer enablers (CMOS sensors and financial services). The emphasis is on investing in the content side and keeping the CE cash cow stable, which probably means continued managed decline for the smartphone segment. You can see how this all plays out in the Sony slides below.

Sony KANDO

Sony business segments

 

Sony strategy 1

 

Sony strategy 2

 

Sony strategy 3

 

Sony investment areas