Scores: HIGH differences/inconsistencies/variance (iOS; iPhone)

Bernie Hildebrandt's Avatar

Bernie Hildebrandt

24 Jun, 2017 07:20 PM

Keyword variants: unusual unusually extreme score different inconsistent variable 'iPhone 7 Plus'.

Dear geeky primates:

The attached photo (PNG) is a screen capture from within the your 'Geekbench 4' app, showing the most recent historical CPU results from my iPhone 7 Plus (256GB) running the latest iOS 10.3.2

Generally speaking the tests where performed with as much external noise or internal limits reduced as much as possible, which may have included:
-enabling Airplane Mode (turning the cellular radio OFF) but re-enabling Wi-Fi (as required to for parts of the benchmarks).
-Bluetooth OFF
-closed all apps (other than Geekbench 4)
-have virtually all apps set to run only when being used wrt Location Services ( i.e. not set to "always")
-running tests while device was relatively cool (room temp) vs hot (so as not to unintentional engage thermal breakers/throttling)
-Siri turned OFF
-Battery: low power mode turned OFF

NB: I did NOT go as far as turning OFF
-Location Services (but virtually all are OFF as mentioned)
-any existing Notifications

As you can see from the attached there is a HUGE variation in the benchmark results. I'm comfortable with a 10% deviation anytime or a 5% deviation when I try to control for any noise. The APRIL results are in line with the aggregates you've compiled. Then recently results drop by HALF. But seem to BOUNCH back. Disturbingly, the LAST results show MULTICORE results LOWER than SINGLECORE.

Given these results, a layperson would expect the COMPUTE benchmarks to vary in sympathy with these ERRATIC CPU benchmarks. This was not the case. That benchmark test (results not shown) was run at similar times (hence similar conditions) but were always in line with the aggregates.

What do you make of this monkey business?

P.S.
   I read both your white papers describing the nature of the benchmarks. I looked for answers in you Knowledge Base. I tried to review all relevant posts on your Discussion Board.
   I understand what is being executed. I did not find any answers. Nor did I see such extreme results (regardless of HW or OS). There is an 800 lb gorilla in the room. OK, just under 363 kg. Still, that's a lot of gorilla.

  1. Support Staff 1 Posted by Colin on 24 Aug, 2017 06:04 PM

    Colin's Avatar

    Hi Bernie,

    Thanks for your message, and I apologize for the delayed reply. Based on your description, I am not sure what could be causing this issue. Could you please resend your PNG image for me to take a look at?

    Regards,
    Colin
    Primate Labs Inc.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac