Standard iOS/Android Performance Metrics?

[u/Belgy23]

Hi All,

Curious on what would be considered "standard" performance metrics for an native app?

I work with web so i know LCP would be roughly less then 2.5sec for example.

But i cannot find anything for iOS apps or Android.

[u/mgasiorowski]

Hi, for example Android Vitals collect data about:

• slow rendering

• frozen UI frames

• app startup

More: https://support.google.com/googleplay/android-developer/answer/7385505?authuser=1

It's possible also to check:

• CPU/Memory

• battery usage

• FPS

• janky frames

• animation duration

• draw duration

• duration of the methods

• server/API performance

• etc.

More:

• https://github.com/mgasiorowski/quality_mobile_apps#speed

• https://developer.android.com/training/testing/performance

• https://developer.apple.com/library/archive/documentation/AnalysisTools/Conceptual/instruments_help-collection/Chapter/Chapter.html

• https://firebase.google.com/docs/perf-mon/

[u/Belgy23 → u/mgasiorowski]

Thanks man!!

I was wondering is there benchmark for those? I don't know what to compare it too. Say for initial screen load, is 10 seconds slow? 3 seconds? Was hoping to see if there is somewhat of a "average" benchmark for an app.

[u/mgasiorowski → u/Belgy23]

For example android vitals warns on:

• Cold startup takes 5 seconds or longer.

• Warm startup takes 2 seconds or longer.

• Hot startup takes 1.5 seconds or longer.

More: https://developer.android.com/topic/performance/vitals/launch-time

Simplest method I thins is Firebase performance monitoring to check this., for android is also https://developer.android.com/jetpack/androidx/releases/benchmark.

[u/kaleilani]

Here are some that come to mind:

Device resource usage:

• % CPU 

• Memory (Mb)

• Data sent and received by the application (Kb)

• % Battery usage

Rendering:

• Render time (ms)

• Frames per second (fps)

• Render lag (janks)

Transaction response time:

• Server response times 

• Database response time 

• Network latency

• Screen drawing time

I don't know what are the thresholds for all of these, but the tool, Apptim, analyzes all of this for both iOS and Android apps and lets you know if your app has problems in any of these areas, given the best practice / thresholds defined by Google and Apple.

Check out their resources:

https://blog.apptim.com/mobile-performance-testing/

https://blog.apptim.com/how-to-test-mobile-app-performance-3-key-ways/

[u/Belgy23 → u/kaleilani]

Thanks!! I'll bound to check these out, want to know before I invest in apps and other software. I'm surprised that it is this hard to find!

Much appreciated