haikuwebkit/PerformanceTests/MotionMark
Myles C. Maxfield 85abf67b1e MotionMark scores are super sensitive to a single long frame
https://bugs.webkit.org/show_bug.cgi?id=220847
<rdar://problem/74152743>

Reviewed by Jon Lee.

Currently, "ramp" tests have three phases. The middle phase is where they try to determine a maximum reasonable
complexity, and the third one is where they try various complexities between 0 and the maximum. The calculation
of this maximum reasonable complexity is currently very sensitive to outlier frame times. If there is a single
outlier frame time, the failure mode is to assume that the maximum complexity is ~10. So, the solution is to
ignore outlier frame times during this first phase, and to ensure that there are at least 9 frames measured that
have non-outlier times.

This test also changes the speed of the middle phase. Previously, each interval during this phase had
a complexity that was 3.16x of the previous complexity. This patch changes that to 1.78x of the previous
complexity for complexities above 50, and 1.33x for complexities above 10,000.

* MotionMark/tests/resources/main.js:
(filterOutOutliers):
(_measureAndResetInterval):
(update):
(registerFrameTime):
(intervalHasConcluded):
(start):
(didFinishInterval):


Canonical link: https://commits.webkit.org/235098@main
git-svn-id: https://svn.webkit.org/repository/webkit/trunk@274179 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2021-03-09 23:08:41 +00:00
..
resources MotionMark focus test can cause extreme variance in whichever test runs directly after it 2021-01-29 03:42:39 +00:00
tests MotionMark scores are super sensitive to a single long frame 2021-03-09 23:08:41 +00:00
about.html
developer.html MotionMark focus test can cause extreme variance in whichever test runs directly after it 2021-01-29 03:42:39 +00:00
index.html