nephele
/
haikuwebkit
1
0
Fork 0
Code Issues Releases Activity
haikuwebkit/PerformanceTests/JSBench/harness.py

204 lines
7.9 KiB
Python
Raw Permalink Normal View History

We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
#!/usr/bin/env python
# Copyright (C) 2011, 2012 Purdue University
# Written by Gregor Richards
# All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions are met:
#
# 1. Redistributions of source code must retain the above copyright notice,
# this list of conditions and the following disclaimer.
# 2. Redistributions in binary form must reproduce the above copyright notice,
# this list of conditions and the following disclaimer in the documentation
# and/or other materials provided with the distribution.
#
# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
# AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
# ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE
# LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
# CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
# SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
# INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
# CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
# ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
# POSSIBILITY OF SUCH DAMAGE.
import math
import os
import re
import sys
benchmarks = ["amazon/chrome", "amazon/firefox", "amazon/safari",
"facebook/chrome", "facebook/firefox", "facebook/safari",
"google/chrome", "google/firefox", "google/safari",
"twitter/chrome", "twitter/firefox", "twitter/safari",
"yahoo/chrome", "yahoo/firefox", "yahoo/safari"]
modes = {
"*": ["urem"],
"amazon/firefox": ["urm"],
"google/firefox": ["uem"]
}
runcount = 25
keepruns = 20
keepfrom = runcount - keepruns
if len(sys.argv) != 2:
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print("Use: python harness.py <JS executable>")
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
exit(1)
js = sys.argv[1]
# standard t-distribution for normally distributed samples
tDistribution = [0, 0, 12.71, 4.30, 3.18, 2.78, 2.57, 2.45, 2.36, 2.31, 2.26,
2.23, 2.20, 2.18, 2.16, 2.14, 2.13, 2.12, 2.11, 2.10, 2.09, 2.09, 2.08, 2.07,
2.07, 2.06, 2.06, 2.06, 2.05, 2.05, 2.05, 2.04, 2.04, 2.04, 2.03, 2.03, 2.03,
2.03, 2.03, 2.02, 2.02, 2.02, 2.02, 2.02, 2.02, 2.02, 2.01, 2.01, 2.01, 2.01,
2.01, 2.01, 2.01, 2.01, 2.01, 2.00, 2.00, 2.00, 2.00, 2.00, 2.00, 2.00, 2.00,
2.00, 2.00, 2.00, 2.00, 2.00, 2.00, 2.00, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99,
1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99,
1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.99, 1.98, 1.98, 1.98, 1.98, 1.98,
1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98,
1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98,
1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98,
1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.98,
1.98, 1.98, 1.98, 1.98, 1.98, 1.98, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97,
1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.97, 1.96]
def tDist(n):
if (n >= len(tDistribution)):
return tDistribution[-1]
return tDistribution[n]
results = {}
for benchmark in benchmarks:
results[benchmark] = {}
bmodes = modes["*"]
if benchmark in modes:
bmodes = modes[benchmark]
for mode in bmodes:
results[benchmark][mode] = []
for runno in range(runcount):
# Now run it and get the results
print(benchmark + " " + mode + " " + str(runno))
res = os.popen(js + " " + benchmark + "/" + mode + ".js").read()
time = float(re.match("Time: ([0-9]*)ms", res).group(1))
if runno >= keepfrom:
results[benchmark][mode].append(time)
# Collect the totals
sresults = {}
totals = {
"mean": 1,
"stddev": 1,
"sem": 1,
"ci": 1,
"runs": 0
}
for benchmark in benchmarks:
sresults[benchmark] = {}
bmodes = modes["*"]
if benchmark in modes:
bmodes = modes[benchmark]
for mode in bmodes:
sresults[benchmark][mode] = sresult = {}
result = results[benchmark][mode]
totals["runs"] = totals["runs"] + 1
sresult["mode"] = mode
mean = sresult["mean"] = sum(result) / len(result)
stddev = sresult["stddev"] = math.sqrt(
sum(
map(lambda e: math.pow(e - mean, 2), result)
) / (len(result) - 1)
)
sm = sresult["sm"] = stddev / mean
sem = sresult["sem"] = stddev / math.sqrt(len(result))
semm = sresult["semm"] = sem / mean
ci = sresult["ci"] = tDist(len(result)) * sem
cim = sresult["cim"] = ci / mean
totals["mean"] *= mean
totals["stddev"] *= stddev
totals["sem"] *= sem
totals["ci"] *= ci
power = 1 / totals["runs"]
totals["mean"] = math.pow(totals["mean"], power)
totals["stddev"] = math.pow(totals["stddev"], power)
totals["sm"] = totals["stddev"] / totals["mean"]
totals["sem"] = math.pow(totals["sem"], power)
totals["semm"] = totals["sem"] / totals["mean"]
totals["ci"] = math.pow(totals["ci"], power)
totals["cim"] = totals["ci"] / totals["mean"]
totals["sm"] *= 100
totals["semm"] *= 100
totals["cim"] *= 100
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print("Final results:")
print(u" %(mean)fms \u00b1 %(cim)f%% (lower is better)" % totals)
print(" Standard deviation = %(sm)f%% of mean" % totals)
print(" Standard error = %(semm)f%% of mean" % totals)
print(" %(runs)d runs" % {"runs": runcount})
print("")
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print("Result breakdown:")
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
for benchmark in benchmarks:
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print(" %(benchmark)s:" % {"benchmark": benchmark})
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
bmodes = modes["*"]
if benchmark in modes:
bmodes = modes[benchmark]
for mode in bmodes:
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print(u" %(mode)s: %(mean)fms \u00b1 %(cim)f%% (stddev=%(sm)f%%, stderr=%(semm)f%%)" % sresults[benchmark][mode])
print("")
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print("Raw results:")
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
for benchmark in benchmarks:
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print(" %(benchmark)s:" % {"benchmark": benchmark})
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
bmodes = modes["*"]
if benchmark in modes:
bmodes = modes[benchmark]
for mode in bmodes:
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
print(" %(mode)s: %(results)s" % {
We should have JSBench in PerformanceTests https://bugs.webkit.org/show_bug.cgi?id=157952 Rubber-stamped by Saam Barati. PerformanceTests: There are some slight changes to the layout of the test directory to make it work nicely with run-jsc-benchmarks. Before JSBench had each of the browser specific sub-tests in a sub-directory. These have been flattened e.g. amazon/safari/ has become amazon-safari/. * JSBench/amazon-chrome-win/urem.html: Added. * JSBench/amazon-chrome-win/urem.js: Added. * JSBench/amazon-chrome/urem.html: Added. * JSBench/amazon-chrome/urem.js: Added. * JSBench/amazon-firefox-win/urm.html: Added. * JSBench/amazon-firefox-win/urm.js: Added. * JSBench/amazon-firefox/urm.html: Added. * JSBench/amazon-firefox/urm.js: Added. * JSBench/amazon-safari/urem.html: Added. * JSBench/amazon-safari/urem.js: Added. * JSBench/browsercheck.js: Added. * JSBench/facebook-chrome-win/urem.html: Added. * JSBench/facebook-chrome-win/urem.js: Added. * JSBench/facebook-chrome/urem.html: Added. * JSBench/facebook-chrome/urem.js: Added. * JSBench/facebook-firefox-win/urem.html: Added. * JSBench/facebook-firefox-win/urem.js: Added. * JSBench/facebook-firefox/urem.html: Added. * JSBench/facebook-firefox/urem.js: Added. * JSBench/facebook-safari/urem.html: Added. * JSBench/facebook-safari/urem.js: Added. * JSBench/google-chrome-win/urem.html: Added. * JSBench/google-chrome-win/urem.js: Added. * JSBench/google-chrome/urem.html: Added. * JSBench/google-chrome/urem.js: Added. * JSBench/google-firefox-win/urem.html: Added. * JSBench/google-firefox-win/urem.js: Added. * JSBench/google-firefox/uem.html: Added. * JSBench/google-firefox/uem.js: Added. * JSBench/google-safari/urem.html: Added. * JSBench/google-safari/urem.js: Added. * JSBench/harness.html: Added. * JSBench/harness.js: Added. * JSBench/harness.py: Added. * JSBench/index.html: Added. * JSBench/reload.html: Added. * JSBench/twitter-chrome-win/rem.html: Added. * JSBench/twitter-chrome-win/rem.js: Added. * JSBench/twitter-chrome/urem.html: Added. * JSBench/twitter-chrome/urem.js: Added. * JSBench/twitter-firefox-win/urem.html: Added. * JSBench/twitter-firefox-win/urem.js: Added. * JSBench/twitter-firefox/urem.html: Added. * JSBench/twitter-firefox/urem.js: Added. * JSBench/twitter-safari/urem.html: Added. * JSBench/twitter-safari/urem.js: Added. * JSBench/yahoo-chrome-win/urem.html: Added. * JSBench/yahoo-chrome-win/urem.js: Added. * JSBench/yahoo-chrome/urem.html: Added. * JSBench/yahoo-chrome/urem.js: Added. * JSBench/yahoo-firefox-win/urem.html: Added. * JSBench/yahoo-firefox-win/urem.js: Added. * JSBench/yahoo-firefox/urem.html: Added. * JSBench/yahoo-firefox/urem.js: Added. * JSBench/yahoo-safari/urem.html: Added. * JSBench/yahoo-safari/urem.js: Added. Tools: This changes the runner to use the layout of the newest version of JSBench. * Scripts/run-jsc-benchmarks: Canonical link: https://commits.webkit.org/176149@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@201339 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2016-05-24 19:00:51 +00:00
"mode": mode,
"results": results[benchmark][mode]
[python] Replace print operator with print() function for python3 compatibility https://bugs.webkit.org/show_bug.cgi?id=180592 Reviewed by Michael Catanzaro. PerformanceTests: * JSBench/harness.py: Source/JavaScriptCore: * Scripts/generateYarrUnicodePropertyTables.py: (openOrExit): (verifyUCDFilesExist): (Aliases.parsePropertyAliasesFile): (Aliases.parsePropertyValueAliasesFile): * Scripts/make-js-file-arrays.py: (main): * generate-bytecode-files: Source/WebCore/PAL: * AVFoundationSupport.py: Tools: * BuildSlaveSupport/wait-for-SVN-server.py: (getLatestSVNRevision): (waitForSVNRevision): * Scripts/download-latest-github-release.py: (find_latest_release): (main): * Scripts/update-wasm-gcc-torture.py: (update_lkgr): (untar_torture): (list_js_files): (waterfall_known_failures): * Scripts/update-webkit-wincairo-libs.py: * Scripts/webkitpy/benchmark_runner/benchmark_runner.py: (BenchmarkRunner.show_results): * Scripts/webkitpy/benchmark_runner/http_server_driver/simple_http_server_driver.py: (SimpleHTTPServerDriver.fetch_result): * Scripts/webkitpy/benchmark_runner/run_benchmark.py: (list_benchmark_plans): * Scripts/webkitpy/bindings/main.py: (BindingsTests.generate_from_idl): (BindingsTests.generate_supplemental_dependency): (BindingsTests.detect_changes): (BindingsTests.run_tests): (BindingsTests.main): * Scripts/webkitpy/codegen/main.py: (BuiltinsGeneratorTests.generate_from_js_builtins): (BuiltinsGeneratorTests.detect_changes): (BuiltinsGeneratorTests.single_builtin_test): (BuiltinsGeneratorTests.run_test): (BuiltinsGeneratorTests.run_tests): (BuiltinsGeneratorTests.main): * Scripts/webkitpy/common/net/bugzilla/bugzilla_mock.py: (MockBugzilla.fetch_attachment): * Scripts/webkitpy/common/net/buildbot/buildbot.py: (Builder._fetch_revision_to_build_map): * Scripts/webkitpy/common/system/crashlogs.py: (CrashLogs._find_newest_log_win): * Scripts/webkitpy/common/system/outputcapture_unittest.py: (OutputCaptureTest.test_output_capture_scope): * Scripts/webkitpy/common/system/profiler.py: (GooglePProf.profile_after_exit): (Perf.profile_after_exit): * Scripts/webkitpy/common/system/user.py: (User.prompt_with_multiple_lists): (User.prompt_with_list): (User._warn_if_application_is_xcode): (User.edit_changelog): * Scripts/webkitpy/inspector/main.py: (InspectorGeneratorTests.generate_from_json): (InspectorGeneratorTests.detect_changes): (InspectorGeneratorTests.run_tests): (InspectorGeneratorTests.main): * Scripts/webkitpy/layout_tests/controllers/manager.py: (Manager._print_expectation_line_for_test): (Manager._print_expectations_for_subset): (Manager._print_expectations_for_subset.if): * Scripts/webkitpy/layout_tests/servers/run_webkit_httpd.py: (run_server): * Scripts/webkitpy/port/config_standalone.py: (main): * Scripts/webkitpy/port/darwin_testcase.py: (DarwinTest.test_spindump.logging_run_command): (DarwinTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios.py: (IOSPort.clean_up_test_run): * Scripts/webkitpy/port/ios_device_unittest.py: (IOSDeviceTest.test_spindump.logging_run_command): (IOSDeviceTest.test_sample_process.logging_run_command): * Scripts/webkitpy/port/ios_simulator_unittest.py: (IOSSimulatorTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/port/leakdetector_unittest.py: (test_count_total_bytes_and_unique_leaks.mock_run_script): * Scripts/webkitpy/port/mac_unittest.py: (MacTest.test_xcrun.throwing_run_command): * Scripts/webkitpy/style/checkers/contributors.py: (ContributorsChecker.check): * Scripts/webkitpy/tool/commands/abstractlocalservercommand.py: (AbstractLocalServerCommand.execute): * Scripts/webkitpy/tool/commands/adduserstogroups.py: (AddUsersToGroups.execute): * Scripts/webkitpy/tool/commands/analyzechangelog.py: (AnalyzeChangeLog._generate_jsons): (AnalyzeChangeLog.execute): (ChangeLogAnalyzer._set_filename): (ChangeLogAnalyzer.analyze): * Scripts/webkitpy/tool/commands/bugfortest.py: (BugForTest.execute): * Scripts/webkitpy/tool/commands/bugsearch.py: (execute): * Scripts/webkitpy/tool/commands/findusers.py: (FindUsers.execute): * Scripts/webkitpy/tool/commands/gardenomatic.py: (GardenOMatic.execute): * Scripts/webkitpy/tool/commands/rebaseline.py: (RebaselineTest.execute): * Scripts/webkitpy/tool/commands/rebaselineserver.py: (RebaselineServer._prepare_config): * Scripts/webkitpy/tool/commands/setupgitclone.py: (SetupGitClone.execute): (SetupGitClone._get_username_and_email): * Scripts/webkitpy/tool/commands/suggestnominations.py: (SuggestNominations._print_nominations): (SuggestNominations._print_counts): * Scripts/webkitpy/tool/commands/upload.py: (CommitMessageForCurrentDiff.execute): (CreateBug.prompt_for_bug_title_and_comment): * Scripts/webkitpy/tool/multicommandtool.py: (HelpCommand.execute): * Scripts/webkitpy/tool/servers/gardeningserver_unittest.py: (TestGardeningHTTPRequestHandler._serve_text): (TestGardeningHTTPRequestHandler._serve_json): * Scripts/webkitpy/tool/steps/addsvnmimetypeforpng.py: (AddSvnMimetypeForPng.run): * Scripts/webkitpy/tool/steps/suggestreviewers.py: (SuggestReviewers.run): * Scripts/webkitpy/w3c/test_importer.py: (TestImporter.update_tests_options): * Scripts/webkitpy/webdriver_tests/webdriver_test_runner_selenium.py: (WebDriverTestRunnerSelenium.run): * TestResultServer/model/jsonresults_unittest.py: * gtk/ycm_extra_conf.py: (FlagsForFile): * lldb/lldb_webkit.py: (btjs): LayoutTests: * html5lib/generate-test-wrappers.py: (_remove_stale_tests): * http/tests/websocket/tests/hybi/bad-handshake-crash_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-more-accept-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-connection-header_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-cr_wsh.py: (web_socket_do_extra_handshake): * http/tests/websocket/tests/hybi/handshake-fail-by-no-upgrade-header_wsh.py: (web_socket_do_extra_handshake): Canonical link: https://commits.webkit.org/196514@main git-svn-id: https://svn.webkit.org/repository/webkit/trunk@225698 268f45cc-cd09-0410-ab3c-d52691b4dbfc
2017-12-08 21:56:09 +00:00
})