The Phoronix Test Suite is the most comprehensive testing and benchmarking platform

Overview

Phoronix Test Suite 10.8.1

Phoronix Test Suite

The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available for Linux, Solaris, macOS, Windows, and BSD operating systems. The Phoronix Test Suite allows for carrying out tests in a fully automated manner from test installation to execution and reporting. All tests are meant to be easily reproducible, easy-to-use, and support fully automated execution. The Phoronix Test Suite is open-source under the GNU GPLv3 license and is developed by Phoronix Media in cooperation with partners.

Phoronix Test Suite Documentation

The Phoronix Test Suite itself is an open-source framework for conducting automated tests along with reporting of test results, detection of installed system software/hardware, and other features. This framework is designed to be an extensible architecture so that new test profiles and suites can be easily added to represent performance benchmarks, unit tests, and other quantitative and qualitative (e.g. image quality comparison and pass/fail) measurements. Available through OpenBenchmarking.org, a collaborative storage platform developed in conjunction with the Phoronix Test Suite, are more than 600 individual test profiles and more than 200 test suites available by default from the Phoronix Test Suite. Independent users are also able to upload their test results, profiles, and suites to OpenBenchmarking.org.

A test profile is a single test that can be executed by the Phoronix Test Suite -- with a series of options possible within every test -- and a test suite is a seamless collection of test profiles and/or additional test suites. A test profile consists of a set of Bash/shell scripts and XML files while a test suite is a single XML file. Modules for the Phoronix Test Suite also allow for integration with git-bisect and other revision control systems for per-commit regression testing, system sensor monitoring, and other extras.

OpenBenchmarking.org also allows for conducting side-by-side result comparisons, a central location for storing and sharing test results, and collaborating over test data. Phoromatic is a complementary platform to OpenBenchmarking.org and the Phoronix Test Suite for interfacing with Phoronix Test Suite client(s) to automatically execute test runs on a timed, per-commit, or other trigger-driven basis. Phoromatic is designed for enterprise and allows for the easy management of multiple networked systems running Phoronix Test Suite clients via a single web-based interface.

Professional support and custom engineering for the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org is available by contacting https://www.phoronix-test-suite.com/.

Full details on the Phoronix Test Suite setup and usage is available from the included HTML/PDF documentation within the phoronix-test-suite package and from the Phoronix Test Suite documentation directory.

Installation & Setup

The Phoronix Test Suite is supported on Linux, *BSD, Solaris, macOS, and Windows systems. However, the most full-featured and well supported operating system for conducting the tests is Linux with some non-basic functionality not being available under all platforms. The Phoronix Test Suite software/framework is compatible with all major CPU architectures (e.g. i686, x86_64, ARM / AArch64, RISC-V, POWER 64-bit), but not all of the test profiles/suites are compatible with all architectures.

The Phoronix Test Suite can be installed for system-wide usage or run locally without installation from the extracted tar.gz/zip package. The only hard dependency on the Phoronix Test Suite is having command-line support for PHP (PHP 5.3+) installed. A complete PHP stack (e.g. with web server) is not needed, but merely the PHP command-line support, which is widely available from operating system package managers under the name php, php7-cli, php5-cli, php7 or php8.

Usage

The process to download, install/setup, execute, and report the results of a benchmark can be as simple as a command such as phoronix-test-suite benchmark smallpt to run a simple CPU test profile. If wishing to simply install a test, it's a matter of running phoronix-test-suite install and to run it's phoronix-test-suite run . There's also a batch mode for non-interactive benchmarking by first running phoronix-test-suite batch-setup and then using the batch-run sub-command rather than run. For more guidance see the Phoronix Test Suite documentation.

Viewing installed system hardware and software is available via phoronix-test-suite system-info.

Facilitating a result comparison from OpenBenchmarking.org can be done by running, for example, phoronix-test-suite benchmark 1204293-BY-PHORONIX357 if wishing to compare the results of the https://openbenchmarking.org/result/1204293-BY-PHORONIX357 result file.

Comments
  • [NOTICE] Failed To Fetch OpenBenchmarking.org Repository Data: pts, and system

    [NOTICE] Failed To Fetch OpenBenchmarking.org Repository Data: pts, and system

    [root@ip-10-103-137-85 phoronix-test-suite]# /usr/bin/phoronix-test-suite

    [NOTICE] Failed To Fetch OpenBenchmarking.org Repository Data: pts

    [NOTICE] Failed To Fetch OpenBenchmarking.org Repository Data: system

    Phoronix Test Suite v7.8.0m2 (Folldal)

    The Phoronix Test Suite is the most comprehensive testing and benchmarking platform available for Linux, Solaris, OS X, and BSD operating systems. The Phoronix Test Suite allows for carrying out tests in a fully automated manner from test installation to execution and reporting. All tests are meant to be easily reproducible, easy-to-use, and support fully automated execution. The Phoronix Test Suite is open-source under the GNU GPLv3 license and is developed by Phoronix Media in cooperation with partners.

    View the included PDF / HTML documentation or visit http://www.phoronix-test-suite.com/ for full details.

    TEST INSTALLATION

    force-install         [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    install               [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    install-dependencies  [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    make-download-cache
    remove-installed-test [Test]
    

    TESTING

    auto-compare
    benchmark          [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    estimate-run-time  [Test | Suite | OpenBenchmarking ID | Test Result]
    finish-run         [Test Result]
    run                [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    run-random-tests
    run-tests-in-suite
    stress-run         [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    

    BATCH TESTING

    batch-benchmark   [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    batch-install     [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    batch-run         [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    batch-setup
    default-benchmark [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    default-run       [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    internal-run      [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    

    OPENBENCHMARKING.ORG

    clone-result                  [OpenBenchmarking ID]  ...
    list-recommended-tests
    make-openbenchmarking-cache
    openbenchmarking-changes
    openbenchmarking-launcher
    openbenchmarking-login
    openbenchmarking-refresh
    openbenchmarking-repositories
    upload-result                 [Test Result]
    upload-test-profile
    upload-test-suite
    

    SYSTEM

    diagnostics
    interactive
    php-conf
    system-info
    system-sensors
    

    INFORMATION

    info                          [Test | Suite | OpenBenchmarking ID | Test Result]
    list-available-suites
    list-available-tests
    list-available-virtual-suites
    list-installed-dependencies
    list-installed-suites
    list-installed-tests
    list-missing-dependencies
    list-not-installed-tests
    list-possible-dependencies
    list-saved-results
    list-test-usage
    list-unsupported-tests
    search
    

    ASSET CREATION

    build-suite
    debug-benchmark           [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    debug-install             [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    debug-result-parser       [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    debug-test-download-links [Test | Suite | OpenBenchmarking ID | Test Result]
    download-test-files       [Test | Suite | OpenBenchmarking ID | Test Result]  ...
    result-file-to-suite      [Test Result]
    validate-result-file
    validate-test-profile
    validate-test-suite
    

    RESULT MANAGEMENT

    analyze-all-runs                 [Test Result]
    auto-sort-result-file            [Test Result]
    edit-result-file                 [Test Result]
    extract-from-result-file         [Test Result]
    merge-results                    [Test Result]  ...
    refresh-graphs                   [Test Result]
    remove-from-result-file          [Test Result]
    remove-result                    [Test Result]
    rename-identifier-in-result-file [Test Result]
    rename-result-file               [Test Result]
    reorder-result-file              [Test Result]
    result-file-to-csv               [Test Result]
    result-file-to-json              [Test Result]
    result-file-to-pdf               [Test Result]
    result-file-to-text              [Test Result]
    show-result                      [Test Result]
    winners-and-losers               [Test Result]
    

    OTHER

    debug-dependency-handler
    debug-render-test
    debug-self-test
    help
    version
    

    MODULES

    auto-load-module
    list-modules
    module-info      [Phoronix Test Suite Module]
    module-setup     [Phoronix Test Suite Module]
    test-module      [Phoronix Test Suite Module]
    unload-module
    

    USER CONFIGURATION

    enterprise-setup
    network-info
    network-setup
    user-config-reset
    user-config-set
    

    WEB / GUI SUPPORT

    gui
    start-remote-gui-server
    start-ws-server
    

    PHOROMATIC

    start-phoromatic-server
    

    Not sure what is the impact of not being able to Fetch OpenBenchmarking.org Repository Data. I am behind a proxy, but i have exported my proxy environment variables export http_proxy=http://my proxy:80 export https_proxy=http://my proxy:80

    opened by kamal2222ahmed 31
  • set don't down the lastest package from openbenchmarking

    set don't down the lastest package from openbenchmarking

    Hi, I want to update the pts.index and keep the old package, I set as follows, but it doesnt' work, how? ` /var/lib/phoronix-test-suite/pts-core/static/user-config-defaults.xml

                        <AnonymousUsageReporting>TRUE</AnonymousUsageReporting>
    
                        <IndexCacheTTL>0</IndexCacheTTL>
    
                        <AlwaysUploadSystemLogs>FALSE</AlwaysUploadSystemLogs>
    
                </OpenBenchmarking>`
    

    Thanks

    opened by ayiyaliing 28
  • multiple clients not being detected by phoromatic server

    multiple clients not being detected by phoromatic server

    So for some reason, when I run the phoromatic server, the clients that try to connect to it are only being detected under 1 client only. I believe I was able to get it to work with an older version of the phoromatic tool (not quite sure if it was 6.2.1 or 6.2.2) however, in 6.6.0 it seems to fail to detect the multiple clients that are connecting to it, and interprets the multiple clients as 1 client.

    opened by kkebb 21
  • asmfish test fails to install on aarch64

    asmfish test fails to install on aarch64

    ./phoronix-test-suite run asmfish ... Installation Size: 5 MB Installing Test @ 14:02:22 The installer exited with a non-zero exit status. ERROR: ./asmFish/fasm: 1: ./asmFish/fasm: Syntax error: "(" unexpected LOG: ~/.phoronix-test-suite/installed-tests/pts/asmfish-1.0.1/install-failed.log

    opened by swalk-cavium 15
  • Is the randomly generated hash configurable?

    Is the randomly generated hash configurable?

    Hello again,

    I noticed that the hash CODE gets randomly generated every time we start up a new phoromatic server, is there a way to configure that CODE so that it's consistent every time we bring up the server? This would be really helpful in the use case of orchestration with docker where the same code can be used by the clients when they need to connect to the server and helps avoid writing a script to extract the code from the server and push it to the clients.

    opened by kkebb 14
  • Input file for Incompact3d

    Input file for Incompact3d

    The input file for Incompact3d (examples/Cylinder/input.i3d) performs 90'000 time steps (parameter ilast) and writes snapshot + checkpoint every 100 iterations (parameters icheckpoint and ioutput). Thus, the overall performance is likely limited by IO on high-end CPU.

    https://github.com/phoronix-test-suite/phoronix-test-suite/blob/b18bd6cb67457e9532d2eec2a41256a00fd2d764/ob-cache/test-profiles/pts/incompact3d-1.0.0/test-definition.xml#L31

    If keeping the current setup, it would be relevant to have the parameters icheckpoint and ioutput larger than the parameter ilast to reduce the amount of IO.

    opened by mathrack 13
  • I can't run phoronix-test-suite in my arm64 device.

    I can't run phoronix-test-suite in my arm64 device.

    Hi,all

    • my device info
    os: ubuntu16.04
    php: PHP 7.4.4 (cli)
    phoronix-test-suite :  form the github download.
    

    when I run the commandphoronix-test-suite , I can get any message. when I try to debug, it can't run in the filephoronix-test-suite/pts-core/phoronix-test-suite.php the code is

            if(pts_client::read_env('PTS_IGNORE_MODULES') == false)
            {
        
                    pts_client::module_framework_init(); // Initialize the PTS module system
                    
            }
    
    

    Thanks for your time.

    opened by WangFengtu1996 13
  • sudo phoronix-test-suite benchmark <GRAPHICAL TEST> fails

    sudo phoronix-test-suite benchmark fails

    On Ubuntu 17.04, running a graphical benchmark with sudo will fail. I tested on both Intel and NVIDIA machines. I tested with unigine-tropics, unigine-heaven, and openareana. This is with a fresh install of 17.04 and current updates. This is with both sudo phoronix-test-suite benchmark unigine-tropics and using Phoromatic with sudo systemctl start phoromatic-client and sending a benchmark to the system.

    Running all of these benchmarks in user spaces works as expected. As I'm setting up a Phoromatic client/server setup with phoromatic-client being enabled with systemctl, I'd like to get the tests to run as root.

    The output from running the command above:

    Unigine Tropics 1.3:
        pts/unigine-tropics-1.6.3 [Resolution: 800 x 600 - Mode: Fullscreen]
        Test 1 of 1
        Estimated Trial Run Count:    3
        Estimated Time To Completion: 11 Minutes [11:26 MDT]
            Started Run 1 @ 11:16:01
            The test run did not produce a result.
            Started Run 2 @ 11:16:02
            The test run did not produce a result.
            Started Run 3 @ 11:16:03
            The test run did not produce a result.
            E: Unigine fatal error
    

    And the root user debug-run log:

    cat /var/lib/phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/unigine-tropics-1.6.3-1502817824-1.log
    No protocol specified
    Engine::init(): clear video settings for "Unknown GPU"
    No protocol specified
    
    Unigine fatal error
    Engine::init(): clear video settings for "Unknown GPU"
    AppWindow::AppWindow(): can't open display
    Loading "/var/lib/phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/tropics/bin/../data/unigine.cfg"...
    Loading "libGL.so.1"...
    Shutdown
    

    And the normal user debug-run:

    cat /home/james/.phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/unigine-tropics-1.6.3-1502818006-1.log
    ATTENTION: default value of option vblank_mode overridden by environment.
    Engine::init(): clear video settings for "Mesa DRI Intel(R) Haswell Desktop x86/MMX/SSE2 3.0 Mesa 17.0.7"
    ATTENTION: default value of option vblank_mode overridden by environment.
    GLRender::GLRender(): Unknown GPU
    RenderPostProcess::set_post_textures(): can't find "color_0" texture in "post_blur_radial" material
    Loading "/home/james/.phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/tropics/bin/../data/unigine.cfg"...
    Loading "libGL.so.1"...
    Set 800x600 fullscreen video mode
    Set 1.00 gamma value
    Unigine engine http://unigine.com/
    Binary: Linux 32bit GCC 4.3.2 Release May 20 2010
    App path:  /home/james/.phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/tropics/bin/
    Data path: /home/james/.phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3/tropics/data/
    Save path: /home/james/.phoronix-test-suite/installed-tests/pts/unigine-tropics-1.6.3//.Unigine Tropics/
    
    ---- System ----
    System: Linux 4.10.0-32-generic x86_64
    CPU: Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz 3600MHz MMX SSE SSE2 SSE3 SSSE3 SSE41 SSE42 HTT
    GPU: Mesa DRI Intel(R) Haswell Desktop x86/MMX/SSE2 3.0 Mesa 17.0.7
    System memory: 15917 Mb
    Video memory:  256 Mb
    
    ---- MathLib ----
    Set SSE3 simd processor
    
    ---- Sound ----
    NULL
    
    ---- Render ----
    OpenGL vendor:   Intel Open Source Technology Center
    OpenGL renderer: Mesa DRI Intel(R) Haswell Desktop x86/MMX/SSE2
    OpenGL version:  3.0 Mesa 17.0.7
    <-- Truncated -->
    Shading language:      1.30
    Maximum texture size:  16384
    Maximum texture units: 192
    Maximum draw buffers:  8
    
    ---- Physics ----
    Physics: Multi-threaded
    
    ---- Interpreter ----
    Version: 2.31
    
    Loading "tropics/unigine.cpp" 53ms
    Loading "demos/tropics/locale/unigine.en" dictionary
    Loading "core/materials/unigine_post.mat" 12 materials 12 shaders 0ms
    <-- Truncated -->
    Loading "core/materials/unigine_decals.mat" 1 material 69 shaders 3ms
    Loading "core/properties/unigine.prop" 2 properties 0ms
    Unigine~# world_load tropics
    Loading "tropics.cpp" 131ms
    Loading "demos/tropics/tropics.mat" 40 materials 443ms
    Loading "tropics.world" 6986ms
    Unigine~# render_hdr 1 && render_srgb 0 && render_restart
    Release
    Phoronix running
    Unigine~# render_stereo 0 && render_restart
    Unigine~# render_dof 1 && render_restart
    Unigine~# render_dof 0 && render_restart
    Phoronix finished
    Time:	201.798
    Frames:	8980
    FPS:	44.4999
    Unigine~# quit
    Close "libGL.so.1"
    Memory usage: 128b
    Allocations:  2
    Shutdown
    

    If I run the same sudo command with the version packaged with Ubuntu 17.04, it succeeds (5.2.1-1ubuntu2). I also tested with the version 5.8 .deb, which is the oldest version that installs without dependency issues in 17.04, version 6.0, and 7.0, and they have the same issue.

    Can you help?

    Also, a big thank you from System76. We love your work, software, and articles. Much appreciated!

    opened by Xeboc 13
  • Facing issue in installation of test ttsiod-renderer in aarch64 platform

    Facing issue in installation of test ttsiod-renderer in aarch64 platform

    Facing below issue in aarch64 platform: phoronix-test-suite install ttsiod-renderer

    Phoronix Test Suite v8.6.0m0

    To Install:    pts/ttsiod-renderer-1.7.0
    
    Determining File Requirements ............................................................................................................
    Searching Download Caches ................................................................................................................
    
    1 Test To Install
        37MB Of Disk Space Is Needed
    
    pts/ttsiod-renderer-1.7.0:
        Test Installation 1 of 1
        1 File Needed [4.1 MB / 1 Minute]
        File Found: renderer-2.3b.zip                                                                                                 [4.10MB]
        Installation Size: 36.2 MB
        Installing Test @ 16:17:57
            The installer exited with a non-zero exit status.
            ERROR: lto-wrapper: fatal error: /usr/bin/g++ returned 1 exit status
            LOG: /var/lib/phoronix-test-suite/installed-tests/pts/ttsiod-renderer-1.7.0/install-failed.log
    

    Checked install-failed.log file test is failing due to below issue: CXXLD renderer ScanConverter.h: In member function 'InnerLoop': ScanConverter.h:117:5: internal compiler error: Segmentation fault } ^ Please submit a full bug report, with preprocessed source if appropriate. See file:///usr/share/doc/gcc-7/README.Bugs for instructions. lto-wrapper: fatal error: g++ returned 1 exit status compilation terminated. /usr/bin/ld: error: lto-wrapper failed collect2: error: ld returned 1 exit status

    Please guide me on solving this issue. Thanks in advance.

    opened by ossdev07 12
  • result-file-to-pdf is broken on Centos 6 / PHP 5.3.3 in v6.2.2

    result-file-to-pdf is broken on Centos 6 / PHP 5.3.3 in v6.2.2

    When trying to convert a result to PDF I get the error: "PHP Fatal error: Cannot create references to elements of a temporary array expression in /usr/share/phoronix-test-suite/pts-core/objects/pts_result_file_output.php on line 237"

    php -v PHP 5.3.3 (cli) (built: Feb 9 2016 10:36:17) Copyright (c) 1997-2010 The PHP Group Zend Engine v2.3.0, Copyright (c) 1998-2010 Zend Technologies

    Phoronix Test Suite v6.2.2 (Gamvik)

    CentOS 6.7 with latest updates

    phoronix-test-suite result-file-to-pdf 2016-04-25-1757 ... PHP Fatal error: Cannot create references to elements of a temporary array expression in /usr/share/phoronix-test-suite/pts-core/objects/pts_result_file_output.php on line 237

    opened by Elfe 12
  • Result viewer default message is not helpful

    Result viewer default message is not helpful

    Running version v9.2.0m2 (from git) and trying to view one of the results in a browser. (phoronix-test-suite show-result smalltestresults)

    The default message in /pts-core/static/dynamic-result-viewer/index.php Line #65 isn't all that helpful.

    echo '<p>You must configure result_viewer_config.php!</p>';
    

    It should contain information on HOW to fix this issue (or at the very least some basic information / pointer for the next step on how to proceed.)

    		echo '<p>You must configure result_viewer_config.php!</p>';
    		echo '<p>Is "sqlite3" installed?</p>';
    		echo '<p>You can view the PHP configuration via:</p><pre style="background-color:#F0F0F0">    phoronix-test-suite php-conf</pre>';
    		echo '<p>You will probably want to configure files:</p>';
    		echo '<pre style="background-color:#F0F0F0">    ~/.phoronix-test-suite/user-config.xml</pre>';
    		echo '<p>and:</p>';
    		echo '<pre style="background-color:#F0F0F0">    ~/.phoronix-test-suite/graph-config.json</pre>';
    		echo '<p><b>NOTE:</b> You can <span style="background-color:#FFC0C0"><b>NOT</b></span> simply copy <span style="background-color:#FFC0C0">result_viewer_config.php.configure</span> to <span style="background-color:#C0FFC0">result_viewer_config.php</span> via:</p>';
    		echo '<pre style="background-color:#F8F8F8">    cd /usr/share/phoronix-test-suite/pts-core/static/dynamic-result-viewer/;';
    		echo ' sudo cp result_viewer_config.php.configure result_viewer_config.php</pre>';
    

    Even with the above I'm still not sure on what exactly needs to be done to configure this? (Searching the HTML manual and PDF manual for result_viewer_config shows no results.)

    Note.1: I don't see an option to restart, or stop, the result-viewer?

    e.g.

    $ phoronix-test-suite start-result-viewer
    
        [PROBLEM] The result viewer is already running. 
    

    Note.2: As a temporary work-around using result-file-to-pdf option instead.

    opened by Michaelangel007 11
  • pts/ffmpeg-3.0.0 fails in Fedora 37

    pts/ffmpeg-3.0.0 fails in Fedora 37

    I am getting the following error when running this test

    FFmpeg 5.1.2:
        pts/ffmpeg-3.0.0 [Encoder: libx265 - Scenario: Video On Demand]
        Test 8 of 8
        Estimated Trial Run Count:    3                     
        Estimated Time To Completion: 8 Minutes [16:06 MST] 
            Started Run 1 @ 15:58:44
            The test quit with a non-zero exit status.
            Started Run 2 @ 15:58:48
            The test quit with a non-zero exit status.
            Started Run 3 @ 15:58:52
            The test quit with a non-zero exit status.
            E: SyntaxError: Missing parentheses in call to 'print'. Did you mean print(...)?
    

    I have searched google and have not seen a reference to this error.

    opened by JR1994 0
  • Update test issues on phoronix

    Update test issues on phoronix

    **Hello, i have problems loading tests on phoronix , I am told that the file is too large ( 1.4 mb) . Is there a way to do that ? Thank you sottr.zip **

    opened by Rama95YT 0
  • Php error for installing tungsten

    Php error for installing tungsten

    I tried install tungsten. Before 2 month, I succeed to install tungsten and also fuzzing it with afl But, now I cannot install tungsten. I tried to change php version to 7 and 8. How can I install tungsten? Is it changed tungsten for 2month

    image
    opened by chanmin0723 0
  • node-express-loadtest not version locked

    node-express-loadtest not version locked

    It seems that the npm packages are not version locked, and newer versions may affect the performance of the test. I was running this on an Intel 13th gen 13600KF and got a much higher score than the recorda in openbenchmarking, so I suspect that this is due to version differences.

    opened by pca006132 0
  • system-info detects X11 Server when none exists, and no graphics benchmark can be installed

    system-info detects X11 Server when none exists, and no graphics benchmark can be installed

    I have Gnome 43.1 running on top of wayland, no X11 installed and no XWayland.

    system-info says the display server is X Server, and when trying to install gputest, gravitymark or vkmark I get the following error: No display server was found, skipping pts/<whatever test>

    opened by Motherboard 0
  • CPU frequency (cpu.freq) not recorded even after explicitly setting MONITOR=...

    CPU frequency (cpu.freq) not recorded even after explicitly setting MONITOR=...

    Phoronix Test Suite version: 10.8.4.

    Not sure if this has already been reported in another issue, but in my system, the CPU frequency is not recorded despite setting MONITOR=cpu.freq.

    This is how I start the stress-run:

    TOTAL_LOOP_TIME="10" \ 
    TEST_RESULTS_NAME="$(openssl rand -hex 12)" \ 
    TEST_RESULTS_IDENTIFIER="$(openssl rand -hex 12)" \ 
    PTS_CONCURRENT_TEST_RUNS="15" \ 
    MONITOR=cpu.temp,gpu.temp,cpu.usage,gpu.usage,cpu.freq,gpu.freq,memory.usage,sys.temp \ 
    phoronix-test-suite stress-run compress-7zip build-mplayer encode-flac graphics-magick build-php
    

    A small portion of the initial output:

    
    STRESS-RUN ENVIRONMENT VARIABLES:
    
    PTS_CONCURRENT_TEST_RUNS set; running 15 tests concurrently.
    
    
    TOTAL_LOOP_TIME set; running tests for 10 minutes
    
    
    TEST_RESULTS_NAME set; saving the result sensor data as b6dfb1240a59bc2e9ebba504.
    
    
    TEST_RESULTS_IDENTIFIER set; test identifier is 91c4acd2692c21f835c8e78e.
    
    
    
    GraphicsMagick 1.3.38:
        pts/graphics-magick-2.1.0
        Processor Test Configuration
            1: HWB Color Space
            2: Noise-Gaussian
            3: Enhanced
            4: Resizing
            5: Rotate
            6: Sharpen
            7: Swirl
            8: Test All Options
            ** Multiple items can be selected, delimit by a comma. **
            Operation: 8
    
    SYSTEM INFORMATION: 
    
    <removed to keep this concise>
    
    Sensors To Be Logged:
       - CPU Frequency (CPU0)
       - CPU Temperature
       - CPU Usage (Summary)
       - GPU Frequency
       - GPU Temperature
       - GPU Usage
       - Memory Usage
       - System Temperature
    

    As you can see, CPU Frequency is shown in the output. Though, I am not sure why it is writing only for CPU0 and not for the seven others.

    The composite.xml file in the results directory has no data for the cpu.freq: https://pastebin.com/0AjbcSGK

    opened by WrichikBasu 1
Releases(v10.8.4)
  • v10.8.4(Jul 3, 2022)

    Phoronix Test Suite 10.8.4 3 July 2022

    pts-core: Allow sub-folders within PTS_EXTRA_SYSTEM_LOGS_DIR when uploading to Phoromatic server pts-core: Fix TOTAL_LOOP_TIME handling pts-core: openSUSE external dependency handling fixes phodevi: Support for reporting video BIOS version phodevi: Budgie desktop version detection phodevi: Avoid deprecated wmic usage on Windows phoromatic: Input sanitization updates in the result viewer

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.8.4.tar.gz(4.05 MB)
    phoronix-test-suite_10.8.4_all.deb(2.24 MB)
  • v10.8.3(Apr 24, 2022)

  • v10.8.2(Feb 13, 2022)

    Point release primarily for Phoromatic Server input validation/sanitization updates, other small fixes/improvements.

    Phoronix Test Suite 10.8.2 13 February 2022

    pts-core: Arch Linux external dependency updates pts-core: Workaround/fix PHP 5.4 usage with RHEL7-based distributions pts-core: Convert compiler / multicore / single-threaded test suites into virtual test suites since their properties can be auto-determined based on OB metadata pts-core: Add virtual test suites for "riscv" and "aarch64" to make it easy to show tests that run successfully on RISC-V and 64-bit Arm phodevi: Add Arm Cortex-X1C detection phodevi: CPU temperature reporting for additional SoCs such as the Raspberry Pi 400 phoromatic: Additional input sanitization and validation improvements

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.8.2.tar.gz(3.82 MB)
    phoronix-test-suite_10.8.2_all.deb(2.12 MB)
  • v10.8.1(Jan 23, 2022)

    Point release primarily for Phoromatic Server input sanitization updates, HTTPS Download Cache Server API support, OpenBenchmarking.org caching improvements.

    Phoronix Test Suite 10.8.1 23 January 2022

    pts-core: Log external dependencies attempted to be installed to phoronix-test-suite-dependencies.log pts-core: Allow PTS_DISPLAY_MODE to override other display mode preferences (e.g. short mode requested inline) pts-core: Optional Download Cache Server interface support for HTTPS pts-core: Support for archiving test profile change-logs locally rather than having to always query OpenBenchmarking.org server pts-core: Allow caching of some OpenBenchmarking.org overview metrics locally for reducing repetitive OpenBenchmarking.org load/queries pts-core: Allow displaying more overview metrics from OpenBenchmarking.org in the web view and info sub-command now that it's cached pts-core: Make rendering of Perf Per Core/Thread/Clock/RAM opt-in from the result viewer phoromatic: Allow binary log file uploads by default when Phoromatic Server is 10.8+ phoromatic: Input sanitization updates for Phoromatic Server and other security improvements phoromatic: Move "Create A Test Profile" page behind an opt-in rootadmin Phoromatic Server option phoromatic: Log update script output phodevi: GPU vRAM usage reporting for modern AMDGPU DRM versions phodevi: Use "-NoProfile" with powershell for possible performance benefits phodevi: Avoid including kernel version in Mesa/OpenGL string phodevi: Arm Neoverse-V1 / Cortex-X2 identification

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.8.1.tar.gz(3.75 MB)
    phoronix-test-suite_10.8.1_all.deb(2.08 MB)
  • v10.8.0(Dec 25, 2021)

    Phoronix Test Suite 10.8.0 25 December 2021

    pts-core: Remaining PHP 8.1 warnings/fixes addressed pts-core: Various macOS 12 warning fixes pts-core: Allow using OUTPUT_DIR / OUTPUT_FILE environment variables to control result-file-to* sub-commands pts-core: Improved JSON output generation, add option to the result viewer pts-core: Add result-file-to-html sub-command and simple inline HTML result output option from result viewer pts-core: Allow sorting results by test date/time pts-core: Add TEST_EXECUTION_SORT environment variable to allow sorting test run order in more ways pts-core: Consolidate/centralize handling of environment variable options to pts_env pts-core: Add remove-incomplete-results-from-result-file helper command to remove results with incomplete or missing data pts-core: Add REMOVE_TESTS_ON_COMPLETION environment variable as another way to have tests auto-uninstall/remove after running pts-core: Improved test installation / test run-time error reporting and detection pts-core: Allow recording/archiving install and runtime errors within installation metadata pts-core: Add list-failed-installs sub-command for showing tests that failed to install pts-core: Add list-test-errors sub-command for showing test run-time errors pts-core: Add variables sub-command for showing environment variable descriptions and what is set pts-core: Dynamic detection of Windows download folder location pts-core: Improved Zip handling on Windows phodevi: Add detection for Arm Cortex-A710 and Neoverse-N2 cores phodevi: Add detection for AMD Zen 4 cores phodevi: Add detection for Intel Raptor Lake phodevi: Allow better detecting model number on Windows/Linux for Dell and Apple laptops phodevi: CPU temperature monitoring on Windows phodevi: Show "energy_performance_preference" CPU frequency scaling value where relevant phodevi: Linux CPUFreq EPP reporting support phodevi: Report Windows 10+ security features phodevi: Add PHODEVI_SANITIZE environment variable for those wanting to strip out certain hardware/software strings from system information cleanup: Add module that can auto uninstall tests not run in a given amount of time phoromatic: Allow relevant PTS environment variables to be exposed for setting by Phoromatic Server for benchmarks/schedules as "advanced options" area phoromatic: Use the unified result viewer code for presenting result graphs and other result page data phoromatic: Make use of shared/common result viewer code to allow adding/editing annotations, editing result file title/description, and deleting individual results from within the result viewer phoromatic: Efficiency improvement for when viewing result with just one result file phoromatic: Allow Phoromatic client to connect to Phoromatic HTTPS servers phoromatic: Allow optionally uploading test install/run logs to the Phoromatic Server phoromatic: Alow "Run A Benchmark" area to execute conventional PTS/system test suites phoromatic: Allow test schedules page to add suites to a schedule rather than only adding just test profiles phoromatic: Add option to settings page to always un-install/remove tests after execution for all Phoromatic testing phoromatic: Allow environment variables to also be set on a global basis from the Phoromatic Server Settings page phoromatic: Allow test installation metadata to be submitted to Phoromatic Server so from systems area can show currently installed tests and any errors phoromatic: Opt-in (settings page) support for streaming in-progress benchmark results to the Phoromatic Server between test runs so results can be viewed from the server as they are completed phoromatic: Unifying more result viewer and Phoromatic common display code

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.8.0.tar.gz(2.20 MB)
    phoronix-test-suite_10.8.0_all.deb(1.10 MB)
  • v10.6.1(Oct 10, 2021)

    Phoronix Test Suite 10.6.1 10 October 2021

    pts-core: Allow reporting test run errors inline / as part of the result file XML with null/empty results pts-core: Remove the old, long deprecated static/JavaScript PTS result viewer that hasn't been used except for rare fallbacks since PTS pre-9.0 pts-core: PHP 8.1 deprecation warning/error fixes pts-core: Support launching PHP web server with PHP_CLI_SERVER_WORKERS to allow multiple workers/threads pts-core: Windows batch file handling test execution fix pts-core: Allow running merge-results when pointing to specific XML files outside of standard paths pts-core: Various minor fixes phoromatic: Fix possible case of local test profile download issues from Phoromatic Server phoromatic: Warn when lacking database write access for Phoromatic Server phoromatic: Support (opt-in) handling of non-text file log files phoromatic: Allow uploading of system logs after initial upload of result XML to deal with HTTP size limitations and other factors with large logs phoromatic: Use the unified/common log viewer for viewing logs from the Phoromatic web interface phoromatic: Tweaking of the Phoromatic CSS style to bring it more uniform with OpenBenchmarking.org / PTS Local Result Viewer / first update in ~6 years... phodevi: Improve detection of new Intel oneAPI DPC++/C++ Compiler phodevi: ACPI Platform Profile reporting support on Linux phodevi: Support reporting NVIDIA BAR1 total memory / Radeon vRAM visible memory (Resizable BAR / ReBAR status)

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.6.1.tar.gz(2.14 MB)
    phoronix-test-suite_10.6.1_all.deb(1.09 MB)
  • v10.4.0(May 16, 2021)

    Phoronix Test Suite 10.4.0 16 May 2021

    pts-core: Ubuntu 21.04 dependency updates for changed/removed package names pts-core: Add "auto-resolution-wide" option pts-core: Add $CPU_THREADS_PER_CORE helper pts-core: Allow perf-per-dollar-per-hour in the result viewer, extending perf-per-dollar HTML helper pts-core: Add PTS_EXTRA_SYSTEM_LOGS_DIR environment variable to allow pointing to directory of extra system log files pts-core: Add RepositoryURL option for test profiles phodevi: Intel Linux graphics string format improvement phoromatic: Treat set context scripts as a file rather than executing it as a buffer phoromatic: Allow passing Phodevi system properties to Phoromatic Server phodevi: Add some new properties, port some pts_network info to phodevi interfaces system_monitor: Adjust perf-per precision

    Phoronix Test Suite 10.4.0 Milestone 1 17 March 2021

    pts-core: Optimize out sorting percentile values array excess times pts-core: Optimization to avoid re-parsing test profile definition multiple times pts-core: Optimization to avoid re-parsing installed test metadata multiple times pts-core: Allow longer HTTP timeouts on OpenBenchmarking.org result uploads if needed pts-core: Allow sorting runs within a result file from within the result viewer web interface

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.4.0.tar.gz(2.09 MB)
    phoronix-test-suite_10.4.0_all.deb(1.11 MB)
  • v10.4.0m1(Mar 17, 2021)

    Phoronix Test Suite 10.4.0 Milestone 1 17 March 2021

    pts-core: Optimize out sorting percentile values array excess times pts-core: Optimization to avoid re-parsing test profile definition multiple times pts-core: Optimization to avoid re-parsing installed test metadata multiple times pts-core: Allow longer HTTP timeouts on OpenBenchmarking.org result uploads if needed pts-core: Allow sorting runs within a result file from within the result viewer web interface

    Source code(tar.gz)
    Source code(zip)
  • v10.2.2(Feb 17, 2021)

    Phoronix Test Suite 10.2.2 17 February 2021

    pts-core: Add helper text when hitting a download with no working mirrors pts-core: Various external dependency updates pts-core: Add enable-repo sub-command for more easily enabling new OpenBenchmarking.org repos pts-core: Result viewer fix for the limit drop down menu potentially not being activated in some cases pts-core: Allow renaming runs within the result viewer phoromatic: Ensure pcntl_signal is present before starting Phoromatic Server phoromatic: PHP 8 compatibility fixes phodevi: Fix display driver name potentially being reported inaccurate for some obscure graphics cards / driver configurations phodevi: Export current GPU graphics card PCI device ID (GPU_DEVICE_ID) for some games/tests relying on it for configuration

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.2.2.tar.gz(1.91 MB)
    phoronix-test-suite_10.2.2_all.deb(1.04 MB)
  • v10.2.1(Feb 1, 2021)

    Phoronix Test Suite 10.2.1 1 February 2021

    pts-core: Add "InstallRequiresInternet" option for test profiles that is more narrow (install time only) than the existing "RequiresInternet" pts-core: Add check-tests sub-command pts-core: Fix possible crash on PDF output pts-core: Various small fixes and tweaks pts-core: Fix PHP8 + cURL download error pts_Graph: A number of minor SVG standards compliance updates phodevi: Log Transparent Huge Pages setting as part of system details phodevi: Don't bother parsing the X.org log if it grows too big

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.2.1.tar.gz(1.90 MB)
    phoronix-test-suite_10.2.1_all.deb(1.03 MB)
  • v10.2.0(Jan 4, 2021)

    Phoronix Test Suite 10.2

    Release Date: 5 January 2021 | Codename: Harstad

    • Significantly faster Phoromatic Web UI performance
    • Improved support for macOS 11 Big Sur, Apple Silicon (Apple M1)
    • Improved tracking of per-test/configuration run-time time requirements, improved test run-time estimation
    • Support for reporting broken download mirrors to OpenBenchmarking.org
    • BSD support updates (FreeBSD, DragonFlyBSD, OpenBSD, NetBSD)
    • Full PHP 8.0 compatibility
    • Various Phodevi software/hardware detection reporting improvements
    • New modules: turbostat

    Phoronix Test Suite 10.2.0 5 January 2020

    pts-core: PHP8 detection improvements pts-core: For estimated run time, avoid over-calculating time if test has no options but multiple outputs pts-core: Updated (Open)Mandriva external dependencies pts_Graph: Minor enhancements phodevi: Add support for reporting ACPI Platform Profile and INT340x Workload Hint

    Phoronix Test Suite 10.2.0 Milestone 3 21 December 2020

    pts-core: Add debug-unhandled-dependencies option pts-core: Default to 2.5% std dev threshold default on new installs pts-core: BSD external dependency updates pts-core: Various refinements to the text user interface pts-core: When a test profile hits a failed download / broken mirror, report that URL to OpenBenchmarking.org phodevi: Don't restore the Phodevi cache if the /etc/machine-id changed (or /etc/hostname as fallback)

    Phoronix Test Suite 10.2.0 Milestone 2 6 December 2020

    pts-core: Transition to new JSON-based data format for managing test install metadata while maintaining backwards compatibility with prior XML format pts-core: Begin tracking test run-times per-hash (all configured test options) for more detailed time tracking and in turn time estimates on subsequent runs pts-core: Increase compression factor when uploading benchmark results pts-core: Last minute fixes for PHP 8.0 compatibility phodevi: Report if CPUFreq Boost enabled/disabled turbostat: Add TurboStat module to easily generate turbostat dumps on a per-test basis to log files phoromatic: Much faster web viewer performance especially with large databases

    Phoronix Test Suite 10.2.0 Milestone 1 21 November 2020

    pts-core: Log lock_stat, config.gz, dmidecode to system logs pts-core: Only show Apple options when running on macOS pts-core: Add extra safeguard around FORCE_TIMES_TO_RUN for disabling dynamic run count ob_auto_compare: Intelligently choose more relevant reference results phodevi: macOS CPU temperature monitoring support phodevi: Support for reading WattsUp Pro power meter data directly without utility using WATTS_UP_METER= phodevi: Report Google Compute Engine machine type as part of motherboard string phodevi: Add dumpe2fs to system logs when running on EXT4 and root phodevi: Add block size reporting phodevi: CPU power reporting for Ampere Altra phodevi: Various Ampere Altra hardware detection/reporting improvements phodevi: Support reading CPU package power consumption on macOS using powermetrics

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.2.0.tar.gz(1.85 MB)
    phoronix-test-suite_10.2.0_all.deb(1.01 MB)
  • v10.2.0m3(Dec 22, 2020)

    Phoronix Test Suite 10.2.0 Milestone 3 21 December 2020

    pts-core: Add debug-unhandled-dependencies option pts-core: Default to 2.5% std dev threshold default on new installs pts-core: BSD external dependency updates pts-core: Various refinements to the text user interface pts-core: When a test profile hits a failed download / broken mirror, report that URL to OpenBenchmarking.org phodevi: Don't restore the Phodevi cache if the /etc/machine-id changed (or /etc/hostname as fallback)

    Source code(tar.gz)
    Source code(zip)
  • v10.2.0m2(Dec 6, 2020)

    Phoronix Test Suite 10.2.0 Milestone 2 6 December 2020

    pts-core: Transition to new JSON-based data format for managing test install metadata while maintaining backwards compatibility with prior XML format pts-core: Begin tracking test run-times per-hash (all configured test options) for more detailed time tracking and in turn time estimates on subsequent runs pts-core: Increase compression factor when uploading benchmark results pts-core: Last minute fixes for PHP 8.0 compatibility phodevi: Report if CPUFreq Boost enabled/disabled turbostat: Add TurboStat module to easily generate turbostat dumps on a per-test basis to log files phoromatic: Much faster web viewer performance especially with large databases

    Source code(tar.gz)
    Source code(zip)
  • v10.2.0m1(Nov 21, 2020)

    Phoronix Test Suite 10.2.0 Milestone 1 21 November 2020

    pts-core: Log lock_stat, config.gz, dmidecode to system logs pts-core: Only show Apple options when running on macOS pts-core: Add extra safeguard around FORCE_TIMES_TO_RUN for disabling dynamic run count ob_auto_compare: Intelligently choose more relevant reference results phodevi: macOS CPU temperature monitoring support phodevi: Support for reading WattsUp Pro power meter data directly without utility using WATTS_UP_METER= phodevi: Report Google Compute Engine machine type as part of motherboard string phodevi: Add dumpe2fs to system logs when running on EXT4 and root phodevi: Add block size reporting phodevi: CPU power reporting for Ampere Altra phodevi: Various Ampere Altra hardware detection/reporting improvements phodevi: Support reading CPU package power consumption on macOS using powermetrics

    Source code(tar.gz)
    Source code(zip)
  • v10.0.1(Oct 21, 2020)

  • v10.0.0(Oct 13, 2020)

    Phoronix Test Suite 10.0

    Release Date: 13 October 2020 | Codename: Finnsnes

    • New version/overhaul of OpenBenchmarking.org
    • Various hardware/software detection improvements with Phodevi
    • New modules: flush_caches, test_timeout

    Phoronix Test Suite 10.0.0 13 October 2020

    pts-core: Ensure any post-run script is triggered still under halt-testing/skip-test conditions pts-core: Allow batch processing of performance per dollar metrics phodevi: Add Intel AMX presence detection phodevi: Add detection for Intel Alder Lake, Jasper Lake, Sapphire Rapids, and others phoromatic: Ensure Windows tests get displayed even if running the Phoromatic Server on Linux flush_caches: Add module to flush system caches between runs test_timeout: Add module to quit a test run if it exceeds a predefined time limit or 'auto' determination

    Phoronix Test Suite 10.0.0 Milestone 3 1 October 2020

    pts-core: Don't show Vulkan options if Vulkan support is known to be unavailable/broken pts-core: Add OptionSelect tag support within test suite definitions pts-core: Allow * wildcard match in FileCheck handling within external dependency XML pts-core: Add "OS" TestType pts-core: Various external dependency updates pts-core: Continued tweaking to the analytics engine phodevi: Add Neoverse N2, Cortex-X1 detection and other Arm CPU updates pts_Graph: Various improvements

    Phoronix Test Suite 10.0.0 Milestone 2 12 September 2020

    pts-core: Honor NO_COLOR environment variable for disabling terminal coloring pts-core: Allow launching just the result viewer from systemd (phoronix-result-server.service) pts-core: Result viewer UI tweaks pts-core: Minor fixes pts-core: Add RequiresRootInstall test profile option pts-core: Result file text output tweaks pts-core: More robust test result parsing in certain time formats

    Phoronix Test Suite 10.0.0 Milestone 1 19 August 2020

    pts-core: Add keep-results-in-result-file sub-command pts-core: Split the dynamic result viewer into its own embed class for result file handling to allow for easy re-use by OpenBenchmarking, Phoromatic, etc pts-core: Various changes for supporting the new OpenBenchmarking.org infrastructure pts_Graph: Add histogram type phodevi: CPU core name / family detection to friendly strings (OpenBenchmarking.org driven) phodevi: Report core name via system-info command phodevi: Various storage HDD/SSD detection reporting improvements phodevi: Ampere Altra detection phodevi: macOS/Apple hardware detection improvements

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-10.0.0.tar.gz(1.83 MB)
    phoronix-test-suite_10.0.0_all.deb(1023.17 KB)
  • v10.0.0m3(Oct 1, 2020)

    Phoronix Test Suite 10.0.0 Milestone 3 1 October 2020

    pts-core: Don't show Vulkan options if Vulkan support is known to be unavailable/broken pts-core: Add OptionSelect tag support within test suite definitions pts-core: Allow * wildcard match in FileCheck handling within external dependency XML pts-core: Add "OS" TestType pts-core: Various external dependency updates pts-core: Continued tweaking to the analytics engine phodevi: Add Neoverse N2, Cortex-X1 detection and other Arm CPU updates pts_Graph: Various improvements

    Source code(tar.gz)
    Source code(zip)
  • v10.0.0m2(Sep 13, 2020)

    Phoronix Test Suite 10.0.0 Milestone 2 12 September 2020

    pts-core: Honor NO_COLOR environment variable for disabling terminal coloring pts-core: Allow launching just the result viewer from systemd (phoronix-result-server.service) pts-core: Result viewer UI tweaks pts-core: Minor fixes pts-core: Add RequiresRootInstall test profile option pts-core: Result file text output tweaks pts-core: More robust test result parsing in certain time formats

    Source code(tar.gz)
    Source code(zip)
  • v10.0.0m1(Aug 20, 2020)

    Phoronix Test Suite 10.0.0 Milestone 1 19 August 2020

    pts-core: Add keep-results-in-result-file sub-command pts-core: Split the dynamic result viewer into its own embed class for result file handling to allow for easy re-use by OpenBenchmarking, Phoromatic, etc pts-core: Various changes for supporting the new OpenBenchmarking.org infrastructure pts_Graph: Add histogram type phodevi: CPU core name / family detection to friendly strings (OpenBenchmarking.org driven) phodevi: Report core name via system-info command phodevi: Various storage HDD/SSD detection reporting improvements phodevi: Ampere Altra detection phodevi: macOS/Apple hardware detection improvements

    Source code(tar.gz)
    Source code(zip)
  • v9.8.0(Jul 9, 2020)

    Phoronix Test Suite 9.8

    Release Date: 9 July 2020 | Codename: Nesodden

    • Improved handling of test install failure when a new minor test profile update is available tu automatically try
    • Improved detection of OpenCL and NVIDIA CUDA presence for avoiding some test option prompts when not supported
    • Estimated test install time reporting
    • Rewritten virtual test suite implementation
    • Early PHP 8.0 support
    • Linux AMD Energy driver support in Phodevi, NVIDIA GPU detection in WSL2, other cases

    Phoronix Test Suite 9.8.0 9 July 2020

    pts-core: Handling of cases where all options are unsupported (such as CUDA and OpenCL tests with no valid backends found) to avoid prompts pts-core: Be more liberal in allowing CUDA/OpenCL GPU compute tests to run fine without display server active pts-core: Fix for not filling test suites of contained tests in some select cases (sub-suites listing in results viewer) pts-core: Allow creating new virtual test suites that are not prefixed by a OB repository phodevi: NVIDIA GPU detection within WSL2 docker: Rewritten phoronix/pts Docker implementation based on Ubuntu 20.04 LTS

    Phoronix Test Suite 9.8.0 Milestone 2 24 June 2020

    pts-core: Add client side plumbing for estimated test install time from OpenBenchmarking.org pts-core: Add estimate-install-time sub-command, show estimated install time when installing a test pts-core: Improve web browser selection logic for result viewer pts-core: Add search field to the result viewer areas for limiting based on title/argument matching pts-core: Various minor fixes pts-core: Don't show OpenCL test options if no OpenCL drivers/adapters appear present phodevi: Fix for incorrect monitor count when parsing X.Org log phodevi: Warning fixes for latest WSL

    Phoronix Test Suite 9.8.0 Milestone 1 3 June 2020

    pts-core: When an install fails, try a newer minor version update to that test profile if available (fixes broken download mirrors, etc) pts-core: When a newer minor version of a test profile is installed and a requested (older) one is not, use the newer compatible version pts-core: Rewrite virtual test suite implementation pts-core: Add handler for ensuring reported system time is accurate, otherwise calculate current date/time using offsets pts-core: When scanning test suites on disk, ensure the latest test suite version is used pts-core: Add test-to-suite-map sub-command pts-core: Fix for loading the result viewer JavaScript / CSS when running on a Windows host pts-core: For tests requiring root but not run initially as root and using monitoring data, drop the first run to ensure sudo promot doesn't skew time pts-core: Fix PHP8 error in the 'info' sub-command pts-core: Other PHP deprecation code tweaks phodevi: Add amd_energy Linux driver support

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-9.8.0.tar.gz(1.73 MB)
    phoronix-test-suite_9.8.0_all.deb(978.58 KB)
  • v9.8.0m2(Jun 24, 2020)

    Phoronix Test Suite 9.8.0 Milestone 2 24 June 2020

    pts-core: Add client side plumbing for estimated test install time from OpenBenchmarking.org pts-core: Add estimate-install-time sub-command, show estimated install time when installing a test pts-core: Improve web browser selection logic for result viewer pts-core: Add search field to the result viewer areas for limiting based on title/argument matching pts-core: Various minor fixes pts-core: Don't show OpenCL test options if no OpenCL drivers/adapters appear present phodevi: Fix for incorrect monitor count when parsing X.Org log phodevi: Warning fixes for latest WSL

    Source code(tar.gz)
    Source code(zip)
  • v9.8.0m1(Jun 3, 2020)

    Phoronix Test Suite 9.8.0 Milestone 1 3 June 2020

    pts-core: When an install fails, try a newer minor version update to that test profile if available (fixes broken download mirrors, etc) pts-core: When a newer minor version of a test profile is installed and a requested (older) one is not, use the newer compatible version pts-core: Rewrite virtual test suite implementation pts-core: Add handler for ensuring reported system time is accurate, otherwise calculate current date/time using offsets pts-core: When scanning test suites on disk, ensure the latest test suite version is used pts-core: Add test-to-suite map sub-command pts-core: Fix for loading the result viewer JavaScript / CSS when running on a Windows host pts-core: For tests requiring root but not run initially as root and using monitoring data, drop the first run to ensure sudo promot doesn't skew time pts-core: Fix PHP8 error in the 'info' sub-command pts-core: Other PHP deprecation code tweaks phodevi: Add amd_energy Linux driver support

    Source code(tar.gz)
    Source code(zip)
  • v9.6.1(May 25, 2020)

    Phoronix Test Suite 9.6.1 25 May 2020

    pts-core: Show unit/scale in CSV export pts-core: When limiting results to show in result viewer, keep child objects that match the desired type for the parent pts-core: Add rebuild-test-suite option for regenerating suite XML all cleaned up pts-core: Allow exporting result files to XML test suites via the result viewer linux_perf: Reporting many more events pts-core: External dependency updates pts_Graph: graph code tweaks phodevi: Avoid macOS reporting X-Core string before Intel CPU string phodevi: Sway compositor version detection phodevi: Detection of newer Arm CPU cores

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-9.6.1.tar.gz(1.69 MB)
    phoronix-test-suite_9.6.1_all.deb(961.44 KB)
  • v9.6.0(Apr 21, 2020)

    Phoronix Test Suite 9.6

    Release Date: 21 April 2020 | Codename: Nittedal

    • Continued improvements to the result viewer with many features added
    • New sub-commands: workload-topology, analyze-run-times

    Phoronix Test Suite 9.6.0 21 April 2020

    pts-core: Allow building virtual suites off external dependencies pts-core: Various result viewer improvements pts-core: Allow saving results under stress-run pts-core: Responsive/mobile result viewer improvements pts-core: Show local tests within the build-suite sub-command pts-core: Show local suites within the list-installed-suites sub-command pts_Graph: Restore capability for drawing mini graphs for all results in a result file overview

    Phoronix Test Suite 9.6.0 Milestone 3 12 April 2020

    pts-core: Allow automated per-thread/core/clock/RAM graphs within the result viewer pts-core: Result viewer add "Limit displaying results to tests within:" pts-core: From the result viewer allow "Show Geometric Means Per-Suite/Category" pts-core: Add workload-topology sub-command pts-core: Allow adding deprecated tests to build-suite pts-core: CSV export improvements pts-core: Add "Do Not Show Results With Incomplete Data" to the result viewer pts-core: Allow test suite "Status" tag pts-core: Don't report OB updates on deprecated tests or suites

    Phoronix Test Suite 9.6.0 Milestone 2 5 April 2020

    pts-core: Documentation updates pts-core: External dependency updates pts-core: Allow listing test profiles within the result viewer pts-core: Allow listing test suites and test suite data within the result viewer pts-core: Allow showing test profile information within the result viewer pts-core: Various other updates to the result viewer pts-core: Add vaapi as possible external dependency update_checker: Add message of the day support

    Phoronix Test Suite 9.6.0 Milestone 1 24 March 2020

    pts-core: Add new analyze-run-times sub-command pts-core: Allow hiding results from within the result viewer pts-core: Allow generating performance-per-dollar metrics from within the result file pts-core: Allow showing system logs from the result viewer pts-core: Allow showing test description within the result viewer pts-core: Fixes for running the result viewer from a website sub directory in correctly loading assets pts-core: Add result viewer option "hide noisy results" pts-core: Add result viewer option "hide results with little change/spread" pts-core: Add result viewer option "only show results where X faster than Y" pts-core: Add XML export to result viewer export menu pts-core: Support deleting runs from the result viewer pts-core: Improve the print view from the result viewer phodevi: BSD tweaks/fixes

    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-9.6.0.tar.gz(1.65 MB)
    phoronix-test-suite_9.6.0_all.deb(950.80 KB)
  • v9.6.0m3(Apr 12, 2020)

    Phoronix Test Suite 9.6.0 Milestone 3 12 April 2020

    pts-core: Allow automated per-thread/core/clock/RAM graphs within the result viewer pts-core: Result viewer add "Limit displaying results to tests within:" pts-core: From the result viewer allow "Show Geometric Means Per-Suite/Category" pts-core: Add workload-topology sub-command pts-core: Allow adding deprecated tests to build-suite pts-core: CSV export improvements pts-core: Add "Do Not Show Results With Incomplete Data" to the result viewer pts-core: Allow test suite "Status" tag pts-core: Don't report OB updates on deprecated tests or suites

    Source code(tar.gz)
    Source code(zip)
  • v9.6.0m2(Apr 5, 2020)

    Phoronix Test Suite 9.6.0 Milestone 2 5 April 2020

    pts-core: Documentation updates pts-core: External dependency updates pts-core: Allow listing test profiles within the result viewer pts-core: Allow listing test suites and test suite data within the result viewer pts-core: Allow showing test profile information within the result viewer pts-core: Various other updates to the result viewer pts-core: Add vaapi as possible external dependency update_checker: Add message of the day support

    Source code(tar.gz)
    Source code(zip)
  • v9.6.0m1(Mar 24, 2020)

    Phoronix Test Suite 9.6.0 Milestone 1 24 March 2020

    pts-core: Add new analyze-run-times sub-command pts-core: Allow hiding results from within the result viewer pts-core: Allow generating performance-per-dollar metrics from within the result file pts-core: Allow showing system logs from the result viewer pts-core: Allow showing test description within the result viewer pts-core: Fixes for running the result viewer from a website sub directory in correctly loading assets pts-core: Add result viewer option "hide noisy results" pts-core: Add result viewer option "hide results with little change/spread" pts-core: Add result viewer option "only show results where X faster than Y" pts-core: Add XML export to result viewer export menu pts-core: Support deleting runs from the result viewer pts-core: Improve the print view from the result viewer phodevi: BSD tweaks/fixes

    Source code(tar.gz)
    Source code(zip)
  • v9.4.1(Mar 4, 2020)

  • v9.4.0(Feb 25, 2020)

    Phoronix Test Suite 9.4

    Release Date: 24 February 2020 | Codename: Vestby

    • Numerous result viewer improvements (showing logs within viewer, UI/UX improvements, new options, deleting results)
    • Support for annotating results that are then displayed below individual benchmark results
    • The modern result viewer now works on Microsoft Windows platforms
    • Support for showing performance-per-suite metrics
    • Numerous PDF result generation enhancements
    • Save test logs and save installation logs is now enabled by default
    • Improve reporting on test installation failures
    • New sub-commands: remove-result-from-result-file, intersect
    Source code(tar.gz)
    Source code(zip)
    phoronix-test-suite-9.4.0.tar.gz(1.53 MB)
    phoronix-test-suite_9.4.0_all.deb(908.15 KB)
  • v9.4.0m3(Feb 18, 2020)

    Phoronix Test Suite 9.4.0 Milestone 3 18 February 2020

    pts-core: Add PDF bookmarks to result graphs on PDF result file generation pts-core: Add automated executive summary of result files via executive-summary sub-command and PDF result export pts-core: Add remove-result-from-result-file sub-command (slightly different from remove-results-from-result-file) pts-core: Set SaveTestLogs = TRUE by default pts-core: Set SaveInstallationLogs = TRUE by default pts-core: Refactor test-logs (SaveTestLogs) handling pts-core: Refactor test installation logs handling pts-core: More verbose reporting of system/external dependency solving status pts-core: Get the modern result viewer working on Windows pts-core: Support for showing test logs from the result viewer pts-core: Support for showing install logs from the result viewer pts-core: PDF output improvements pts-core: Fix for some suites not showing up on list-suites sub-command pts-core: Report "Test Suites Containing This Test" in the info sub-command on tests pts-core: On PDF export allow showing geometric means of tests based on their test suite connections pts-core: Add intersect sub-command for showing tests common between multiple results/suites

    Source code(tar.gz)
    Source code(zip)
Owner
Phoronix Test Suite
The open-source Phoronix Test Suite benchmarking platform.
Phoronix Test Suite
SimpleTest is a framework for unit testing, web site testing and mock objects for PHP

SimpleTest SimpleTest is a framework for unit testing, web site testing and mock objects for PHP. Installation Downloads All downloads are stored on G

SimpleTest 147 Jun 20, 2022
Magic Test allows you to write browser tests by simply clicking around on the application being tested, all without the slowness of constantly restarting the testing environment.

Magic Test for Laravel Magic Test allows you to write browser tests by simply clicking around on the application being tested, all without the slownes

null 400 Jan 5, 2023
Wraps your Pest suite in a Laravel application instance, allowing global use of the framework in tests.

Pest Larastrap Plugin This is currently a highly experimental project and is subject to large pre-release changes. Pest PHP is an awesome PHP testing

Luke Downing 3 Jan 6, 2022
The most powerful and flexible mocking framework for PHPUnit / Codeception.

AspectMock AspectMock is not an ordinary PHP mocking framework. With the power of Aspect Oriented programming and the awesome Go-AOP library, AspectMo

Codeception Testing Framework 777 Dec 12, 2022
Infrastructure and testing helpers for creating CQRS and event sourced applications.

Broadway is a project providing infrastructure and testing helpers for creating CQRS and event sourced applications. Broadway tries hard to not get in your way.

null 1.5k Dec 30, 2022
:heavy_check_mark: PHP Test Framework for Freedom, Truth, and Justice

Kahlan is a full-featured Unit & BDD test framework a la RSpec/JSpec which uses a describe-it syntax and moves testing in PHP one step forward. Kahlan

Kahlan 1.1k Jan 2, 2023
The modern, simple and intuitive PHP unit testing framework.

atoum PHP version atoum version 5.3 -> 5.6 1.x -> 3.x 7.2 -> 8.x 4.x (current) A simple, modern and intuitive unit testing framework for PHP! Just lik

atoum 1.4k Nov 29, 2022
PHP unit testing framework with built in mocks and stubs. Runs in the browser, or via the command line.

Enhance PHP A unit testing framework with mocks and stubs. Built for PHP, in PHP! Quick Start: Just add EnhanceTestFramework.php and you are ready to

Enhance PHP 67 Sep 12, 2022
PHP libraries that makes Selenium WebDriver + PHPUnit functional testing easy and robust

Steward: easy and robust testing with Selenium WebDriver + PHPUnit Steward is a set of libraries made to simplify writing and running robust functiona

LMC s.r.o. 219 Dec 17, 2022
CommandHelper - is a very useful thing for quick code testing and more!

CommandHelper CommandHelper - is a very useful thing for quick code testing and more! Examples: Code: require_once('commandhelper.php');

RuvSleep 1 Feb 11, 2022
An effort to make testing PHP code as easy and fun as its JavaScript equivalent

An effort to make testing PHP code as easy and fun as its JavaScript equivalent when using the excellent Jasmine, from which syntax and general usage is shamelessly borrowed.

Johan Stenqvist 24 Apr 22, 2022
Event driven BDD test framework for PHP

The highly extensible, highly enjoyable, PHP testing framework. Read more at peridot-php.github.io or head over to the wiki. Building PHAR Peridot's p

Peridot 327 Jan 5, 2023
BDD test framework for PHP

BDD test framework for PHP, inspired by Jasmine and RSpec. Features a familiar syntax, and a watch command to automatically re-run specs during develo

Daniel St. Jules 286 Nov 12, 2022
vfsStream is a stream wrapper for a virtual file system that may be helpful in unit tests to mock the real file system. It can be used with any unit test framework, like PHPUnit or SimpleTest.

vfsStream vfsStream is a stream wrapper for a virtual file system that may be helpful in unit tests to mock the real file system. It can be used with

null 1.4k Dec 23, 2022
⛽ Pest plugin to test Laravel applications powered by Octane.

⛽ Laravel Octane (Pest Plugin) Pest plugin to test Laravel applications powered by Octane. Install Via Composer composer require --dev cerbero/pest-pl

Andrea Marco Sartori 21 Apr 5, 2022
A sample RESTful API in Laravel with PHPunit test.

Laravel PHP Framework URL | URI | Action |

Fasil 9 Jul 11, 2020
PHPUnit Application Architecture Test

PHPUnit Application Architecture Test Idea: write architecture tests as well as feature and unit tests Installation Install via composer composer requ

null 19 Dec 11, 2022
A Composer script to run a 'test' or 'spec' Composer script against multiple PHP versions.

composer-multitest composer-multitest is a Composer script that runs a test or spec Composer script against multiple PHP versions managed by PHPBrew o

Raphael Stolt 5 Aug 27, 2019
Patchstack Test task Laravel&Vue CRUD

Patchstack Test Task - Laravel & Vue CRUD SPA Written with Laravel and Vue2 using mix. Installation Clone this repository Run "composer update" comman

Crypto Rookie 3 Aug 25, 2022