ci/llvmpipe,softpipe: Switch piglit testing to piglit-runner.
The new runner reduces the runtime by about 1/3 thanks to using rust instead of python, and includes automatic flake handling so you don't just have to skip flaky tests. The wrapper script also includes IRC flake reporting (so one can track and update the flakes list to improve CI reliability), always uploading results to CI for review (so you can diagnose flakes and look at timings), has a prettier regressions report and a helpful timing report, and is the same as what's used by all the HW runners as well. The downside is that by dropping the massive list of skips, you no longer get flagged if Mesa refactors end up accidentally disabling extensions and thus making tests skip. For that, I've started on https://gitlab.freedesktop.org/anholt/deqp-runner/-/merge_requests/33 so that hardware drivers get extension checking coverage too. Thanks to the perf improvement, we get to drop one of the jobs for llvmpipe. xfail lists were mostly sed-jobs from the prior expectations lists. The exceptions to that you'll find in the form of whitespace around the affected test group (usually changes of capitalization or special-characters), or an explanation for the more interesting changes (which thankfully we can now record in the xfails lists!). Reviewed-by: Cristian Ciocaltea <cristian.ciocaltea@collabora.com> Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/14604>
This commit is contained in:
@@ -1260,16 +1260,16 @@ debian-mingw32-x86_64:
|
||||
|
||||
.piglit-test:
|
||||
artifacts:
|
||||
when: on_failure
|
||||
name: "mesa_${CI_JOB_NAME}"
|
||||
paths:
|
||||
- results/summary/
|
||||
- results/*.txt
|
||||
- results
|
||||
reports:
|
||||
junit: results/junit.xml
|
||||
variables:
|
||||
PIGLIT_NO_WINDOW: 1
|
||||
CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition
|
||||
HWCI_TEST_SCRIPT: "/install/piglit/piglit-runner.sh"
|
||||
script:
|
||||
- install/piglit/run.sh
|
||||
- install/piglit/piglit-runner.sh
|
||||
|
||||
.piglit-traces-test:
|
||||
extends:
|
||||
@@ -1283,12 +1283,18 @@ debian-mingw32-x86_64:
|
||||
name: "mesa_${CI_JOB_NAME}"
|
||||
reports:
|
||||
junit: results/junit.xml
|
||||
paths:
|
||||
- results/summary/
|
||||
- results/*.txt
|
||||
variables:
|
||||
CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition
|
||||
PIGLIT_PROFILES: replay
|
||||
PIGLIT_REPLAY_UPLOAD_TO_MINIO: 1
|
||||
PIGLIT_REPLAY_EXTRA_ARGS: --keep-image --db-path ${CI_PROJECT_DIR}/replayer-db/ --minio_host=minio-packet.freedesktop.org --minio_bucket=mesa-tracie-public --role-session-name=${CI_PROJECT_PATH}:${CI_JOB_ID} --jwt-file=${CI_JOB_JWT_FILE}
|
||||
PIGLIT_JUNIT_RESULTS: 1
|
||||
CI_JOB_JWT_FILE: /minio_jwt # JWT file on piglit jobs should be available on / partition
|
||||
script:
|
||||
- install/piglit/run.sh
|
||||
|
||||
.deqp-test:
|
||||
script:
|
||||
|
Reference in New Issue
Block a user