2019-01-20 19:21:45 +08:00
|
|
|
variables:
|
2020-03-07 05:23:20 +08:00
|
|
|
FDO_UPSTREAM_REPO: mesa/mesa
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
CI_PRE_CLONE_SCRIPT: |-
|
|
|
|
set -o xtrace
|
|
|
|
/usr/bin/wget -q -O- ${CI_PROJECT_URL}/-/raw/${CI_COMMIT_SHA}/.gitlab-ci/download-git-cache.sh | sh -
|
|
|
|
set +o xtrace
|
2019-04-02 15:24:00 +08:00
|
|
|
|
|
|
|
include:
|
2020-03-07 05:23:20 +08:00
|
|
|
- project: 'freedesktop/ci-templates'
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
ref: &ci-templates-sha 52dd4a94044449c8481d18dcdc221a3c636366d2
|
2019-04-02 22:56:54 +08:00
|
|
|
file: '/templates/debian.yml'
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
- project: 'freedesktop/ci-templates'
|
|
|
|
ref: *ci-templates-sha
|
|
|
|
file: '/templates/alpine.yml'
|
2019-10-24 05:36:19 +08:00
|
|
|
- local: '.gitlab-ci/lava-gitlab-ci.yml'
|
2019-10-31 03:39:08 +08:00
|
|
|
- local: '.gitlab-ci/test-source-dep.yml'
|
2019-09-18 22:03:36 +08:00
|
|
|
|
2019-01-20 19:21:45 +08:00
|
|
|
stages:
|
2020-08-06 23:10:08 +08:00
|
|
|
- container
|
2020-05-16 23:17:23 +08:00
|
|
|
- container-2
|
2020-08-06 23:37:33 +08:00
|
|
|
- sanity
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
- git-archive
|
2020-07-01 23:37:49 +08:00
|
|
|
- deploy
|
2020-02-28 01:27:56 +08:00
|
|
|
- meson-x86_64
|
|
|
|
- scons
|
|
|
|
- meson-misc
|
|
|
|
- llvmpipe
|
|
|
|
- softpipe
|
|
|
|
- freedreno
|
|
|
|
- panfrost
|
2020-03-06 15:39:25 +08:00
|
|
|
- radv
|
|
|
|
- lima
|
2020-04-01 15:17:25 +08:00
|
|
|
- virgl
|
2020-07-03 16:04:20 +08:00
|
|
|
- radeonsi
|
2020-01-13 16:45:57 +08:00
|
|
|
- success
|
2019-01-20 19:21:45 +08:00
|
|
|
|
2020-07-07 21:02:35 +08:00
|
|
|
# Generic rule to not run the job during scheduled pipelines
|
|
|
|
# ----------------------------------------------------------
|
|
|
|
.scheduled_pipelines-rules:
|
|
|
|
rules: &ignore_scheduled_pipelines
|
2020-09-08 23:44:40 +08:00
|
|
|
if: &is-scheduled-pipeline '$CI_PIPELINE_SOURCE == "schedule"'
|
2020-07-07 21:02:35 +08:00
|
|
|
when: never
|
|
|
|
|
2020-09-08 18:20:39 +08:00
|
|
|
# YAML anchors for rule conditions
|
|
|
|
# --------------------------------
|
|
|
|
.rules-anchors:
|
|
|
|
rules:
|
2020-09-09 00:00:21 +08:00
|
|
|
# For Marge Bot
|
|
|
|
- if: &is-for-marge '$GITLAB_USER_LOGIN == "marge-bot"'
|
|
|
|
when: never
|
2020-09-08 23:52:24 +08:00
|
|
|
# Forked project branch
|
2020-09-09 00:02:58 +08:00
|
|
|
- if: &is-forked-branch '$CI_PROJECT_NAMESPACE != "mesa" && $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME != $CI_COMMIT_REF_NAME'
|
2020-09-08 23:52:24 +08:00
|
|
|
when: manual
|
2020-09-08 23:30:49 +08:00
|
|
|
# Forked project branch / pre-merge pipeline
|
2020-09-09 00:02:58 +08:00
|
|
|
- if: &is-forked-branch-or-pre-merge '$CI_PROJECT_NAMESPACE != "mesa" || $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME == $CI_COMMIT_REF_NAME'
|
2020-09-08 23:30:49 +08:00
|
|
|
when: manual
|
2020-09-08 18:20:39 +08:00
|
|
|
# Pipeline runs for the master branch of the main project
|
2020-09-03 00:35:32 +08:00
|
|
|
- if: &is-main-master '$CI_PROJECT_NAMESPACE == "mesa" && $CI_COMMIT_REF_NAME == "master" && $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME != "master"'
|
2020-09-08 18:20:39 +08:00
|
|
|
when: always
|
2020-09-08 23:47:18 +08:00
|
|
|
# Post-merge pipeline
|
|
|
|
- if: &is-post-merge '$CI_PROJECT_NAMESPACE == "mesa" && $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME != $CI_COMMIT_REF_NAME'
|
|
|
|
when: on_success
|
2020-09-08 18:36:11 +08:00
|
|
|
# Post-merge pipeline, not for Marge Bot
|
2020-09-09 00:02:58 +08:00
|
|
|
- if: &is-post-merge-not-for-marge '$CI_PROJECT_NAMESPACE == "mesa" && $GITLAB_USER_LOGIN != "marge-bot" && $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME != $CI_COMMIT_REF_NAME'
|
2020-09-08 18:36:11 +08:00
|
|
|
when: on_success
|
2020-09-08 23:58:32 +08:00
|
|
|
# Pre-merge pipeline
|
|
|
|
- if: &is-pre-merge '$CI_MERGE_REQUEST_SOURCE_BRANCH_NAME == $CI_COMMIT_REF_NAME'
|
|
|
|
when: on_success
|
2020-09-08 18:31:08 +08:00
|
|
|
# Pre-merge pipeline for Marge Bot
|
|
|
|
- if: &is-pre-merge-for-marge '$GITLAB_USER_LOGIN == "marge-bot" && $CI_MERGE_REQUEST_SOURCE_BRANCH_NAME == $CI_COMMIT_REF_NAME'
|
|
|
|
when: on_success
|
2020-09-08 18:20:39 +08:00
|
|
|
|
|
|
|
|
2020-06-22 17:10:29 +08:00
|
|
|
.docs-base:
|
2020-06-22 17:21:06 +08:00
|
|
|
extends: .ci-run-policy
|
2019-05-27 23:12:10 +08:00
|
|
|
image: alpine
|
|
|
|
script:
|
2020-07-02 19:09:36 +08:00
|
|
|
- apk --no-cache add py3-pip graphviz
|
2019-05-27 23:12:10 +08:00
|
|
|
- pip3 install sphinx sphinx_rtd_theme
|
|
|
|
- sphinx-build -b html docs public
|
2020-06-22 17:10:29 +08:00
|
|
|
|
|
|
|
pages:
|
|
|
|
extends: .docs-base
|
2020-06-22 17:10:40 +08:00
|
|
|
stage: deploy
|
2019-05-27 23:12:10 +08:00
|
|
|
artifacts:
|
|
|
|
paths:
|
|
|
|
- public
|
2020-08-06 23:12:11 +08:00
|
|
|
needs: []
|
2020-06-22 17:21:06 +08:00
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-09-08 18:20:39 +08:00
|
|
|
- if: *is-main-master
|
2020-06-22 17:21:06 +08:00
|
|
|
changes: &docs-or-ci
|
|
|
|
- docs/**/*
|
|
|
|
- .gitlab-ci.yml
|
2020-07-01 23:41:06 +08:00
|
|
|
when: always
|
2020-06-22 17:21:06 +08:00
|
|
|
# Other cases default to never
|
2019-01-20 19:21:45 +08:00
|
|
|
|
2020-06-22 17:10:29 +08:00
|
|
|
test-docs:
|
|
|
|
extends: .docs-base
|
2020-07-21 22:13:37 +08:00
|
|
|
# Cancel job if a newer commit is pushed to the same branch
|
|
|
|
interruptible: true
|
2020-08-06 23:10:08 +08:00
|
|
|
stage: deploy
|
|
|
|
needs: []
|
2020-06-22 17:13:05 +08:00
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-09-03 00:39:52 +08:00
|
|
|
- if: *is-main-master
|
|
|
|
changes: *docs-or-ci
|
|
|
|
when: never
|
2020-09-08 18:31:08 +08:00
|
|
|
- if: *is-pre-merge-for-marge
|
2020-06-22 17:21:06 +08:00
|
|
|
changes: *docs-or-ci
|
2020-09-01 00:46:37 +08:00
|
|
|
when: on_success
|
2020-09-08 18:36:11 +08:00
|
|
|
- if: *is-post-merge-not-for-marge
|
2020-09-01 00:46:37 +08:00
|
|
|
changes: *docs-or-ci
|
2020-06-22 17:13:05 +08:00
|
|
|
when: on_success
|
2020-09-08 23:30:49 +08:00
|
|
|
- if: *is-forked-branch-or-pre-merge
|
2020-09-01 17:44:54 +08:00
|
|
|
changes: *docs-or-ci
|
2020-06-22 17:13:05 +08:00
|
|
|
when: manual
|
|
|
|
# Other cases default to never
|
2020-06-22 17:10:29 +08:00
|
|
|
|
2019-02-22 23:52:08 +08:00
|
|
|
# When to automatically run the CI
|
2019-09-06 23:35:52 +08:00
|
|
|
.ci-run-policy:
|
2019-09-26 15:27:27 +08:00
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-04-03 18:50:11 +08:00
|
|
|
# If any files affecting the pipeline are changed, build/test jobs run
|
|
|
|
# automatically once all dependency jobs have passed
|
|
|
|
- changes: &all_paths
|
2020-01-13 16:45:57 +08:00
|
|
|
- VERSION
|
2020-05-15 04:51:38 +08:00
|
|
|
- bin/git_sha1_gen.py
|
|
|
|
- bin/install_megadrivers.py
|
|
|
|
- bin/meson_get_version.py
|
|
|
|
- bin/symbols-check.py
|
2020-01-13 16:45:57 +08:00
|
|
|
# GitLab CI
|
|
|
|
- .gitlab-ci.yml
|
|
|
|
- .gitlab-ci/**/*
|
|
|
|
# Meson
|
|
|
|
- meson*
|
|
|
|
- build-support/**/*
|
|
|
|
- subprojects/**/*
|
|
|
|
# SCons
|
|
|
|
- SConstruct
|
|
|
|
- scons/**/*
|
|
|
|
- common.py
|
|
|
|
# Source code
|
|
|
|
- include/**/*
|
|
|
|
- src/**/*
|
|
|
|
when: on_success
|
2020-04-03 18:50:11 +08:00
|
|
|
# Otherwise, build/test jobs won't run
|
2020-01-13 16:45:57 +08:00
|
|
|
- when: never
|
2019-03-27 01:39:41 +08:00
|
|
|
retry:
|
|
|
|
max: 2
|
|
|
|
when:
|
|
|
|
- runner_system_failure
|
2019-02-22 23:52:08 +08:00
|
|
|
|
2020-01-13 16:45:57 +08:00
|
|
|
success:
|
|
|
|
stage: success
|
|
|
|
image: debian:stable-slim
|
2020-06-22 17:16:17 +08:00
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-09-08 23:47:18 +08:00
|
|
|
- if: *is-post-merge
|
2020-06-22 17:16:17 +08:00
|
|
|
when: never
|
2020-09-09 00:00:21 +08:00
|
|
|
- if: *is-for-marge
|
2020-06-22 17:16:17 +08:00
|
|
|
changes: *docs-or-ci
|
|
|
|
when: never
|
|
|
|
- changes: *all_paths
|
|
|
|
when: never
|
2020-09-08 23:58:32 +08:00
|
|
|
- if: *is-pre-merge
|
2020-08-28 23:08:57 +08:00
|
|
|
when: on_success
|
2020-01-21 01:34:34 +08:00
|
|
|
variables:
|
|
|
|
GIT_STRATEGY: none
|
2020-01-13 16:45:57 +08:00
|
|
|
script:
|
|
|
|
- echo "Dummy job to make sure every merge request pipeline runs at least one job"
|
|
|
|
|
|
|
|
|
2019-09-06 23:35:52 +08:00
|
|
|
.ci-deqp-artifacts:
|
2019-06-29 07:35:32 +08:00
|
|
|
artifacts:
|
2020-03-06 19:35:17 +08:00
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
2019-06-29 07:35:32 +08:00
|
|
|
when: always
|
|
|
|
untracked: false
|
|
|
|
paths:
|
|
|
|
# Watch out! Artifacts are relative to the build dir.
|
|
|
|
# https://gitlab.com/gitlab-org/gitlab-ce/commit/8788fb925706cad594adf6917a6c5f6587dd1521
|
|
|
|
- artifacts
|
2019-02-22 23:52:08 +08:00
|
|
|
|
2019-12-17 18:50:14 +08:00
|
|
|
# Build the CI docker images.
|
2019-11-12 01:13:28 +08:00
|
|
|
#
|
2020-03-07 05:23:20 +08:00
|
|
|
# FDO_DISTRIBUTION_TAG is the tag of the docker image used by later stage jobs. If the
|
2019-11-12 01:13:28 +08:00
|
|
|
# image doesn't exist yet, the container stage job generates it.
|
|
|
|
#
|
|
|
|
# In order to generate a new image, one should generally change the tag.
|
|
|
|
# While removing the image from the registry would also work, that's not
|
|
|
|
# recommended except for ephemeral images during development: Replacing
|
|
|
|
# an image after a significant amount of time might pull in newer
|
|
|
|
# versions of gcc/clang or other packages, which might break the build
|
|
|
|
# with older commits using the same tag.
|
|
|
|
#
|
|
|
|
# After merging a change resulting in generating a new image to the
|
|
|
|
# main repository, it's recommended to remove the image from the source
|
|
|
|
# repository's container registry, so that the image from the main
|
|
|
|
# repository's registry will be used there as well.
|
2019-09-06 23:04:47 +08:00
|
|
|
|
2019-10-15 06:04:14 +08:00
|
|
|
.container:
|
2020-08-06 23:10:08 +08:00
|
|
|
stage: container
|
2019-10-15 06:04:14 +08:00
|
|
|
extends:
|
|
|
|
- .ci-run-policy
|
2020-04-03 18:50:11 +08:00
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-06-29 17:33:13 +08:00
|
|
|
# Run pipeline by default in the main project if any CI pipeline
|
|
|
|
# configuration files were changed, to ensure docker images are up to date
|
2020-09-08 23:47:18 +08:00
|
|
|
- if: *is-post-merge
|
2020-06-29 17:33:13 +08:00
|
|
|
changes:
|
|
|
|
- .gitlab-ci.yml
|
|
|
|
- .gitlab-ci/**/*
|
|
|
|
when: on_success
|
2020-04-03 17:46:12 +08:00
|
|
|
# Run pipeline by default if it was triggered by Marge Bot, is for a
|
2020-06-29 17:33:13 +08:00
|
|
|
# merge request, and any files affecting the pipeline were changed
|
2020-09-08 18:31:08 +08:00
|
|
|
- if: *is-pre-merge-for-marge
|
2020-04-03 18:50:11 +08:00
|
|
|
changes:
|
|
|
|
*all_paths
|
|
|
|
when: on_success
|
2020-06-29 17:33:13 +08:00
|
|
|
# Run pipeline by default in the main project if it was not triggered by
|
|
|
|
# Marge Bot, and any files affecting the pipeline were changed
|
2020-09-08 18:36:11 +08:00
|
|
|
- if: *is-post-merge-not-for-marge
|
2020-04-03 18:50:11 +08:00
|
|
|
changes:
|
|
|
|
*all_paths
|
|
|
|
when: on_success
|
2020-06-29 17:33:13 +08:00
|
|
|
# Allow triggering jobs manually in other cases if any files affecting the
|
|
|
|
# pipeline were changed
|
2020-04-03 17:46:12 +08:00
|
|
|
- changes:
|
2020-04-03 18:50:11 +08:00
|
|
|
*all_paths
|
|
|
|
when: manual
|
|
|
|
# Otherwise, container jobs won't run
|
|
|
|
- when: never
|
2019-10-15 06:04:14 +08:00
|
|
|
variables:
|
2020-03-07 05:23:20 +08:00
|
|
|
FDO_DISTRIBUTION_VERSION: buster-slim
|
2020-03-24 01:16:07 +08:00
|
|
|
FDO_REPO_SUFFIX: "debian/$CI_JOB_NAME"
|
2020-06-27 01:59:41 +08:00
|
|
|
FDO_DISTRIBUTION_EXEC: 'env FDO_CI_CONCURRENT=${FDO_CI_CONCURRENT} bash .gitlab-ci/container/${CI_JOB_NAME}.sh'
|
2019-10-15 06:04:14 +08:00
|
|
|
# no need to pull the whole repo to build the container image
|
|
|
|
GIT_STRATEGY: none
|
|
|
|
|
2020-05-30 21:53:41 +08:00
|
|
|
# Debian 10 based x86 build image base
|
|
|
|
x86_build-base:
|
2019-09-06 23:35:52 +08:00
|
|
|
extends:
|
2020-03-24 01:16:07 +08:00
|
|
|
- .fdo.container-build@debian
|
2019-10-15 06:04:14 +08:00
|
|
|
- .container
|
2019-11-12 01:13:28 +08:00
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_build-base "2020-11-05-kmod"
|
2020-05-30 21:53:41 +08:00
|
|
|
|
|
|
|
.use-x86_build-base:
|
|
|
|
extends:
|
|
|
|
- x86_build-base
|
|
|
|
- .ci-run-policy
|
|
|
|
stage: container-2
|
|
|
|
variables:
|
|
|
|
BASE_TAG: *x86_build-base
|
|
|
|
FDO_BASE_IMAGE: "$CI_REGISTRY_IMAGE/debian/x86_build-base:$BASE_TAG"
|
|
|
|
needs:
|
|
|
|
- x86_build-base
|
|
|
|
|
|
|
|
# Debian 10 based x86 main build image
|
|
|
|
x86_build:
|
|
|
|
extends:
|
|
|
|
- .use-x86_build-base
|
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_build "2020-11-05-kmod"
|
2019-01-20 19:26:53 +08:00
|
|
|
|
2019-11-14 00:43:41 +08:00
|
|
|
.use-x86_build:
|
2019-11-12 01:13:28 +08:00
|
|
|
variables:
|
|
|
|
TAG: *x86_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/x86_build:$TAG"
|
2019-10-10 21:27:17 +08:00
|
|
|
needs:
|
2019-11-14 00:43:41 +08:00
|
|
|
- x86_build
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2019-10-10 21:27:17 +08:00
|
|
|
|
2020-06-02 01:08:30 +08:00
|
|
|
# Debian 10 based i386 cross-build image
|
|
|
|
i386_build:
|
|
|
|
extends:
|
|
|
|
- .use-x86_build-base
|
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &i386_build "2020-11-05-kmod"
|
2020-06-02 01:08:30 +08:00
|
|
|
|
|
|
|
.use-i386_build:
|
|
|
|
variables:
|
|
|
|
TAG: *i386_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/i386_build:$TAG"
|
|
|
|
needs:
|
|
|
|
- i386_build
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2020-06-02 01:08:30 +08:00
|
|
|
|
|
|
|
# Debian 10 based ppc64el cross-build image
|
|
|
|
ppc64el_build:
|
|
|
|
extends:
|
|
|
|
- .use-x86_build-base
|
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &ppc64el_build "2020-11-05-kmod"
|
2020-06-02 01:08:30 +08:00
|
|
|
|
|
|
|
.use-ppc64el_build:
|
|
|
|
variables:
|
|
|
|
TAG: *ppc64el_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/ppc64el_build:$TAG"
|
|
|
|
needs:
|
|
|
|
- ppc64el_build
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2020-06-02 01:08:30 +08:00
|
|
|
|
|
|
|
# Debian 10 based s390x cross-build image
|
|
|
|
s390x_build:
|
|
|
|
extends:
|
|
|
|
- .use-x86_build-base
|
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &s390x_build "2020-11-05-kmod"
|
2020-06-02 01:08:30 +08:00
|
|
|
|
|
|
|
.use-s390x_build:
|
|
|
|
variables:
|
|
|
|
TAG: *s390x_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/s390x_build:$TAG"
|
|
|
|
needs:
|
|
|
|
- s390x_build
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2020-06-02 01:08:30 +08:00
|
|
|
|
2020-09-10 07:37:54 +08:00
|
|
|
# Android NDK cross-build image
|
|
|
|
android_build:
|
|
|
|
extends:
|
|
|
|
- .use-x86_build-base
|
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &android_build "2020-11-05-kmod"
|
2020-09-10 07:37:54 +08:00
|
|
|
|
|
|
|
.use-android_build:
|
|
|
|
variables:
|
|
|
|
TAG: *android_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/android_build:$TAG"
|
|
|
|
needs:
|
|
|
|
- android_build
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2020-09-10 07:37:54 +08:00
|
|
|
|
2020-05-16 23:17:23 +08:00
|
|
|
# Debian 10 based x86 test image base
|
|
|
|
x86_test-base:
|
2020-05-30 21:53:41 +08:00
|
|
|
extends: x86_build-base
|
2020-05-16 23:17:23 +08:00
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_test-base "2020-11-05-kmod"
|
2020-05-16 23:17:23 +08:00
|
|
|
|
|
|
|
.use-x86_test-base:
|
|
|
|
extends:
|
2020-05-30 21:53:41 +08:00
|
|
|
- x86_build-base
|
2020-05-16 23:17:23 +08:00
|
|
|
- .ci-run-policy
|
|
|
|
stage: container-2
|
|
|
|
variables:
|
|
|
|
BASE_TAG: *x86_test-base
|
|
|
|
FDO_BASE_IMAGE: "$CI_REGISTRY_IMAGE/debian/x86_test-base:$BASE_TAG"
|
|
|
|
needs:
|
|
|
|
- x86_test-base
|
|
|
|
|
2019-11-18 16:15:12 +08:00
|
|
|
# Debian 10 based x86 test image for GL
|
|
|
|
x86_test-gl:
|
2020-05-16 23:17:23 +08:00
|
|
|
extends: .use-x86_test-base
|
2019-11-06 01:52:24 +08:00
|
|
|
variables:
|
2020-10-01 01:20:22 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_test-gl "2020-11-06-deqp-version"
|
2019-11-06 01:52:24 +08:00
|
|
|
|
2019-11-18 16:23:18 +08:00
|
|
|
# Debian 10 based x86 test image for VK
|
|
|
|
x86_test-vk:
|
2020-05-16 23:17:23 +08:00
|
|
|
extends: .use-x86_test-base
|
2019-11-18 16:23:18 +08:00
|
|
|
variables:
|
2020-10-01 01:20:22 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_test-vk "2020-11-06-deqp-version"
|
2019-11-18 16:23:18 +08:00
|
|
|
|
2019-11-12 01:13:28 +08:00
|
|
|
# Debian 9 based x86 build image (old LLVM)
|
2019-11-14 00:43:41 +08:00
|
|
|
x86_build_old:
|
2020-05-30 21:53:41 +08:00
|
|
|
extends: x86_build-base
|
2019-09-06 23:04:47 +08:00
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &x86_build_old "2020-11-05-kmod"
|
2020-03-07 05:23:20 +08:00
|
|
|
FDO_DISTRIBUTION_VERSION: stretch-slim
|
2019-09-06 23:04:47 +08:00
|
|
|
|
2019-11-14 00:43:41 +08:00
|
|
|
.use-x86_build_old:
|
2019-11-12 01:13:28 +08:00
|
|
|
variables:
|
|
|
|
TAG: *x86_build_old
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/x86_build_old:$TAG"
|
2019-09-18 22:17:01 +08:00
|
|
|
needs:
|
2019-11-14 00:43:41 +08:00
|
|
|
- x86_build_old
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2019-09-18 22:17:01 +08:00
|
|
|
|
2019-11-12 01:13:28 +08:00
|
|
|
# Debian 10 based ARM build image
|
2019-11-14 00:43:41 +08:00
|
|
|
arm_build:
|
2019-09-06 23:35:52 +08:00
|
|
|
extends:
|
2020-03-24 01:16:07 +08:00
|
|
|
- .fdo.container-build@debian@arm64v8
|
2019-10-15 06:04:14 +08:00
|
|
|
- .container
|
2019-06-29 07:35:32 +08:00
|
|
|
variables:
|
2020-11-04 17:06:20 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &arm_build "2020-11-05-kmod"
|
2019-11-12 01:13:28 +08:00
|
|
|
|
|
|
|
.use-arm_build:
|
|
|
|
variables:
|
|
|
|
TAG: *arm_build
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/arm_build:$TAG"
|
|
|
|
needs:
|
|
|
|
- arm_build
|
2019-01-20 19:26:53 +08:00
|
|
|
|
2020-06-08 04:03:34 +08:00
|
|
|
# Debian 10 based x86 baremetal image base
|
|
|
|
arm_test-base:
|
|
|
|
extends:
|
|
|
|
- .fdo.container-build@debian
|
|
|
|
- .container
|
|
|
|
variables:
|
2020-10-06 08:49:00 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &arm_test-base "2020-10-06-clang10-2"
|
2020-06-08 04:03:34 +08:00
|
|
|
|
|
|
|
.use-arm_test-base:
|
|
|
|
extends:
|
|
|
|
- arm_test-base
|
|
|
|
- .ci-run-policy
|
|
|
|
stage: container-2
|
|
|
|
variables:
|
|
|
|
BASE_TAG: *arm_test-base
|
|
|
|
FDO_BASE_IMAGE: "$CI_REGISTRY_IMAGE/debian/arm_test-base:$BASE_TAG"
|
|
|
|
needs:
|
|
|
|
- arm_test-base
|
|
|
|
|
2020-06-08 05:19:50 +08:00
|
|
|
# x86 image with ARM64 rootfs for baremetal testing.
|
|
|
|
arm64_test:
|
2020-06-08 04:03:34 +08:00
|
|
|
extends:
|
|
|
|
- .use-arm_test-base
|
2020-05-14 02:08:08 +08:00
|
|
|
variables:
|
2020-10-01 01:20:22 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &arm64_test "2020-11-09-deqp-version"
|
2020-05-14 02:08:08 +08:00
|
|
|
|
2020-06-08 05:19:50 +08:00
|
|
|
.use-arm64_test:
|
2020-05-14 02:08:08 +08:00
|
|
|
variables:
|
2020-06-08 05:19:50 +08:00
|
|
|
TAG: *arm64_test
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/arm64_test:$TAG"
|
2020-05-14 02:08:08 +08:00
|
|
|
needs:
|
2020-06-08 05:19:50 +08:00
|
|
|
- arm64_test
|
2020-05-14 02:08:08 +08:00
|
|
|
|
2020-03-24 19:11:36 +08:00
|
|
|
# Native Windows docker builds
|
2020-05-20 05:01:47 +08:00
|
|
|
#
|
2020-03-24 19:11:36 +08:00
|
|
|
# Unlike the above Linux-based builds - including MinGW/SCons builds which
|
|
|
|
# cross-compile for Windows - which use the freedesktop ci-templates, we
|
|
|
|
# cannot use the same scheme here. As Windows lacks support for
|
|
|
|
# Docker-in-Docker, and Podman does not run natively on Windows, we have
|
|
|
|
# to open-code much of the same ourselves.
|
|
|
|
#
|
|
|
|
# This is achieved by first running in a native Windows shell instance
|
|
|
|
# (host PowerShell) in the container stage to build and push the image,
|
|
|
|
# then in the build stage by executing inside Docker.
|
|
|
|
|
|
|
|
.windows-docker-vs2019:
|
|
|
|
variables:
|
2020-05-05 22:49:22 +08:00
|
|
|
WINDOWS_TAG: "2020-05-05-llvm"
|
2020-03-24 19:11:36 +08:00
|
|
|
WINDOWS_IMAGE: "$CI_REGISTRY_IMAGE/windows/x64_build:$WINDOWS_TAG"
|
|
|
|
WINDOWS_UPSTREAM_IMAGE: "$CI_REGISTRY/$FDO_UPSTREAM_REPO/windows/x64_build:$WINDOWS_TAG"
|
|
|
|
|
2020-08-29 02:08:39 +08:00
|
|
|
.windows_build_vs2019:
|
2020-03-24 19:11:36 +08:00
|
|
|
extends:
|
|
|
|
- .container
|
|
|
|
- .windows-docker-vs2019
|
2020-08-06 23:10:08 +08:00
|
|
|
stage: container
|
2020-03-24 19:11:36 +08:00
|
|
|
variables:
|
|
|
|
GIT_STRATEGY: fetch # we do actually need the full repository though
|
2020-05-05 22:49:22 +08:00
|
|
|
timeout: 4h # LLVM takes ages
|
2020-03-24 19:11:36 +08:00
|
|
|
tags:
|
|
|
|
- windows
|
|
|
|
- shell
|
|
|
|
- "1809"
|
2020-03-30 17:16:18 +08:00
|
|
|
- mesa
|
2020-03-24 19:11:36 +08:00
|
|
|
script:
|
|
|
|
- .\.gitlab-ci\windows\mesa_container.ps1 $CI_REGISTRY $CI_REGISTRY_USER $CI_REGISTRY_PASSWORD $WINDOWS_IMAGE $WINDOWS_UPSTREAM_IMAGE
|
2020-05-20 05:01:47 +08:00
|
|
|
|
2020-03-24 19:11:36 +08:00
|
|
|
.use-windows_build_vs2019:
|
|
|
|
extends: .windows-docker-vs2019
|
|
|
|
image: "$WINDOWS_IMAGE"
|
|
|
|
needs:
|
2020-04-16 21:56:18 +08:00
|
|
|
- windows_build_vs2019
|
2020-10-22 23:58:35 +08:00
|
|
|
- check mr
|
2019-10-15 06:04:14 +08:00
|
|
|
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
git_archive:
|
|
|
|
extends: .fdo.container-build@alpine
|
2020-08-06 23:10:08 +08:00
|
|
|
stage: container
|
2020-07-07 21:02:35 +08:00
|
|
|
rules:
|
2020-09-08 23:44:40 +08:00
|
|
|
- if: *is-scheduled-pipeline
|
2020-07-07 21:02:35 +08:00
|
|
|
when: always
|
2020-08-06 23:37:33 +08:00
|
|
|
- if: *is-pre-merge
|
|
|
|
when: on_success
|
2020-10-27 01:05:49 +08:00
|
|
|
- changes: *all_paths
|
|
|
|
when: on_success
|
2020-08-06 23:37:33 +08:00
|
|
|
- if: *is-forked-branch
|
|
|
|
when: manual
|
|
|
|
# Other cases default to never
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
variables:
|
|
|
|
FDO_REPO_SUFFIX: &git-archive-suffix "alpine/git_archive"
|
2020-07-07 20:44:33 +08:00
|
|
|
FDO_DISTRIBUTION_EXEC: 'pip3 install git+http://gitlab.freedesktop.org/freedesktop/ci-templates@6f5af7e5574509726c79109e3c147cee95e81366'
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
# no need to pull the whole repo to build the container image
|
|
|
|
GIT_STRATEGY: none
|
2020-07-07 20:44:33 +08:00
|
|
|
FDO_DISTRIBUTION_TAG: &git-archive-tag "2020-07-07"
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
FDO_DISTRIBUTION_PACKAGES: git py3-pip
|
|
|
|
|
2020-08-06 23:37:33 +08:00
|
|
|
.use-git_archive:
|
|
|
|
extends: .fdo.suffixed-image@alpine
|
|
|
|
variables:
|
|
|
|
FDO_DISTRIBUTION_TAG: *git-archive-tag
|
|
|
|
FDO_REPO_SUFFIX: *git-archive-suffix
|
|
|
|
needs:
|
|
|
|
- git_archive
|
|
|
|
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
|
|
|
|
# Git archive
|
|
|
|
|
|
|
|
make git archive:
|
2020-08-06 23:37:33 +08:00
|
|
|
extends: .use-git_archive
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
stage: git-archive
|
2020-07-07 21:02:35 +08:00
|
|
|
rules:
|
2020-09-08 23:44:40 +08:00
|
|
|
- if: *is-scheduled-pipeline
|
2020-07-07 21:02:35 +08:00
|
|
|
when: on_success
|
CI: reduce bandwidth for git pull
Over the last 7 days, git pulls represented a total of 1.7 TB.
On those 1.7 TB, we can see:
- ~300 GB for the CI farm on hetzner
- ~730 GB for the CI farm on packet.net
- ~680 GB for the rest of the world
We can not really change the rest of the world*, but we can
certainly reduce the egress costs towards our CI farms.
Right now, the gitlab runners are not doing a good job at
caching the git trees for the various jobs we make, and
we end up with a lot of cache-misses. A typical pipeline
ends up with a good 2.8GB of git pull data. (a compressed
archive of the mesa folder accounts for 280MB)
In this patch, we implemented what was suggested in
https://gitlab.com/gitlab-org/gitlab/-/issues/215591#note_334642576
- we host a brand new MinIO server on packet
- jobs can upload files on 2 locations:
* git-cache/<namespace>/<project>/<branch-name>.tar.gz
* artifacts/<namespace>/<project>/<pipeline-id>/
- the authorization is handled by gitlab with short tokens
valid only for the time of the job is running
- whenever a job runs, the runner are configured to execute
(eval) $CI_PRE_CLONE_SCRIPT
- this variable is set globally to download the current cache
from the MinIO packet server, unpack it and replace the
possibly out of date cache found on the runner
- then git fetch is run by the runner, and only the delta
between the upstream tree and the local tree gets pulled.
We can rebuild the git cache in a schedule job (once a day
seems sufficient), and then we can stop the cache miss
entirely.
First results showed that instead of pulling 280MB of data
in my fork, I got a pull of only 250KB. That should help us.
* arguably, there are other farms in the rest of the world, so
hopefully we can change those too.
Reviewed-by: Michel Dänzer <mdaenzer@redhat.com>
Reviewed-by: Peter Hutterer <peter.hutterer@who-t.net>
Signed-off-by: Benjamin Tissoires <benjamin.tissoires@gmail.com>
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/5428>
2020-06-11 23:16:28 +08:00
|
|
|
# ensure we are running on packet
|
|
|
|
tags:
|
|
|
|
- packet.net
|
|
|
|
script:
|
|
|
|
# compress the current folder
|
|
|
|
- tar -cvzf ../$CI_PROJECT_NAME.tar.gz .
|
|
|
|
|
|
|
|
# login with the JWT token
|
|
|
|
- ci-fairy minio login $CI_JOB_JWT
|
|
|
|
- ci-fairy minio cp ../$CI_PROJECT_NAME.tar.gz minio://minio-packet.freedesktop.org/git-cache/$CI_PROJECT_NAMESPACE/$CI_PROJECT_NAME/$CI_PROJECT_NAME.tar.gz
|
|
|
|
|
|
|
|
|
2020-08-06 23:37:33 +08:00
|
|
|
# Sanity checks of MR settings and commit logs
|
|
|
|
.sanity-check:
|
|
|
|
extends: .use-git_archive
|
|
|
|
stage: sanity
|
|
|
|
artifacts:
|
|
|
|
when: on_failure
|
|
|
|
reports:
|
|
|
|
junit: check-*.xml
|
|
|
|
|
|
|
|
check mr:
|
|
|
|
extends: .sanity-check
|
|
|
|
rules:
|
2020-10-22 23:58:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-08-06 23:37:33 +08:00
|
|
|
- if: *is-pre-merge
|
|
|
|
when: on_success
|
2020-10-22 23:58:35 +08:00
|
|
|
- changes: *all_paths
|
|
|
|
when: on_success
|
2020-08-06 23:37:33 +08:00
|
|
|
# Other cases default to never
|
|
|
|
variables:
|
|
|
|
GIT_STRATEGY: none
|
|
|
|
script:
|
2020-10-22 23:58:35 +08:00
|
|
|
# Only run checks in pre-merge pipelines for MRs
|
|
|
|
- if test "x$CI_MERGE_REQUEST_SOURCE_BRANCH_NAME" != "x$CI_COMMIT_REF_NAME"; then exit 0; fi
|
2020-08-06 23:37:33 +08:00
|
|
|
- ci-fairy check-merge-request --require-allow-collaboration --junit-xml=check-merge-request.xml
|
|
|
|
|
2020-10-22 19:05:34 +08:00
|
|
|
.check commits:
|
2020-08-06 23:37:33 +08:00
|
|
|
extends: .sanity-check
|
|
|
|
rules:
|
|
|
|
- if: *is-pre-merge
|
|
|
|
when: on_success
|
|
|
|
- if: *is-forked-branch
|
|
|
|
when: manual
|
|
|
|
# Other cases default to never
|
|
|
|
script:
|
|
|
|
- ci-fairy check-commits --junit-xml=check-commits.xml
|
|
|
|
|
|
|
|
|
2019-01-20 19:26:53 +08:00
|
|
|
# BUILD
|
|
|
|
|
2019-10-24 05:21:31 +08:00
|
|
|
# Shared between windows and Linux
|
|
|
|
.build-common:
|
2019-10-15 06:52:58 +08:00
|
|
|
extends: .ci-run-policy
|
2020-07-21 22:13:37 +08:00
|
|
|
# Cancel job if a newer commit is pushed to the same branch
|
|
|
|
interruptible: true
|
2019-01-20 19:26:53 +08:00
|
|
|
artifacts:
|
2020-03-06 19:35:17 +08:00
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
2019-07-25 00:27:48 +08:00
|
|
|
when: always
|
|
|
|
paths:
|
|
|
|
- _build/meson-logs/*.txt
|
|
|
|
# scons:
|
2019-07-26 18:20:41 +08:00
|
|
|
- build/*/config.log
|
2019-04-11 06:59:12 +08:00
|
|
|
- shader-db
|
2019-10-24 05:21:31 +08:00
|
|
|
|
|
|
|
# Just Linux
|
|
|
|
.build-linux:
|
|
|
|
extends: .build-common
|
2019-04-05 00:01:27 +08:00
|
|
|
variables:
|
|
|
|
CCACHE_COMPILERCHECK: "content"
|
2019-11-20 16:11:35 +08:00
|
|
|
CCACHE_COMPRESS: "true"
|
|
|
|
CCACHE_DIR: /cache/mesa/ccache
|
2019-02-13 00:59:27 +08:00
|
|
|
# Use ccache transparently, and print stats before/after
|
|
|
|
before_script:
|
|
|
|
- export PATH="/usr/lib/ccache:$PATH"
|
|
|
|
- export CCACHE_BASEDIR="$PWD"
|
2019-11-20 16:11:35 +08:00
|
|
|
- ccache --show-stats
|
2019-02-13 00:59:27 +08:00
|
|
|
after_script:
|
|
|
|
- ccache --show-stats
|
2019-01-20 19:26:53 +08:00
|
|
|
|
2019-10-24 05:36:19 +08:00
|
|
|
.build-windows:
|
|
|
|
extends: .build-common
|
|
|
|
tags:
|
2020-03-24 19:11:36 +08:00
|
|
|
- windows
|
|
|
|
- docker
|
|
|
|
- "1809"
|
2020-03-30 22:58:51 +08:00
|
|
|
- mesa
|
2019-10-24 05:36:19 +08:00
|
|
|
cache:
|
|
|
|
key: ${CI_JOB_NAME}
|
|
|
|
paths:
|
|
|
|
- subprojects/packagecache
|
|
|
|
|
2019-01-20 19:26:53 +08:00
|
|
|
.meson-build:
|
2019-10-15 06:52:58 +08:00
|
|
|
extends:
|
2019-10-24 05:21:31 +08:00
|
|
|
- .build-linux
|
2019-11-14 00:43:41 +08:00
|
|
|
- .use-x86_build
|
2020-02-28 01:27:56 +08:00
|
|
|
stage: meson-x86_64
|
2019-12-13 18:02:16 +08:00
|
|
|
variables:
|
2020-10-06 08:49:00 +08:00
|
|
|
LLVM_VERSION: 10
|
2019-02-13 00:59:27 +08:00
|
|
|
script:
|
2019-05-03 16:49:43 +08:00
|
|
|
- .gitlab-ci/meson-build.sh
|
2019-01-20 19:26:53 +08:00
|
|
|
|
2019-01-23 23:46:10 +08:00
|
|
|
.scons-build:
|
2019-10-15 06:52:58 +08:00
|
|
|
extends:
|
2019-10-24 05:21:31 +08:00
|
|
|
- .build-linux
|
2019-11-14 00:43:41 +08:00
|
|
|
- .use-x86_build
|
2020-02-28 01:27:56 +08:00
|
|
|
stage: scons
|
2019-01-23 23:46:10 +08:00
|
|
|
script:
|
2020-06-27 01:59:41 +08:00
|
|
|
- env SCONSFLAGS="-j${FDO_CI_CONCURRENT:-4}" .gitlab-ci/scons-build.sh
|
2019-01-23 23:46:10 +08:00
|
|
|
|
2019-11-19 19:23:41 +08:00
|
|
|
meson-testing:
|
2019-09-06 23:35:52 +08:00
|
|
|
extends:
|
|
|
|
- .meson-build
|
|
|
|
- .ci-deqp-artifacts
|
2019-11-19 19:23:41 +08:00
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "enabled"
|
2019-11-19 19:23:41 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=dri
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gbm=enabled
|
|
|
|
-D egl=enabled
|
2019-06-25 22:44:16 +08:00
|
|
|
-D platforms=x11
|
2019-11-19 19:23:41 +08:00
|
|
|
GALLIUM_ST: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D dri3=enabled
|
2020-07-03 16:04:20 +08:00
|
|
|
GALLIUM_DRIVERS: "swrast,virgl,radeonsi"
|
2019-11-19 21:46:53 +08:00
|
|
|
VULKAN_DRIVERS: amd
|
2019-11-19 19:23:41 +08:00
|
|
|
BUILDTYPE: "debugoptimized"
|
2019-12-17 13:23:02 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D werror=true
|
2020-07-03 16:04:20 +08:00
|
|
|
UPLOAD_FOR_LAVA: 1
|
|
|
|
DEBIAN_ARCH: amd64
|
2019-11-19 19:23:41 +08:00
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/prepare-artifacts.sh
|
|
|
|
|
2020-09-29 06:40:13 +08:00
|
|
|
meson-clover-testing:
|
|
|
|
extends:
|
|
|
|
- .meson-build
|
|
|
|
- .ci-deqp-artifacts
|
|
|
|
variables:
|
|
|
|
UNWIND: "enabled"
|
|
|
|
LLVM_VERSION: 10
|
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=disabled
|
|
|
|
-D egl=disabled
|
|
|
|
-D gbm=disabled
|
|
|
|
GALLIUM_ST: >
|
|
|
|
-D gallium-opencl=icd
|
|
|
|
-D opencl-spirv=true
|
|
|
|
GALLIUM_DRIVERS: "swrast"
|
|
|
|
BUILDTYPE: "debugoptimized"
|
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/prepare-artifacts.sh
|
|
|
|
|
2020-03-12 19:29:40 +08:00
|
|
|
meson-gallium:
|
2019-11-19 19:23:41 +08:00
|
|
|
extends: .meson-build
|
2019-08-28 18:01:02 +08:00
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "enabled"
|
2019-08-28 18:01:02 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=dri
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gbm=enabled
|
|
|
|
-D egl=enabled
|
2019-06-25 22:44:16 +08:00
|
|
|
-D platforms=x11,wayland
|
2019-08-28 18:01:02 +08:00
|
|
|
GALLIUM_ST: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D dri3=enabled
|
2019-08-28 18:01:02 +08:00
|
|
|
-D gallium-extra-hud=true
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gallium-vdpau=enabled
|
|
|
|
-D gallium-xvmc=enabled
|
2019-08-28 18:01:02 +08:00
|
|
|
-D gallium-omx=bellagio
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gallium-va=enabled
|
|
|
|
-D gallium-xa=enabled
|
2019-08-28 18:01:02 +08:00
|
|
|
-D gallium-nine=true
|
|
|
|
-D gallium-opencl=disabled
|
2019-11-19 21:36:02 +08:00
|
|
|
GALLIUM_DRIVERS: "iris,nouveau,kmsro,r300,r600,freedreno,swr,swrast,svga,v3d,vc4,virgl,etnaviv,panfrost,lima,zink"
|
2020-06-19 14:40:27 +08:00
|
|
|
VULKAN_DRIVERS: swrast
|
2019-08-28 18:01:02 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D osmesa=gallium
|
|
|
|
-D tools=all
|
2020-07-08 11:56:51 +08:00
|
|
|
-D werror=true
|
2019-10-24 00:42:53 +08:00
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/run-shader-db.sh
|
2020-07-25 01:34:47 +08:00
|
|
|
- src/freedreno/.gitlab-ci/run-fdtools.sh
|
2019-08-28 18:01:02 +08:00
|
|
|
|
2020-08-25 01:15:35 +08:00
|
|
|
# Test a release build with -Werror so new warnings don't sneak in.
|
|
|
|
meson-release:
|
|
|
|
extends: .meson-build
|
|
|
|
variables:
|
|
|
|
UNWIND: "enabled"
|
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=dri
|
|
|
|
-D gbm=enabled
|
|
|
|
-D egl=enabled
|
|
|
|
-D platforms=x11,wayland
|
|
|
|
GALLIUM_ST: >
|
|
|
|
-D dri3=enabled
|
|
|
|
-D gallium-extra-hud=true
|
|
|
|
-D gallium-vdpau=enabled
|
|
|
|
-D gallium-xvmc=disabled
|
|
|
|
-D gallium-omx=disabled
|
|
|
|
-D gallium-va=enabled
|
|
|
|
-D gallium-xa=enabled
|
|
|
|
-D gallium-nine=false
|
|
|
|
-D gallium-opencl=disabled
|
|
|
|
-D llvm=false
|
|
|
|
GALLIUM_DRIVERS: "nouveau,kmsro,r300,svga,v3d,vc4,virgl,etnaviv,panfrost,lima,zink"
|
|
|
|
BUILDTYPE: "release"
|
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D osmesa=none
|
|
|
|
-D tools=all
|
|
|
|
-D werror=true
|
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
|
2020-03-12 19:29:40 +08:00
|
|
|
meson-classic:
|
|
|
|
extends: .meson-build
|
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "enabled"
|
2020-03-12 19:29:40 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=dri
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gbm=enabled
|
|
|
|
-D egl=enabled
|
2020-03-12 19:29:40 +08:00
|
|
|
-D platforms=x11,wayland,drm,surfaceless
|
|
|
|
DRI_DRIVERS: "auto"
|
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D osmesa=classic
|
|
|
|
-D tools=all
|
2020-07-03 11:10:09 +08:00
|
|
|
-D werror=true
|
2020-03-12 19:29:40 +08:00
|
|
|
|
2020-07-29 06:35:36 +08:00
|
|
|
meson-android:
|
2020-09-10 07:37:54 +08:00
|
|
|
extends:
|
|
|
|
- .meson-cross
|
|
|
|
- .use-android_build
|
2020-07-29 06:35:36 +08:00
|
|
|
variables:
|
|
|
|
UNWIND: "disabled"
|
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=disabled
|
|
|
|
-D gbm=disabled
|
|
|
|
-D egl=enabled
|
|
|
|
-D platforms=android
|
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D android-stub=true
|
2020-09-10 07:37:54 +08:00
|
|
|
-D llvm=disabled
|
2020-09-25 07:44:50 +08:00
|
|
|
-D platform-sdk-version=26
|
2020-07-29 06:35:36 +08:00
|
|
|
GALLIUM_ST: >
|
|
|
|
-D dri3=disabled
|
|
|
|
-D gallium-vdpau=disabled
|
|
|
|
-D gallium-xvmc=disabled
|
|
|
|
-D gallium-omx=disabled
|
|
|
|
-D gallium-va=disabled
|
|
|
|
-D gallium-xa=disabled
|
|
|
|
-D gallium-nine=false
|
|
|
|
-D gallium-opencl=disabled
|
2020-09-10 07:37:54 +08:00
|
|
|
LLVM_VERSION: ""
|
|
|
|
script:
|
|
|
|
# arm64 build: Can't build v3d/vc4 because they require expat for v3d_decode.
|
|
|
|
- PKG_CONFIG_PATH=/usr/local/lib/aarch64-linux-android/pkgconfig/:/android-ndk-r21d/toolchains/llvm/prebuilt/linux-x86_64/sysroot/usr/lib/aarch64-linux-android/pkgconfig/ CROSS=aarch64-linux-android GALLIUM_DRIVERS=etnaviv,freedreno,lima,panfrost VULKAN_DRIVERS=freedreno .gitlab-ci/meson-build.sh
|
|
|
|
# x86_64 build:
|
|
|
|
# Can't do Intel because gen_decoder.c currently requires libexpat, which
|
|
|
|
# is not a dependency that AOSP wants to accept. Can't do Radeon because
|
|
|
|
# it requires LLVM, which we don't have an Android build of.
|
|
|
|
# - PKG_CONFIG_PATH=/usr/local/lib/x86_64-linux-android/pkgconfig/ CROSS=x86_64-linux-android GALLIUM_DRIVERS=iris VULKAN_DRIVERS=intel .gitlab-ci/meson-build.sh
|
2020-07-29 06:35:36 +08:00
|
|
|
|
2019-09-13 17:59:43 +08:00
|
|
|
.meson-cross:
|
|
|
|
extends:
|
|
|
|
- .meson-build
|
2020-02-28 01:27:56 +08:00
|
|
|
stage: meson-misc
|
2019-09-13 17:59:43 +08:00
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "disabled"
|
2019-09-13 17:59:43 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gbm=disabled
|
|
|
|
-D egl=enabled
|
2019-06-25 20:47:04 +08:00
|
|
|
-D platforms=[]
|
2019-09-13 17:59:43 +08:00
|
|
|
-D osmesa=none
|
|
|
|
GALLIUM_ST: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D dri3=disabled
|
|
|
|
-D gallium-vdpau=disabled
|
|
|
|
-D gallium-xvmc=disabled
|
2019-09-13 17:59:43 +08:00
|
|
|
-D gallium-omx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gallium-va=disabled
|
|
|
|
-D gallium-xa=disabled
|
2019-09-13 17:59:43 +08:00
|
|
|
-D gallium-nine=false
|
2020-01-31 01:21:15 +08:00
|
|
|
LLVM_VERSION: "8"
|
2019-09-13 17:59:43 +08:00
|
|
|
|
2019-10-09 01:46:11 +08:00
|
|
|
.meson-arm:
|
2019-11-12 01:13:28 +08:00
|
|
|
extends:
|
|
|
|
- .meson-cross
|
|
|
|
- .use-arm_build
|
2020-10-22 23:58:35 +08:00
|
|
|
needs:
|
|
|
|
- arm_build
|
|
|
|
- check mr
|
2019-09-13 17:59:43 +08:00
|
|
|
variables:
|
2020-10-01 18:08:17 +08:00
|
|
|
VULKAN_DRIVERS: freedreno,broadcom
|
2019-10-09 01:48:41 +08:00
|
|
|
GALLIUM_DRIVERS: "etnaviv,freedreno,kmsro,lima,nouveau,panfrost,swrast,tegra,v3d,vc4"
|
2019-12-17 18:50:14 +08:00
|
|
|
BUILDTYPE: "debugoptimized"
|
2019-10-09 01:46:11 +08:00
|
|
|
tags:
|
|
|
|
- aarch64
|
|
|
|
|
|
|
|
meson-armhf:
|
2019-12-17 18:50:14 +08:00
|
|
|
extends:
|
|
|
|
- .meson-arm
|
|
|
|
- .ci-deqp-artifacts
|
2019-10-09 01:46:11 +08:00
|
|
|
variables:
|
|
|
|
CROSS: armhf
|
2019-10-09 01:48:41 +08:00
|
|
|
LLVM_VERSION: "7"
|
2020-02-25 02:31:33 +08:00
|
|
|
EXTRA_OPTION: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D llvm=disabled
|
2020-04-01 19:07:46 +08:00
|
|
|
UPLOAD_FOR_LAVA: 1
|
|
|
|
DEBIAN_ARCH: armhf
|
2019-12-17 18:50:14 +08:00
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/prepare-artifacts.sh
|
2019-09-13 17:59:43 +08:00
|
|
|
|
|
|
|
meson-arm64:
|
2019-10-09 01:46:11 +08:00
|
|
|
extends:
|
|
|
|
- .meson-arm
|
|
|
|
- .ci-deqp-artifacts
|
2019-09-13 17:59:43 +08:00
|
|
|
variables:
|
2020-10-01 18:08:17 +08:00
|
|
|
VULKAN_DRIVERS: "freedreno,broadcom"
|
2020-02-25 02:31:33 +08:00
|
|
|
EXTRA_OPTION: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D llvm=disabled
|
2020-04-01 19:07:46 +08:00
|
|
|
UPLOAD_FOR_LAVA: 1
|
|
|
|
DEBIAN_ARCH: arm64
|
2019-10-24 00:42:53 +08:00
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/prepare-artifacts.sh
|
2019-09-13 17:59:43 +08:00
|
|
|
|
2020-02-20 23:37:48 +08:00
|
|
|
meson-arm64-build-test:
|
|
|
|
extends:
|
|
|
|
- .meson-arm
|
|
|
|
- .ci-deqp-artifacts
|
|
|
|
variables:
|
|
|
|
VULKAN_DRIVERS: "amd"
|
2020-08-03 22:19:38 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-Dtools=panfrost
|
2020-10-20 02:54:24 +08:00
|
|
|
-D werror=true
|
2020-02-20 23:37:48 +08:00
|
|
|
script:
|
|
|
|
- .gitlab-ci/meson-build.sh
|
|
|
|
|
2019-03-20 22:58:31 +08:00
|
|
|
meson-clang:
|
|
|
|
extends: .meson-build
|
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "enabled"
|
2019-11-19 21:37:32 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glvnd=true
|
2019-03-20 22:58:31 +08:00
|
|
|
DRI_DRIVERS: "auto"
|
2020-09-22 18:00:18 +08:00
|
|
|
GALLIUM_DRIVERS: "iris,nouveau,kmsro,r300,r600,freedreno,swr,swrast,svga,v3d,vc4,virgl,etnaviv,panfrost,lima,zink,radeonsi,tegra"
|
2020-10-01 18:08:17 +08:00
|
|
|
VULKAN_DRIVERS: intel,amd,freedreno,broadcom
|
2020-10-06 08:49:00 +08:00
|
|
|
CC: "ccache clang-10"
|
|
|
|
CXX: "ccache clang++-10"
|
2019-03-20 22:58:31 +08:00
|
|
|
|
2020-08-29 02:08:39 +08:00
|
|
|
.meson-windows-vs2019:
|
2019-10-24 05:36:19 +08:00
|
|
|
extends:
|
|
|
|
- .build-windows
|
2020-03-24 19:11:36 +08:00
|
|
|
- .use-windows_build_vs2019
|
2020-02-28 01:27:56 +08:00
|
|
|
stage: meson-misc
|
2019-10-24 05:36:19 +08:00
|
|
|
script:
|
2020-03-24 19:11:36 +08:00
|
|
|
- . .\.gitlab-ci\windows\mesa_build.ps1
|
2019-10-24 05:36:19 +08:00
|
|
|
|
2019-05-04 00:19:25 +08:00
|
|
|
scons-win64:
|
|
|
|
extends: .scons-build
|
|
|
|
variables:
|
2020-03-28 18:36:28 +08:00
|
|
|
SCONS_TARGET: platform=windows machine=x86_64 debug=1
|
2019-05-04 00:19:25 +08:00
|
|
|
SCONS_CHECK_COMMAND: "true"
|
2020-03-28 18:36:28 +08:00
|
|
|
allow_failure: true
|
2019-01-21 17:42:37 +08:00
|
|
|
|
2019-05-03 16:58:48 +08:00
|
|
|
meson-clover:
|
2019-01-29 02:05:22 +08:00
|
|
|
extends: .meson-build
|
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "enabled"
|
2019-01-29 02:05:22 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D egl=disabled
|
|
|
|
-D gbm=disabled
|
2020-05-31 05:55:28 +08:00
|
|
|
GALLIUM_DRIVERS: "r600,radeonsi"
|
2019-01-29 02:05:22 +08:00
|
|
|
GALLIUM_ST: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D dri3=disabled
|
|
|
|
-D gallium-vdpau=disabled
|
|
|
|
-D gallium-xvmc=disabled
|
2019-01-29 02:05:22 +08:00
|
|
|
-D gallium-omx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gallium-va=disabled
|
|
|
|
-D gallium-xa=disabled
|
2019-01-29 02:05:22 +08:00
|
|
|
-D gallium-nine=false
|
|
|
|
-D gallium-opencl=icd
|
2019-05-03 16:58:48 +08:00
|
|
|
script:
|
2019-08-21 17:45:25 +08:00
|
|
|
- LLVM_VERSION=8 .gitlab-ci/meson-build.sh
|
2020-10-06 08:49:00 +08:00
|
|
|
- LLVM_VERSION=9 .gitlab-ci/meson-build.sh
|
|
|
|
- .gitlab-ci/meson-build.sh
|
2019-09-06 23:04:47 +08:00
|
|
|
|
2019-05-04 00:19:25 +08:00
|
|
|
meson-vulkan:
|
|
|
|
extends: .meson-build
|
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "disabled"
|
2019-05-04 00:19:25 +08:00
|
|
|
DRI_LOADERS: >
|
|
|
|
-D glx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gbm=disabled
|
|
|
|
-D egl=disabled
|
2019-06-25 22:44:16 +08:00
|
|
|
-D platforms=x11,wayland
|
2019-05-04 00:19:25 +08:00
|
|
|
-D osmesa=none
|
|
|
|
GALLIUM_ST: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-D dri3=enabled
|
|
|
|
-D gallium-vdpau=disabled
|
|
|
|
-D gallium-xvmc=disabled
|
2019-05-04 00:19:25 +08:00
|
|
|
-D gallium-omx=disabled
|
2020-05-20 05:01:47 +08:00
|
|
|
-D gallium-va=disabled
|
|
|
|
-D gallium-xa=disabled
|
2019-05-04 00:19:25 +08:00
|
|
|
-D gallium-nine=false
|
|
|
|
-D gallium-opencl=disabled
|
2019-09-25 18:56:58 +08:00
|
|
|
-D b_sanitize=undefined
|
|
|
|
-D c_args=-fno-sanitize-recover=all
|
|
|
|
-D cpp_args=-fno-sanitize-recover=all
|
|
|
|
UBSAN_OPTIONS: "print_stacktrace=1"
|
2020-10-01 18:08:17 +08:00
|
|
|
VULKAN_DRIVERS: intel,amd,freedreno,broadcom
|
2019-05-09 00:17:23 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D vulkan-overlay-layer=true
|
2020-06-03 21:25:12 +08:00
|
|
|
-D build-aco-tests=true
|
2019-12-17 13:23:02 +08:00
|
|
|
-D werror=true
|
2019-05-04 00:19:25 +08:00
|
|
|
|
2019-07-12 03:58:28 +08:00
|
|
|
meson-i386:
|
2020-06-02 01:08:30 +08:00
|
|
|
extends:
|
|
|
|
- .meson-cross
|
|
|
|
- .use-i386_build
|
2019-07-12 03:58:28 +08:00
|
|
|
variables:
|
2019-08-10 06:46:50 +08:00
|
|
|
CROSS: i386
|
2020-03-04 16:37:46 +08:00
|
|
|
VULKAN_DRIVERS: intel,amd
|
2020-03-12 19:31:05 +08:00
|
|
|
GALLIUM_DRIVERS: "iris,r300,radeonsi,swrast,virgl"
|
2019-07-12 03:58:28 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D vulkan-overlay-layer=true
|
2019-12-17 13:23:02 +08:00
|
|
|
-D werror=true
|
2019-07-12 03:58:28 +08:00
|
|
|
|
2020-01-31 01:21:15 +08:00
|
|
|
meson-s390x:
|
|
|
|
extends:
|
|
|
|
- .meson-cross
|
2020-06-02 01:08:30 +08:00
|
|
|
- .use-s390x_build
|
2020-03-19 01:41:43 +08:00
|
|
|
tags:
|
|
|
|
- kvm
|
2020-01-31 01:21:15 +08:00
|
|
|
variables:
|
|
|
|
CROSS: s390x
|
2020-05-23 22:07:53 +08:00
|
|
|
EXTRA_OPTION: >
|
|
|
|
-D werror=true
|
2020-01-31 01:21:15 +08:00
|
|
|
GALLIUM_DRIVERS: "swrast"
|
|
|
|
|
|
|
|
meson-ppc64el:
|
|
|
|
extends:
|
|
|
|
- meson-s390x
|
2020-06-02 01:08:30 +08:00
|
|
|
- .use-ppc64el_build
|
2020-01-31 01:21:15 +08:00
|
|
|
variables:
|
|
|
|
CROSS: ppc64el
|
2020-05-23 22:07:53 +08:00
|
|
|
EXTRA_OPTION: ""
|
2020-01-31 23:07:10 +08:00
|
|
|
GALLIUM_DRIVERS: "nouveau,radeonsi,swrast,virgl"
|
|
|
|
VULKAN_DRIVERS: "amd"
|
2020-01-31 01:21:15 +08:00
|
|
|
|
2019-10-12 00:04:14 +08:00
|
|
|
meson-mingw32-x86_64:
|
2019-09-20 01:21:51 +08:00
|
|
|
extends: .meson-build
|
2020-02-28 01:27:56 +08:00
|
|
|
stage: meson-misc
|
2019-09-20 01:21:51 +08:00
|
|
|
variables:
|
2020-05-20 05:01:47 +08:00
|
|
|
UNWIND: "disabled"
|
2019-09-20 01:21:51 +08:00
|
|
|
DRI_DRIVERS: ""
|
|
|
|
GALLIUM_DRIVERS: "swrast"
|
|
|
|
EXTRA_OPTION: >
|
2020-05-20 05:01:47 +08:00
|
|
|
-Dllvm=disabled
|
2019-09-20 01:21:51 +08:00
|
|
|
-Dosmesa=gallium
|
|
|
|
--cross-file=.gitlab-ci/x86_64-w64-mingw32
|
|
|
|
|
2019-11-18 16:30:27 +08:00
|
|
|
.test:
|
2019-10-15 06:53:15 +08:00
|
|
|
extends:
|
2019-10-22 23:16:52 +08:00
|
|
|
- .ci-run-policy
|
2020-07-21 22:13:37 +08:00
|
|
|
# Cancel job if a newer commit is pushed to the same branch
|
|
|
|
interruptible: true
|
2019-10-15 06:53:15 +08:00
|
|
|
variables:
|
2019-10-22 23:16:52 +08:00
|
|
|
GIT_STRATEGY: none # testing doesn't build anything from source
|
|
|
|
before_script:
|
2019-06-29 07:35:32 +08:00
|
|
|
# Note: Build dir (and thus install) may be dirty due to GIT_STRATEGY
|
|
|
|
- rm -rf install
|
|
|
|
- tar -xf artifacts/install.tar
|
2019-11-14 21:00:46 +08:00
|
|
|
- LD_LIBRARY_PATH=install/lib find install/lib -name "*.so" -print -exec ldd {} \;
|
2019-06-29 07:35:32 +08:00
|
|
|
artifacts:
|
2019-11-18 03:33:01 +08:00
|
|
|
when: always
|
2020-03-06 19:35:17 +08:00
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
2019-06-29 07:35:32 +08:00
|
|
|
paths:
|
|
|
|
- results/
|
2019-11-18 16:30:27 +08:00
|
|
|
|
2020-09-29 06:40:13 +08:00
|
|
|
.use-x86_test-gl:
|
2019-11-18 16:30:27 +08:00
|
|
|
extends:
|
|
|
|
- .test
|
|
|
|
variables:
|
|
|
|
TAG: *x86_test-gl
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/x86_test-gl:$TAG"
|
2019-10-22 17:19:17 +08:00
|
|
|
needs:
|
2019-11-18 16:15:12 +08:00
|
|
|
- x86_test-gl
|
2019-06-29 07:35:32 +08:00
|
|
|
|
2020-09-29 06:40:13 +08:00
|
|
|
.test-gl:
|
|
|
|
extends:
|
|
|
|
- .use-x86_test-gl
|
|
|
|
needs:
|
|
|
|
- x86_test-gl
|
|
|
|
- meson-testing
|
|
|
|
|
2019-11-18 16:30:27 +08:00
|
|
|
.test-vk:
|
|
|
|
extends:
|
|
|
|
- .test
|
|
|
|
variables:
|
|
|
|
TAG: *x86_test-vk
|
|
|
|
image: "$CI_REGISTRY_IMAGE/debian/x86_test-vk:$TAG"
|
|
|
|
needs:
|
|
|
|
- meson-testing
|
|
|
|
- x86_test-vk
|
|
|
|
|
2020-09-29 06:40:13 +08:00
|
|
|
.test-cl:
|
|
|
|
extends:
|
|
|
|
- .use-x86_test-gl
|
|
|
|
needs:
|
|
|
|
- x86_test-gl
|
|
|
|
- meson-clover-testing
|
|
|
|
|
2019-10-22 23:16:52 +08:00
|
|
|
.piglit-test:
|
2019-10-31 03:39:08 +08:00
|
|
|
extends:
|
|
|
|
- .test-gl
|
|
|
|
- .llvmpipe-rules
|
2019-11-26 01:42:10 +08:00
|
|
|
artifacts:
|
|
|
|
when: on_failure
|
2020-03-06 19:35:17 +08:00
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
2019-11-26 01:42:10 +08:00
|
|
|
paths:
|
|
|
|
- summary/
|
2019-10-22 23:16:52 +08:00
|
|
|
variables:
|
|
|
|
LIBGL_ALWAYS_SOFTWARE: 1
|
|
|
|
PIGLIT_NO_WINDOW: 1
|
|
|
|
script:
|
2020-03-24 19:58:30 +08:00
|
|
|
- install/piglit/run.sh
|
2019-10-22 23:16:52 +08:00
|
|
|
|
2020-09-29 06:40:13 +08:00
|
|
|
piglit-cl:
|
|
|
|
extends:
|
|
|
|
- .piglit-test
|
|
|
|
- .test-cl
|
2020-10-27 15:42:15 +08:00
|
|
|
- .llvmpipe-cl-rules
|
2020-09-29 06:40:13 +08:00
|
|
|
variables:
|
|
|
|
LP_CL: 1
|
|
|
|
LP_NUM_THREADS: 1
|
|
|
|
PIGLIT_PROFILES: cl
|
|
|
|
PIGLIT_OPTIONS: >
|
2020-10-27 13:25:24 +08:00
|
|
|
-x bswap -x phatk -x clz-optimizations
|
2020-09-29 06:40:13 +08:00
|
|
|
script:
|
|
|
|
- install/piglit/run_cl.sh
|
|
|
|
|
2019-10-22 23:16:52 +08:00
|
|
|
piglit-quick_gl:
|
|
|
|
extends: .piglit-test
|
|
|
|
variables:
|
|
|
|
LP_NUM_THREADS: 0
|
|
|
|
PIGLIT_OPTIONS: >
|
2019-12-03 17:45:28 +08:00
|
|
|
--process-isolation false
|
2019-12-05 08:13:38 +08:00
|
|
|
-x egl_ext_device_
|
|
|
|
-x egl_ext_platform_device
|
2020-01-22 07:23:39 +08:00
|
|
|
-x ext_timer_query@time-elapsed
|
2019-10-22 23:16:52 +08:00
|
|
|
-x glx-multithread-clearbuffer
|
|
|
|
-x glx-multithread-shader-compile
|
|
|
|
-x max-texture-size
|
|
|
|
-x maxsize
|
|
|
|
PIGLIT_PROFILES: quick_gl
|
|
|
|
|
2019-12-03 17:45:28 +08:00
|
|
|
piglit-glslparser:
|
|
|
|
extends: .piglit-test
|
|
|
|
variables:
|
|
|
|
LP_NUM_THREADS: 0
|
|
|
|
PIGLIT_PROFILES: glslparser
|
|
|
|
|
|
|
|
piglit-quick_shader:
|
2019-10-22 23:16:52 +08:00
|
|
|
extends: .piglit-test
|
|
|
|
variables:
|
|
|
|
LP_NUM_THREADS: 1
|
2019-12-03 17:45:28 +08:00
|
|
|
PIGLIT_PROFILES: quick_shader
|
2019-10-22 23:16:52 +08:00
|
|
|
|
2019-11-19 15:39:00 +08:00
|
|
|
.deqp-test:
|
2019-10-22 23:16:52 +08:00
|
|
|
variables:
|
|
|
|
DEQP_SKIPS: deqp-default-skips.txt
|
|
|
|
script:
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/deqp-runner.sh
|
2019-10-22 23:16:52 +08:00
|
|
|
|
2019-11-19 15:39:00 +08:00
|
|
|
.deqp-test-gl:
|
|
|
|
extends:
|
|
|
|
- .test-gl
|
|
|
|
- .deqp-test
|
|
|
|
|
|
|
|
.deqp-test-vk:
|
|
|
|
extends:
|
|
|
|
- .test-vk
|
|
|
|
- .deqp-test
|
|
|
|
variables:
|
|
|
|
DEQP_VER: vk
|
|
|
|
|
2020-02-26 16:33:14 +08:00
|
|
|
.fossilize-test:
|
|
|
|
extends: .test-vk
|
|
|
|
script:
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/fossilize-runner.sh
|
2020-06-25 17:21:12 +08:00
|
|
|
artifacts:
|
|
|
|
when: on_failure
|
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
|
|
|
paths:
|
|
|
|
- results/
|
2020-02-26 16:33:14 +08:00
|
|
|
|
2020-03-04 01:17:12 +08:00
|
|
|
llvmpipe-gles2:
|
2019-06-29 07:35:32 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles2
|
2020-06-27 01:59:41 +08:00
|
|
|
# Don't use threads inside llvmpipe, we've already got all cores
|
|
|
|
# busy at the deqp-runner level.
|
ci: Use cts_runner for our dEQP runs.
This runner is a little project by Bas, written in C++, that spawns
threads that then loop grabbing chunks of the (randomly shuffled but
consistently so) test list and hand it to a dEQP instance. As the
remaining list gets shorter, so do the chunks, so hopefully the
threads all complete effectively at once. It also handles restarting
after crashes automatically. I've extended the runner a bit to do
what I was doing in the bash scripts before, like the skip list and
expected failures handling. This project should also be a good
baseline for extending to handle retesting of intermittent failures.
By switching to it, we can have the swrast tests just take up one job
slot on the shared runners and keep their allotment of CPUs busy,
instead of taking up job slots with single-threaded dEQP jobs. It
will also let us (eventually, once I reprovision) switch the freedreno
runners over to threading within the job instead of running concurrent
jobs, so that memory scribbles in one pipeline don't affect unrelated
pipelines, and I can experiment with their parallelism (particularly
on a306 where we are frequently backed up) without trashing other
people's jobs.
What we lose in this process is per-test output in the log (not a big
loss, I think, since we summarize fails at the end and reducing log
length keeps chrome from choking on our logs so badly). We also drop
the renderer sanity checking, since it's not saving qpa files for us
to go poke through. Given that all the drivers involved have fail
lists, if we got the wrong renderer somehow, we'd get a job failure
anyway.
v2: Rebase on droppong of the autoscale cluster and the arm64
build/test split. Use a script to deduplicate the cts-runner
build.
v3: Rebase on the amd64 build/test container split.
Acked-by: Daniel Stone <daniels@collabora.com> (v1)
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> (v2)
2019-11-05 02:54:41 +08:00
|
|
|
LP_NUM_THREADS: 0
|
2019-06-29 07:35:32 +08:00
|
|
|
DEQP_EXPECTED_FAILS: deqp-llvmpipe-fails.txt
|
|
|
|
LIBGL_ALWAYS_SOFTWARE: "true"
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: llvmpipe
|
2019-10-31 03:39:08 +08:00
|
|
|
extends:
|
|
|
|
- .deqp-test-gl
|
|
|
|
- .llvmpipe-rules
|
2019-08-10 01:32:40 +08:00
|
|
|
|
2020-03-04 01:17:12 +08:00
|
|
|
softpipe-gles2:
|
2019-10-31 03:39:08 +08:00
|
|
|
extends:
|
|
|
|
- llvmpipe-gles2
|
|
|
|
- .softpipe-rules
|
2019-08-10 01:32:40 +08:00
|
|
|
variables:
|
|
|
|
DEQP_EXPECTED_FAILS: deqp-softpipe-fails.txt
|
ci: Use cts_runner for our dEQP runs.
This runner is a little project by Bas, written in C++, that spawns
threads that then loop grabbing chunks of the (randomly shuffled but
consistently so) test list and hand it to a dEQP instance. As the
remaining list gets shorter, so do the chunks, so hopefully the
threads all complete effectively at once. It also handles restarting
after crashes automatically. I've extended the runner a bit to do
what I was doing in the bash scripts before, like the skip list and
expected failures handling. This project should also be a good
baseline for extending to handle retesting of intermittent failures.
By switching to it, we can have the swrast tests just take up one job
slot on the shared runners and keep their allotment of CPUs busy,
instead of taking up job slots with single-threaded dEQP jobs. It
will also let us (eventually, once I reprovision) switch the freedreno
runners over to threading within the job instead of running concurrent
jobs, so that memory scribbles in one pipeline don't affect unrelated
pipelines, and I can experiment with their parallelism (particularly
on a306 where we are frequently backed up) without trashing other
people's jobs.
What we lose in this process is per-test output in the log (not a big
loss, I think, since we summarize fails at the end and reducing log
length keeps chrome from choking on our logs so badly). We also drop
the renderer sanity checking, since it's not saving qpa files for us
to go poke through. Given that all the drivers involved have fail
lists, if we got the wrong renderer somehow, we'd get a job failure
anyway.
v2: Rebase on droppong of the autoscale cluster and the arm64
build/test split. Use a script to deduplicate the cts-runner
build.
v3: Rebase on the amd64 build/test container split.
Acked-by: Daniel Stone <daniels@collabora.com> (v1)
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com> (v2)
2019-11-05 02:54:41 +08:00
|
|
|
DEQP_SKIPS: deqp-softpipe-skips.txt
|
2020-10-30 01:29:28 +08:00
|
|
|
DEQP_FLAKES: deqp-softpipe-flakes.txt
|
2019-08-10 01:32:40 +08:00
|
|
|
GALLIUM_DRIVER: "softpipe"
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: softpipe
|
2019-08-10 01:32:40 +08:00
|
|
|
|
2020-03-04 01:17:12 +08:00
|
|
|
softpipe-gles3:
|
2019-08-10 01:32:40 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
2020-03-04 01:17:12 +08:00
|
|
|
extends: softpipe-gles2
|
2019-11-06 02:31:29 +08:00
|
|
|
|
2020-03-04 01:17:12 +08:00
|
|
|
softpipe-gles31:
|
2020-07-21 22:36:28 +08:00
|
|
|
parallel: 2
|
2019-11-06 02:31:29 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles31
|
2020-03-04 01:17:12 +08:00
|
|
|
extends: softpipe-gles2
|
2019-06-29 07:35:32 +08:00
|
|
|
|
2020-08-26 04:43:27 +08:00
|
|
|
# Note that KHR-GL3* test sets include all tests from the previous
|
|
|
|
# version, so we only need to run one test list (unlike dEQP-GLES,
|
|
|
|
# where the test sets are separate).
|
|
|
|
softpipe-gl:
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gl33
|
|
|
|
extends:
|
|
|
|
- softpipe-gles2
|
|
|
|
|
2020-05-12 16:18:48 +08:00
|
|
|
virgl-gles2-on-gl:
|
2020-04-01 15:17:25 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles2
|
|
|
|
DEQP_NO_SAVE_RESULTS: 1
|
2020-08-18 01:47:16 +08:00
|
|
|
DEQP_SKIPS: deqp-virgl-gl-skips.txt
|
2020-06-27 01:59:41 +08:00
|
|
|
# Don't use threads inside llvmpipe, we've already got all cores
|
|
|
|
# busy at the deqp-runner level.
|
2020-04-01 15:17:25 +08:00
|
|
|
LP_NUM_THREADS: 0
|
2020-05-12 16:18:48 +08:00
|
|
|
DEQP_EXPECTED_FAILS: deqp-virgl-gl-fails.txt
|
|
|
|
DEQP_OPTIONS: "--deqp-log-images=disable"
|
2020-04-01 15:17:25 +08:00
|
|
|
LIBGL_ALWAYS_SOFTWARE: "true"
|
|
|
|
GALLIUM_DRIVER: "virpipe"
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: virgl
|
2020-04-01 15:17:25 +08:00
|
|
|
extends:
|
|
|
|
- .deqp-test-gl
|
|
|
|
- .virgl-rules
|
|
|
|
|
2020-05-12 16:18:48 +08:00
|
|
|
virgl-gles3-on-gl:
|
2020-04-01 15:17:25 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
2020-05-12 16:18:48 +08:00
|
|
|
DEQP_RUNNER_OPTIONS: "--timeout 180"
|
|
|
|
extends: virgl-gles2-on-gl
|
2020-04-01 15:17:25 +08:00
|
|
|
|
2020-05-12 16:18:48 +08:00
|
|
|
virgl-gles31-on-gl:
|
2020-07-21 22:36:28 +08:00
|
|
|
parallel: 2
|
2020-04-21 20:51:59 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles31
|
|
|
|
MESA_GLES_VERSION_OVERRIDE: "3.1"
|
|
|
|
MESA_GLSL_VERSION_OVERRIDE: "310"
|
2020-06-04 10:10:40 +08:00
|
|
|
MESA_EXTENSION_OVERRIDE: "-GL_OES_tessellation_shader"
|
2020-05-12 16:18:48 +08:00
|
|
|
extends: virgl-gles3-on-gl
|
2020-04-21 20:51:59 +08:00
|
|
|
|
2020-05-13 15:46:06 +08:00
|
|
|
virgl-gl30-on-gl:
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gl30
|
|
|
|
extends: virgl-gles2-on-gl
|
|
|
|
|
|
|
|
virgl-gl31-on-gl:
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gl31
|
|
|
|
extends: virgl-gles2-on-gl
|
|
|
|
|
|
|
|
virgl-gl32-on-gl:
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gl32
|
|
|
|
extends: virgl-gles2-on-gl
|
|
|
|
|
2020-03-20 02:45:01 +08:00
|
|
|
# Rules for tests that should not be present in MRs or the main
|
|
|
|
# project's pipeline (don't block marge or report red on
|
|
|
|
# mesa/mesamaster) but should be present on pipelines in personal
|
|
|
|
# branches (so you can opt in to running the flaky test when you want
|
|
|
|
# to).
|
|
|
|
.test-manual:
|
|
|
|
rules:
|
2020-07-07 21:02:35 +08:00
|
|
|
- *ignore_scheduled_pipelines
|
2020-09-08 23:52:24 +08:00
|
|
|
- if: *is-forked-branch
|
2020-04-11 21:32:02 +08:00
|
|
|
changes:
|
|
|
|
*all_paths
|
|
|
|
when: manual
|
|
|
|
- when: never
|
2020-03-20 02:45:01 +08:00
|
|
|
|
2020-05-12 16:18:48 +08:00
|
|
|
virgl-gles2-on-gles:
|
|
|
|
variables:
|
|
|
|
VIRGL_HOST_API: GLES
|
|
|
|
DEQP_EXPECTED_FAILS: deqp-virgl-gles-fails.txt
|
|
|
|
extends:
|
|
|
|
- virgl-gles2-on-gl
|
|
|
|
- .test-manual
|
|
|
|
|
|
|
|
virgl-gles3-on-gles:
|
|
|
|
variables:
|
|
|
|
VIRGL_HOST_API: GLES
|
|
|
|
DEQP_EXPECTED_FAILS: deqp-virgl-gles-fails.txt
|
|
|
|
extends:
|
|
|
|
- virgl-gles3-on-gl
|
|
|
|
- .test-manual
|
|
|
|
|
|
|
|
virgl-gles31-on-gles:
|
|
|
|
variables:
|
|
|
|
VIRGL_HOST_API: GLES
|
|
|
|
DEQP_EXPECTED_FAILS: deqp-virgl-gles-fails.txt
|
|
|
|
extends:
|
|
|
|
- virgl-gles31-on-gl
|
|
|
|
- .test-manual
|
|
|
|
|
2020-02-13 03:31:24 +08:00
|
|
|
arm64_a630_gles2:
|
2019-11-12 01:13:28 +08:00
|
|
|
extends:
|
2020-05-16 02:22:37 +08:00
|
|
|
- arm64_a306_gles2
|
2019-06-29 07:35:32 +08:00
|
|
|
variables:
|
2020-05-16 02:22:37 +08:00
|
|
|
BM_KERNEL: /lava-files/cheza-kernel
|
|
|
|
BM_CMDLINE: "ip=dhcp console=ttyMSM0,115200n8 root=/dev/nfs rw nfsrootdebug nfsroot=,tcp,nfsvers=4.2 init=/init"
|
2019-06-29 07:35:32 +08:00
|
|
|
DEQP_EXPECTED_FAILS: deqp-freedreno-a630-fails.txt
|
2020-08-20 01:43:54 +08:00
|
|
|
DEQP_FLAKES: deqp-freedreno-a630-flakes.txt
|
2020-10-01 01:20:22 +08:00
|
|
|
DEQP_SKIPS: deqp-freedreno-a630-skips.txt
|
2020-06-09 06:36:16 +08:00
|
|
|
GIT_STRATEGY: none
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: FD630
|
2020-05-16 02:22:37 +08:00
|
|
|
DEQP_NO_SAVE_RESULTS: ""
|
2020-10-01 01:20:22 +08:00
|
|
|
VK_DRIVER: freedreno
|
2019-06-29 07:35:32 +08:00
|
|
|
tags:
|
2020-05-16 02:22:37 +08:00
|
|
|
- google-freedreno-cheza
|
|
|
|
script:
|
2020-06-09 06:36:16 +08:00
|
|
|
- ./install/bare-metal/cros-servo.sh
|
2019-06-29 07:35:32 +08:00
|
|
|
|
2020-02-13 03:31:24 +08:00
|
|
|
arm64_a630_gles31:
|
|
|
|
extends: arm64_a630_gles2
|
2019-06-29 07:35:32 +08:00
|
|
|
variables:
|
2019-09-12 00:55:43 +08:00
|
|
|
DEQP_VER: gles31
|
2019-06-29 07:35:32 +08:00
|
|
|
|
2020-02-13 03:31:24 +08:00
|
|
|
arm64_a630_gles3:
|
|
|
|
extends: arm64_a630_gles2
|
2019-06-29 07:35:32 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
|
|
|
|
2020-07-17 05:20:22 +08:00
|
|
|
arm64_a630_traces:
|
2020-06-09 05:51:59 +08:00
|
|
|
extends:
|
|
|
|
- arm64_a630_gles2
|
|
|
|
variables:
|
|
|
|
BARE_METAL_TEST_SCRIPT: "/install/tracie-runner-gl.sh"
|
|
|
|
DEVICE_NAME: "freedreno-a630"
|
2020-08-05 16:17:26 +08:00
|
|
|
DRIVER_NAME: "freedreno"
|
2020-06-09 05:51:59 +08:00
|
|
|
TRACIE_NO_UNIT_TESTS: 1
|
2020-07-31 14:13:15 +08:00
|
|
|
TRACIE_UPLOAD_TO_MINIO: 1
|
2020-06-09 05:51:59 +08:00
|
|
|
# This lets us run several more traces which don't use any features we're
|
|
|
|
# missing.
|
|
|
|
MESA_GLSL_VERSION_OVERRIDE: "460"
|
|
|
|
MESA_GL_VERSION_OVERRIDE: "4.6"
|
2020-09-04 19:20:39 +08:00
|
|
|
artifacts:
|
|
|
|
reports:
|
|
|
|
junit: results/junit.xml
|
2020-06-09 05:51:59 +08:00
|
|
|
|
2020-08-28 00:28:53 +08:00
|
|
|
arm64_a630_gl:
|
|
|
|
extends: arm64_a630_gles2
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gl30
|
|
|
|
|
2020-11-07 06:06:26 +08:00
|
|
|
arm64_a630_gles_others:
|
|
|
|
extends: arm64_a630_gles2
|
2020-09-02 08:14:51 +08:00
|
|
|
variables:
|
2020-11-07 06:06:26 +08:00
|
|
|
BARE_METAL_TEST_SCRIPT: "/install/bare-metal/arm64_a630_gles_others.sh"
|
2020-09-02 08:14:51 +08:00
|
|
|
|
2020-07-14 22:58:56 +08:00
|
|
|
arm64_a630_vk:
|
2020-05-26 03:57:25 +08:00
|
|
|
extends: arm64_a630_gles2
|
2020-10-01 01:20:22 +08:00
|
|
|
parallel: 2
|
2020-05-26 03:57:25 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: vk
|
2020-10-01 01:20:22 +08:00
|
|
|
DEQP_FRACTION: 10
|
2020-05-26 03:57:25 +08:00
|
|
|
# Force binning in the main run, which makes sure we render at
|
|
|
|
# least 2 bins. This is the path that impacts the most different
|
|
|
|
# features. However, we end up with flaky results in
|
|
|
|
# dEQP-VK.binding_model.*.geometry and dEQP-VK.glsl.*_vertex.
|
|
|
|
TU_DEBUG: forcebin
|
|
|
|
|
|
|
|
# Do a separate sysmem pass over the testcases that really affect sysmem
|
|
|
|
# rendering. This is currently very flaky, leave it as an option for devs
|
|
|
|
# to click play on in their branches.
|
2020-07-17 05:20:22 +08:00
|
|
|
arm64_a630_vk_sysmem:
|
2020-05-26 03:57:25 +08:00
|
|
|
extends:
|
2020-10-01 01:20:22 +08:00
|
|
|
- arm64_a630_gles2
|
2020-05-26 03:57:25 +08:00
|
|
|
variables:
|
2020-10-01 01:20:22 +08:00
|
|
|
DEQP_VER: vk
|
|
|
|
DEQP_FRACTION: 15
|
2020-05-26 03:57:25 +08:00
|
|
|
DEQP_CASELIST_FILTER: "dEQP-VK.renderpass.*"
|
|
|
|
DEQP_EXPECTED_FAILS: deqp-freedreno-a630-bypass-fails.txt
|
|
|
|
TU_DEBUG: sysmem
|
|
|
|
|
2020-03-04 06:38:09 +08:00
|
|
|
.baremetal-test:
|
|
|
|
extends:
|
|
|
|
- .ci-run-policy
|
2020-06-09 06:09:51 +08:00
|
|
|
- .test
|
2020-07-21 22:13:37 +08:00
|
|
|
# Cancel job if a newer commit is pushed to the same branch
|
|
|
|
interruptible: true
|
2020-03-04 06:38:09 +08:00
|
|
|
stage: test
|
2020-05-16 02:22:37 +08:00
|
|
|
artifacts:
|
|
|
|
when: always
|
|
|
|
name: "mesa_${CI_JOB_NAME}"
|
|
|
|
paths:
|
|
|
|
- results/
|
|
|
|
- serial*.txt
|
2020-03-04 06:38:09 +08:00
|
|
|
|
2020-03-04 03:44:45 +08:00
|
|
|
arm64_a306_gles2:
|
2020-03-04 06:38:09 +08:00
|
|
|
extends:
|
|
|
|
- .baremetal-test
|
2020-06-08 05:19:50 +08:00
|
|
|
- .use-arm64_test
|
2020-03-19 00:51:03 +08:00
|
|
|
- .freedreno-rules
|
2020-03-04 03:44:45 +08:00
|
|
|
variables:
|
2020-03-04 06:38:09 +08:00
|
|
|
BM_KERNEL: /lava-files/Image.gz
|
2020-03-04 06:38:09 +08:00
|
|
|
BM_DTB: /lava-files/apq8016-sbc.dtb
|
|
|
|
BM_ROOTFS: /lava-files/rootfs-arm64
|
|
|
|
BM_CMDLINE: "ip=dhcp console=ttyMSM0,115200n8"
|
2020-05-02 00:57:00 +08:00
|
|
|
FLAKES_CHANNEL: "#freedreno-ci"
|
2020-06-09 06:09:51 +08:00
|
|
|
BARE_METAL_TEST_SCRIPT: "/install/deqp-runner.sh"
|
2020-03-04 03:44:45 +08:00
|
|
|
DEQP_EXPECTED_FAILS: deqp-freedreno-a307-fails.txt
|
2020-08-20 01:43:54 +08:00
|
|
|
DEQP_SKIPS: deqp-default-skips.txt
|
|
|
|
DEQP_FLAKES: deqp-freedreno-a307-flakes.txt
|
2020-03-04 06:38:09 +08:00
|
|
|
DEQP_VER: gles2
|
|
|
|
DEQP_PARALLEL: 4
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: FD307
|
2020-05-23 06:48:55 +08:00
|
|
|
# Since we can't get artifacts back yet, skip making them.
|
|
|
|
DEQP_NO_SAVE_RESULTS: 1
|
2020-03-04 06:38:09 +08:00
|
|
|
script:
|
2020-06-09 06:36:16 +08:00
|
|
|
- ./install/bare-metal/fastboot.sh
|
2020-03-04 06:38:09 +08:00
|
|
|
needs:
|
2020-06-08 05:19:50 +08:00
|
|
|
- arm64_test
|
2020-03-04 06:38:09 +08:00
|
|
|
- meson-arm64
|
2020-03-04 03:44:45 +08:00
|
|
|
tags:
|
2020-03-04 06:38:09 +08:00
|
|
|
- google-freedreno-db410c
|
|
|
|
|
2020-05-16 02:20:44 +08:00
|
|
|
# Fractional run, single threaded, due to flaky results
|
2020-03-20 02:45:01 +08:00
|
|
|
arm64_a306_gles3:
|
2020-03-04 06:38:09 +08:00
|
|
|
extends:
|
|
|
|
- arm64_a306_gles2
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
2020-04-23 02:30:38 +08:00
|
|
|
DEQP_PARALLEL: 1
|
2020-11-07 07:55:24 +08:00
|
|
|
DEQP_FRACTION: 25
|
2020-03-04 03:44:45 +08:00
|
|
|
|
2020-05-16 07:15:07 +08:00
|
|
|
# Fractional runs with debug options. Note that since we're not
|
|
|
|
# hitting the iommu faults, we can run in parallel (derive from gles2, not gles3).
|
|
|
|
arm64_a306_gles3_options:
|
|
|
|
extends: arm64_a306_gles2
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
|
|
|
script:
|
|
|
|
# Check that the non-constbuf UBO case works.
|
2020-06-09 06:36:16 +08:00
|
|
|
- DEQP_RUN_SUFFIX=-nouboopt IR3_SHADER_DEBUG=nouboopt DEQP_CASELIST_FILTER="functional.*ubo" ./install/bare-metal/fastboot.sh
|
2020-05-16 07:15:07 +08:00
|
|
|
|
2020-10-17 08:20:11 +08:00
|
|
|
.arm64_a530_deqp:
|
2020-03-04 06:38:09 +08:00
|
|
|
extends:
|
|
|
|
- arm64_a306_gles2
|
|
|
|
variables:
|
|
|
|
BM_KERNEL: /lava-files/db820c-kernel
|
|
|
|
BM_DTB: /lava-files/db820c.dtb
|
2020-05-20 07:33:10 +08:00
|
|
|
# Disable SMP because only CPU 0 is at a freq higher than 19mhz on
|
|
|
|
# current upstream kernel.
|
|
|
|
BM_CMDLINE: "ip=dhcp console=ttyMSM0,115200n8 nosmp"
|
2020-03-04 06:38:09 +08:00
|
|
|
DEQP_EXPECTED_FAILS: deqp-freedreno-a530-fails.txt
|
2020-08-20 01:43:54 +08:00
|
|
|
DEQP_FLAKES: deqp-freedreno-a530-flakes.txt
|
2020-04-18 03:39:32 +08:00
|
|
|
DEQP_EXPECTED_RENDERER: FD530
|
2020-03-04 06:38:09 +08:00
|
|
|
tags:
|
|
|
|
- google-freedreno-db820c
|
|
|
|
|
2020-10-17 08:20:11 +08:00
|
|
|
arm64_a530_gles2:
|
|
|
|
extends:
|
|
|
|
- .arm64_a530_deqp
|
|
|
|
parallel: 2
|
|
|
|
|
2020-03-04 06:38:09 +08:00
|
|
|
arm64_a530_gles3:
|
|
|
|
extends:
|
2020-10-17 08:20:11 +08:00
|
|
|
- .arm64_a530_deqp
|
2020-03-04 06:38:09 +08:00
|
|
|
variables:
|
|
|
|
DEQP_VER: gles3
|
2020-04-23 02:30:38 +08:00
|
|
|
DEQP_PARALLEL: 1
|
2020-11-07 07:55:24 +08:00
|
|
|
DEQP_FRACTION: 40
|
2020-03-04 06:38:09 +08:00
|
|
|
|
2020-04-23 03:08:06 +08:00
|
|
|
arm64_a530_gles31:
|
|
|
|
extends:
|
|
|
|
- arm64_a530_gles3
|
|
|
|
variables:
|
|
|
|
DEQP_VER: gles31
|
2020-11-07 07:55:24 +08:00
|
|
|
DEQP_FRACTION: 10
|
2020-04-23 03:08:06 +08:00
|
|
|
|
2019-11-13 18:03:52 +08:00
|
|
|
# RADV CI
|
|
|
|
.test-radv:
|
2020-03-10 00:53:51 +08:00
|
|
|
extends: .radv-rules
|
2020-03-06 15:39:25 +08:00
|
|
|
stage: radv
|
2019-11-13 18:03:52 +08:00
|
|
|
variables:
|
|
|
|
VK_DRIVER: radeon
|
2020-05-04 17:44:45 +08:00
|
|
|
ACO_DEBUG: validateir,validatera
|
2020-02-06 00:04:20 +08:00
|
|
|
|
2020-03-20 02:45:01 +08:00
|
|
|
# Can only be triggered manually on personal branches because RADV is the only
|
|
|
|
# driver that does Vulkan testing at the moment.
|
2019-11-13 18:03:52 +08:00
|
|
|
radv_polaris10_vkcts:
|
|
|
|
extends:
|
|
|
|
- .deqp-test-vk
|
2020-03-20 02:45:01 +08:00
|
|
|
- .test-radv
|
|
|
|
- .test-manual
|
2019-11-13 18:03:52 +08:00
|
|
|
variables:
|
|
|
|
DEQP_SKIPS: deqp-radv-polaris10-skips.txt
|
|
|
|
tags:
|
|
|
|
- polaris10
|
2020-01-08 23:46:46 +08:00
|
|
|
|
2020-03-06 15:36:14 +08:00
|
|
|
radv-fossils:
|
|
|
|
extends:
|
|
|
|
- .fossilize-test
|
|
|
|
- .test-radv
|
|
|
|
script:
|
2020-05-04 17:48:46 +08:00
|
|
|
# Pitcairn (GFX6)
|
|
|
|
- export RADV_FORCE_FAMILY="pitcairn"
|
|
|
|
- ./install/fossilize-runner.sh
|
|
|
|
# Bonaire (GFX7)
|
|
|
|
- export RADV_FORCE_FAMILY="bonaire"
|
|
|
|
- ./install/fossilize-runner.sh
|
|
|
|
# Polaris10 (GFX8)
|
2020-03-06 15:36:14 +08:00
|
|
|
- export RADV_FORCE_FAMILY="polaris10"
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/fossilize-runner.sh
|
2020-05-04 17:48:46 +08:00
|
|
|
# Vega10 (GFX9)
|
2020-03-06 15:36:14 +08:00
|
|
|
- export RADV_FORCE_FAMILY="gfx900"
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/fossilize-runner.sh
|
2020-05-04 17:48:46 +08:00
|
|
|
# Navi10 (GFX10)
|
2020-03-06 15:36:14 +08:00
|
|
|
- export RADV_FORCE_FAMILY="gfx1010"
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/fossilize-runner.sh
|
2020-08-10 19:29:14 +08:00
|
|
|
# Sienna Cichlid (GFX10)
|
|
|
|
- export RADV_FORCE_FAMILY="gfx1030"
|
|
|
|
- ./install/fossilize-runner.sh
|
2020-02-06 00:04:20 +08:00
|
|
|
|
2020-02-21 00:26:30 +08:00
|
|
|
# Traces CI
|
2020-01-08 23:46:46 +08:00
|
|
|
.traces-test:
|
|
|
|
cache:
|
|
|
|
key: ${CI_JOB_NAME}
|
|
|
|
paths:
|
2020-02-28 20:48:53 +08:00
|
|
|
- traces-db/
|
2020-07-21 16:48:43 +08:00
|
|
|
variables:
|
|
|
|
TRACIE_UPLOAD_TO_MINIO: 1
|
2020-09-04 17:44:53 +08:00
|
|
|
artifacts:
|
|
|
|
reports:
|
|
|
|
junit: results/junit.xml
|
2020-02-21 00:26:30 +08:00
|
|
|
|
|
|
|
.traces-test-gl:
|
|
|
|
extends:
|
|
|
|
- .test-gl
|
|
|
|
- .traces-test
|
2020-01-08 23:46:46 +08:00
|
|
|
script:
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/tracie-runner-gl.sh
|
2020-02-21 00:26:30 +08:00
|
|
|
|
|
|
|
.traces-test-vk:
|
|
|
|
extends:
|
|
|
|
- .test-vk
|
|
|
|
- .traces-test
|
|
|
|
script:
|
2020-03-24 19:58:30 +08:00
|
|
|
- ./install/tracie-runner-vk.sh
|
2020-01-08 23:46:46 +08:00
|
|
|
|
|
|
|
llvmpipe-traces:
|
2019-10-31 03:39:08 +08:00
|
|
|
extends:
|
|
|
|
- .traces-test-gl
|
|
|
|
- .llvmpipe-rules
|
2020-01-08 23:46:46 +08:00
|
|
|
variables:
|
|
|
|
LIBGL_ALWAYS_SOFTWARE: "true"
|
|
|
|
GALLIUM_DRIVER: "llvmpipe"
|
2020-02-20 23:32:08 +08:00
|
|
|
DEVICE_NAME: "gl-vmware-llvmpipe"
|
2020-08-05 16:17:26 +08:00
|
|
|
DRIVER_NAME: "llvmpipe"
|
2020-02-21 00:26:30 +08:00
|
|
|
|
|
|
|
radv-polaris10-traces:
|
|
|
|
extends:
|
|
|
|
- .traces-test-vk
|
2020-03-20 02:45:01 +08:00
|
|
|
- .test-radv
|
|
|
|
- .test-manual
|
2020-02-21 00:26:30 +08:00
|
|
|
variables:
|
|
|
|
DEVICE_NAME: "vk-amd-polaris10"
|
2020-08-05 16:17:26 +08:00
|
|
|
DRIVER_NAME: "radv"
|
2020-02-21 00:26:30 +08:00
|
|
|
tags:
|
|
|
|
- polaris10
|
2020-04-21 21:44:03 +08:00
|
|
|
|
2020-04-25 00:32:42 +08:00
|
|
|
radv-raven-traces:
|
|
|
|
extends:
|
|
|
|
- .traces-test-vk
|
|
|
|
- .test-radv
|
|
|
|
- .test-manual
|
|
|
|
variables:
|
|
|
|
DEVICE_NAME: "vk-amd-raven"
|
2020-08-05 16:17:26 +08:00
|
|
|
DRIVER_NAME: "radv"
|
2020-04-25 00:32:42 +08:00
|
|
|
tags:
|
|
|
|
- raven
|
|
|
|
|
2020-04-21 21:44:03 +08:00
|
|
|
virgl-traces:
|
|
|
|
extends:
|
|
|
|
- .traces-test-gl
|
|
|
|
- .virgl-rules
|
|
|
|
variables:
|
|
|
|
LIBGL_ALWAYS_SOFTWARE: "true"
|
|
|
|
GALLIUM_DRIVER: "virpipe"
|
|
|
|
DEVICE_NAME: "gl-virgl"
|
2020-08-05 16:17:26 +08:00
|
|
|
DRIVER_NAME: "virgl"
|
2020-04-21 21:44:03 +08:00
|
|
|
MESA_GLES_VERSION_OVERRIDE: "3.1"
|
|
|
|
MESA_GLSL_VERSION_OVERRIDE: "310"
|