1
0
mirror of https://github.com/RIOT-OS/RIOT.git synced 2025-01-17 04:52:59 +01:00

murdock: introduce 'TEST_ON_CI_BLACKLIST'

Introduce a variable to set that a test is blacklisted.

This is a move toward enabling tests by default and adding a blacklisting
reason instead for a board instead of not whitelisting them which hides
the problem.

Currently, a test should be both whitelisted and blacklisted at the same
time to have a meaning. It is planned to whitelist all by default in
an upcoming pull request.
This commit is contained in:
Gaëtan Harter 2019-06-25 18:45:59 +02:00
parent 5d2c57f858
commit 45a318269d
No known key found for this signature in database
GPG Key ID: 76DF6BCF1B1F883B

View File

@ -25,12 +25,19 @@ test-murdock:
# Testing is enabled if all the following conditions are met:
#
# * the board is whitelisted
# * the board is not blacklisted (by default none)
# * the board has enough memory and the executable is being linked
#
# TEST_ON_CI_WHITELIST can be empty, a board list or 'all'
# TEST_ON_CI_WHITELIST and TEST_ON_CI_BLACKLIST can be empty, a board list or 'all'
#
# Prefer blacklisting boards that fail to whitelisting the ones that work.
# It will help tracking what is failing.
#
# Disabling a test in some case must be justified to keep track of the reason.
TEST_ON_CI_WHITELIST ?=
TEST_ON_BOARD_ENABLED ?= $(filter $(TEST_ON_CI_WHITELIST:all=%),$(BOARD))
TEST_ON_CI_BLACKLIST ?=
TEST_ON_BOARD_ENABLED ?= $(filter-out $(TEST_ON_CI_BLACKLIST:all=%),$(filter $(TEST_ON_CI_WHITELIST:all=%),$(BOARD)))
TEST_ON_CI_ENABLED ?= $(if $(RIOTNOLINK),,$(TEST_ON_BOARD_ENABLED))