system-tests improvments: simpler CI definition; Report to test optimization #4996
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
It achieves two tasks :
tracer_releasescenario group:October 9th, a new version of the WAF has been pushed to dd-trace-rb. Turns out that this version was not passing a test (APPSEC-59579). But dd-trace-rb CI was running this test against the weblog
rails70, which was removed at this time, so the issue was not seen during the PR. It showed that running a subset of scenarios/weblog is prone to errors like that, wihtout mentionning that it adds some maintenance on this list.-> By using
tracer_release, the scenario and weblog list is delegated to system-tests, keeping the maintenance level to its minimum here. If for some reason set of scenario/weblog shall not be run, it will be addressed directly in system-tests.CI impact : the current pipeline takes ~16'30
The new pipeline :
Change log entry
None.
Additional Notes:
How to test the change?