Skip to content

Deflake test_collection.py #639

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Aug 19, 2025
Merged

Deflake test_collection.py #639

merged 1 commit into from
Aug 19, 2025

Conversation

mateusz834
Copy link

Current tests perform read operations twice and assert based on previous results. This approach is inherently flaky because some background operations in Splunk can modify data between reads.

This change, wraps every test case in assertEventuallyTrue.

@mateusz834 mateusz834 force-pushed the dev/MP/deflake-collection branch 2 times, most recently from 8e75140 to 719f4c2 Compare August 19, 2025 08:52
@mateusz834 mateusz834 marked this pull request as ready for review August 19, 2025 09:19
Copy link

@cecyliaborek cecyliaborek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

makes sense to me 👌

@mateusz834 mateusz834 force-pushed the dev/MP/deflake-collection branch 2 times, most recently from 635415e to 3fde468 Compare August 19, 2025 11:23
Current tests perform read operations twice and assert based on
previous results. This approach is inherently flaky because
some background operations in Splunk can modify data between reads.

This change, wraps every test case in assertEventuallyTrue.
@mateusz834 mateusz834 force-pushed the dev/MP/deflake-collection branch from 3fde468 to a12f605 Compare August 19, 2025 11:24
@Ickerday Ickerday closed this Aug 19, 2025
@Ickerday Ickerday deleted the dev/MP/deflake-collection branch August 19, 2025 11:38
@Ickerday Ickerday restored the dev/MP/deflake-collection branch August 19, 2025 11:39
@Ickerday Ickerday reopened this Aug 19, 2025
@Ickerday
Copy link
Collaborator

(mistakenly removed the branch in git)

@mateusz834 mateusz834 merged commit 1c25e27 into develop Aug 19, 2025
21 of 22 checks passed
@mateusz834 mateusz834 deleted the dev/MP/deflake-collection branch August 19, 2025 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants