Skip to content

Add Allure reports to Garnet Github #1457

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
darrenge wants to merge 101 commits into
base: main
Choose a base branch
from
Draft

Add Allure reports to Garnet Github #1457

darrenge wants to merge 101 commits into from

Conversation

@darrenge
Copy link
Collaborator

@darrenge darrenge commented Dec 2, 2025 •
edited
Loading

Full test reporting using Allure (https://github.com/allure-framework).

  • Update Nightly GH action to use Allure for all tests
  • Create base class for tests to use so Allure can categorize
  • Make it so each test combination (Net8/Win22/Rel etc) counts as 1 test and not a series of retries
  • Update easy tests to use base class (where quick and easy addition of base class)
  • Save history to another branch so it can be kept to keep a test history (branch allure_data_history; folder:test/Allure/history).
  • Set it up so allure_report is copied to web site (website/static/allure)
  • Update readme on the front of Garnet Github site so it is a link next to BDN link
  • Update tsav tests to Allure
  • Update Garnet tests to Allure
  • Update Cluster tests to Allure
  • Clean up debug parts (history data, code etc)
  • Document Allure process in Teams Channel
  • Implement a pre CI that checks that all tests are Allure enabled
  • History grows by 2-3 MB for each run. Look into truncation methods

@darrenge
Scripts running successfully on local machine. Next step is to get th…
31b4e44 
…em running in GH action
@darrenge
First attempt at running things in a github action nightly run - usin…
633ccf9 
…g mock data for allure results for now
@darrenge
Merge branch 'main' into darrenge/AllureReports
062911d
@darrenge
Changed how allure being installed
03b81c8
@darrenge
Added Allure to path
1c8e081
@darrenge
Path issue ...
a238546
@darrenge
Had test data in wrong spot so wasn't checkd in
a2a29d0
@darrenge
Fix the final stage
41f5a53
@darrenge
Fixed some paths that had collisions
cc314f8
@darrenge
Fixing another path collision
1ff81db
@darrenge
Updated pipeline-success at the end as
5b7abfb
@darrenge
case sensitive issue with running script
dc5d9dc
@darrenge
Add debug code
d29145d
@darrenge
Need add check out
9ddca67
@darrenge
Updated how Allure report generation is called
3ddd6e0
@darrenge
Need to install Alure in the final step areas as well
b5248b1
@darrenge
Remove part about saving history and also don't run tests as not need…
c48e607 
…ed since mock data
@darrenge
Move results
1789f84
@darrenge
Fixing path issue
868a38f
@darrenge
Getting results in couple configs of tests ... bump up matrix by addi…
6f695f8 
…ng debug and cluster tests
@darrenge
Full matrix
1851f9a
@darrenge
Adding Allure CLI install to work on Linux too
c51b1b6
@darrenge
Trying debug while allure not installing on linux
fcd27ce
@darrenge
More debugging
035bb5f
@darrenge
More debugging
c8b24ad
@darrenge
More debugging
798d9ae
@darrenge
Install Allure CLI should work now
037ab83
@darrenge
Fix the Copy of Mock data on linux
2482d53
@darrenge
More changes to work on linux
688772b
@darrenge
Fixed upload artifacts call
4f22e4c
@darrenge
Debugging the copy of previous history
7ce7e68
@darrenge
Hoping this fixes the copy from previous history.
4252179
@darrenge
Debuggin the copy prev results
a837eab
@darrenge
Debugging copy from branch
dd9a419
@darrenge
More debugging
7511368
@darrenge
More debugging
2c399f1
@darrenge
Might have it ...
3876d8e
@darrenge
Cleaning up debug info
51cb0d0
@darrenge
History is working. Move report to GH Website location so front page …
985a0d9 
…can see it
@darrenge
Adding full test matrix to it now -- see how history handles it
46743b6
@darrenge
Making it work for Tsavorite
e0e9a62
@darrenge
Fixed bug in output
c99ab2c
@darrenge
Fixed Tsav nightly bug AND also updated readme.md so that there is an…
0a187fb 
… Allure Report button on the front
@darrenge
Merge branch 'main' into darrenge/AllureReports
22ea6fa
@darrenge
Tsav working in Allure now ... running cluster to make sure all those…
3115a00 
… picked up properly.
@darrenge
Cluster seems to run ok ... now full matrix
7caca75
@darrenge
Comment out uploading Allure test results to artifacts as hitting upp…
6823ab3 
…er ceiling
@darrenge
Just Tsav tests to test history
66efbd9
@darrenge
Fixed Format issues
e3f67a9
@darrenge
Fix format issues with Tsav tests
8fe9023
@darrenge
Changing naming method for Allure tests.
ff882e5
@darrenge
Copy link
Collaborator Author

darrenge commented Dec 2, 2025

Too many pushes to this is doing too many CI runs. Will close it out and reopen it in the future.

@darrenge darrenge closed this Dec 2, 2025
@darrenge darrenge reopened this Dec 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@badrishc badrishc Awaiting requested review from badrishc badrishc will be requested when the pull request is marked ready for review badrishc is a code owner

@TedHartMS TedHartMS Awaiting requested review from TedHartMS TedHartMS will be requested when the pull request is marked ready for review TedHartMS is a code owner

@TalZaccai TalZaccai Awaiting requested review from TalZaccai TalZaccai will be requested when the pull request is marked ready for review TalZaccai is a code owner

Copilot code review Copilot Awaiting requested review from Copilot Copilot will automatically review once the pull request is marked ready for review

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@darrenge