Skip to content

🌱 Add prometheus to e2e workflow #1928

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

dtfranz
Copy link
Contributor

@dtfranz dtfranz commented Apr 17, 2025

Description

Closes #1902 and #1903

Adds prometheus to the test-e2e Makefile target, which stands up a barebones prometheus scraper to gather metrics from the operator-controller and catalogd pods during the e2e test run. When finished, the prometheus server is queried for a raw output of the metrics and stores it in ARTIFACTS_PATH/metrics.out. These metrics will be analyzed in a later PR.

Reviewer Checklist

  • API Go Documentation
  • Tests: Unit Tests (and E2E Tests, if appropriate)
  • Comprehensive Commit Messages
  • Links to related GitHub Issue(s)

@dtfranz dtfranz requested a review from a team as a code owner April 17, 2025 16:24
@openshift-ci openshift-ci bot requested review from bentito and gavinmbell April 17, 2025 16:24
Copy link

netlify bot commented Apr 17, 2025

Deploy Preview for olmv1 ready!

Name Link
🔨 Latest commit 90c6b46
🔍 Latest deploy log https://app.netlify.com/projects/olmv1/deploys/684ad8958c8328000810ef5e
😎 Deploy Preview https://deploy-preview-1928--olmv1.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

codecov bot commented Apr 17, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 69.26%. Comparing base (44de6f2) to head (90c6b46).
Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1928      +/-   ##
==========================================
+ Coverage   69.21%   69.26%   +0.04%     
==========================================
  Files          79       79              
  Lines        7037     7051      +14     
==========================================
+ Hits         4871     4884      +13     
  Misses       1885     1885              
- Partials      281      282       +1     
Flag Coverage Δ
e2e 42.94% <ø> (-0.12%) ⬇️
unit 60.17% <ø> (+0.10%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@tmshort
Copy link
Contributor

tmshort commented Apr 18, 2025

So, this adds a new e2e that isn't run downstream? There's no workflow to run it in upstream CI?

@dtfranz
Copy link
Contributor Author

dtfranz commented Apr 21, 2025

So, this adds a new e2e that isn't run downstream? There's no workflow to run it in upstream CI?

Yes - it currently only adds prometheus to the environment when you run the new e2e target, so I've kept the workflow the same for now. If you'd prefer I'm happy to make that change here - it doesn't add much overhead to the e2e at all.

@dtfranz dtfranz force-pushed the prometheus-e2e branch 2 times, most recently from 6c32ce6 to b51c814 Compare April 25, 2025 01:50
@dtfranz dtfranz force-pushed the prometheus-e2e branch 2 times, most recently from 2daa74b to e8b18c9 Compare June 2, 2025 07:40
@dtfranz dtfranz force-pushed the prometheus-e2e branch 3 times, most recently from bb99737 to b7e65a7 Compare June 11, 2025 04:18
egress:
- {} # Allows all egress traffic for metrics requests
ingress:
- {} # Allows us to query prometheus
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I understand that we need this NP to allow us to get data from Prometheus integrate it with Grafana and etc. So, I am OK with 👍

camilamacedo86
camilamacedo86 previously approved these changes Jun 12, 2025
Copy link
Contributor

@camilamacedo86 camilamacedo86 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dtfranz

Thank you for the nice work. 🎉

I understand that we will need to improve it in the long run and that is just teh first step for we have the targets and quick start.

So, I just added a nit: #1928 (comment) but otherwise I am OK with it. LGTM

We might also want to have a second look and help from @tmshort too

@openshift-ci openshift-ci bot added lgtm Indicates that a PR is ready to be merged. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Jun 12, 2025
@camilamacedo86 camilamacedo86 dismissed their stale review June 12, 2025 08:05

failing on the e2e tests

Copy link

openshift-ci bot commented Jun 12, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from camilamacedo86. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot removed the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jun 12, 2025
@dtfranz
Copy link
Contributor Author

dtfranz commented Jun 12, 2025

I reran it and it passed, seems a test flaked 🫤

Adds prometheus to the test-e2e Makefile target, which stands up a barebones prometheus scraper to gather metrics from the operator-controller and catalogd pods during the e2e test run. When finished, the prometheus server is queried for a raw output of the metrics and stores it in metrics.out. These metrics will be analyzed in a later PR.

Signed-off-by: Daniel Franz <[email protected]>
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Jun 12, 2025
Copy link

openshift-ci bot commented Jun 12, 2025

New changes are detected. LGTM label has been removed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Install Prometheus on e2e cluster
5 participants