Skip to content

Allow sidecar to trigger pcap dump based on Cloud Logging entry #40

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jefsg opened this issue Apr 14, 2025 · 0 comments
Open

Allow sidecar to trigger pcap dump based on Cloud Logging entry #40

jefsg opened this issue Apr 14, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@jefsg
Copy link

jefsg commented Apr 14, 2025

Problem: Oftentimes an issue we want to troubleshoot is not easily triggered and can be weeks between occurrences. Keeping a pcap sidecar actively pushing captures into cloud logging for weeks might become expensive.

Potential solution:

If the sidecar could dump the last X minutes of buffered packet capture data when any container on the same instance logged a given text/json payload, it would allow for these longer term sidecar deployments to debug such intermittent issues.

We would want to be able to configure at least:

  • Length of time to buffer captures (potentially also maximum size of that buffered data - warning log if the max size is reached)
  • Length of time to continue dumping capture data after the triggering event (default to above buffer length)
  • What log message to watch for (usually the error text that we expect the main container to output) - This could be read via shared volume for logging, or a streaming read from cloud logging
  • Might benefit from a safety config to prevent accidental multiple triggers from causing large logging bills - i.e if the trigger event occurred continuously for a week before being looked at.
@thomasmburke thomasmburke added the enhancement New feature or request label Apr 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants