Pinned Loading

1. kubernetes-sigs/inference-perf kubernetes-sigs/inference-perf Public

   GenAI inference performance benchmarking tool

   Python 74 29

2. kubernetes-sigs/wg-serving kubernetes-sigs/wg-serving Public

   WG Serving

   Shell 29 17

3. llm-d-benchmark llm-d-benchmark Public

   Forked from llm-d/llm-d-benchmark

   llm-d benchmark scripts and tooling

   Shell

4. open-telemetry/semantic-conventions open-telemetry/semantic-conventions Public

   Defines standards for generating consistent, accessible telemetry across a variety of domains

   Open Policy Agent 409 255

5. kubernetes/cloud-provider-gcp kubernetes/cloud-provider-gcp Public

   cloud-provider-gcp contains several projects used to run Kubernetes in Google Cloud

   Go 135 238

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 55.1k 9.4k