@@ -16,9 +16,9 @@ workloads using [OpenTelemetry](https://opentelemetry.io/) with
16
16
[ Prometheus] ( https://prometheus.io/ ) for metrics collection, and
17
17
[ Grafana] ( https://grafana.com/ ) for visualization.
18
18
19
- By the end, you'll have a complete, industry-standard observability
20
- observability solution that captures detailed traces and metrics, giving you
21
- visibility into your MCP server performance and usage patterns.
19
+ By the end, you'll have a complete, industry-standard observability solution
20
+ that captures detailed traces and metrics, giving you visibility into your MCP
21
+ server performance and usage patterns.
22
22
23
23
<ThemedImage
24
24
alt = ' Grafana dashboard showing MCP telemetry'
@@ -121,18 +121,22 @@ The architecture for each deployment method:
121
121
graph TB
122
122
A[AI client]
123
123
THV[ToolHive CLI]
124
- MCP[MCP server<br>containers]
125
- OTEL[OTel Collector]
126
- J[Jaeger]
127
- P[Prometheus]
128
- G[Grafana]
129
-
130
- A -- HTTP --> MCP
131
- THV -. manages .-> MCP
132
- THV -- OpenTelemetry data --> OTEL
124
+ Proxy[Proxy process]
125
+ subgraph Docker[**Docker**]
126
+ MCP[MCP server<br>container]
127
+ OTEL[OTel Collector]
128
+ J[Jaeger]
129
+ P[Prometheus]
130
+ G[Grafana]
131
+ end
132
+
133
+ THV -. manages .-> MCP & Proxy
134
+ Proxy -- HTTP or stdio --> MCP
135
+ Proxy -- OpenTelemetry data --> OTEL
133
136
OTEL -- traces --> J
134
137
OTEL -- metrics --> P
135
138
G -- visualization --> P
139
+ A -- HTTP --> Proxy
136
140
```
137
141
138
142
Your setup will include:
@@ -148,21 +152,23 @@ Your setup will include:
148
152
``` mermaid
149
153
graph TB
150
154
A[AI client]
151
- THV[ToolHive Operator]
152
- MCP[MCP server pods]
153
- OTEL[OTel Collector]
154
- J[Jaeger]
155
- P[Prometheus]
156
- G[Grafana]
157
-
158
- A -- HTTP<br>via ingress --> MCP
159
155
subgraph K8s[**K8s Cluster**]
160
- THV -. manages .-> MCP
161
- THV -- OpenTelemetry data --> OTEL
162
- OTEL -- traces --> J
163
- OTEL -- metrics --> P
164
- G -- visualization --> P
156
+ THV[ToolHive Operator]
157
+ Proxy[Proxyrunner pod]
158
+ MCP[MCP server pod]
159
+ OTEL[OTel Collector]
160
+ J[Jaeger]
161
+ P[Prometheus]
162
+ G[Grafana]
165
163
end
164
+
165
+ A -- HTTP<br>via ingress --> Proxy
166
+ THV -. manages .-> Proxy
167
+ Proxy -. manages .-> MCP
168
+ Proxy -- OpenTelemetry data --> OTEL
169
+ OTEL -- traces --> J
170
+ OTEL -- metrics --> P
171
+ G -- visualization --> P
166
172
```
167
173
168
174
Your setup will include:
0 commit comments