Back to project details
completed
API Gateway Redesign
High-performance gateway built on Envoy with advanced traffic management.
LIVE TRAFFIC DASHBOARD
~10x
Traffic increase handled
40%
Latency reduction
0ms
Config reload downtime
100%
Black Friday uptime
Request Flow
Client
gRPC / HTTP / WebSocket
Envoy Proxy
WASM Filters · Auth · Rate Limiting
Auth Service
JWT validation
Rate Limiter
Redis Cluster
Router
Path matching
Upstream A
Service 1
Upstream B
Service 2
Rate Limiting Algorithm
Sliding window counter
Per-user and per-API-key buckets
Configurable burst allowance
Backed by Redis Cluster
Observability
OpenTelemetry tracing across all hops
Structured JSON access logs
Prometheus metrics endpoint
Grafana dashboards for SLIs
Before vs After
| Metric | NGINX (Before) | Envoy (After) |
|---|---|---|
| Protocol Support | HTTP/1.1 only | HTTP/2, gRPC, WebSocket |
| Config Reload | Requires restart | Zero-downtime via xDS |
| Rate Limiting | Fixed window | Sliding window |
| Extensibility | Lua scripts | WASM filters (Rust/Go) |
| Tracing | Manual + log-based | Native OpenTelemetry |