Back to projects

API Gateway Redesign

completed

Redesigned the API gateway layer to support 10x traffic growth with improved observability and rate limiting.

API DesignEnvoygRPCRedisOpenTelemetry
View DemoSource Code

Overview

Replaced a legacy NGINX-based API gateway with an Envoy-based solution that supports gRPC, WebSockets, and advanced traffic management.

Technical Highlights

  • Envoy proxy with custom WASM filters for auth and rate limiting
  • Distributed tracing via OpenTelemetry across all services
  • Sliding window rate limiter backed by Redis Cluster

Outcomes

  • Handled 10x traffic increase during Black Friday
  • Reduced inter-service latency by 40%
  • Zero-downtime configuration updates