Message Queue
Massive buffer holding 200 requests. Place after Firewall to
smooth DDoS spikes, or before Compute to prevent overload. Cheap
insurance against traffic bursts.
Flow: Firewall → Queue → Load Balancer or Load Balancer → Queue
→ Compute
Memory Cache
Caching layer with 35-65% hit rate. Cache hits complete
instantly without hitting DB/Storage. Upgrade tiers for higher
hit rates. Great for reducing DB costs.
Flow: Compute → Cache → DB/Storage
API Gateway
Rate limits incoming traffic. When requests exceed the rate limit,
excess requests are throttled with only -0.2 reputation loss (vs -1.0 for failures).
Upgrade tiers to increase rate limit (20/40/80 RPS).
Flow: Internet → API GW → ALB or WAF → API GW → ALB
NoSQL Database
Faster and cheaper than SQL for READ/WRITE traffic (150ms vs 300ms processing).
Cannot handle SEARCH queries — keep SQL DB for those.
Upgrade tiers for higher capacity (15/30/50).
Flow: Compute → NoSQL or Compute → Cache → NoSQL