Smooth weighted round-robin balancing(github.com) |
Smooth weighted round-robin balancing(github.com) |
I generally use leastconn with haproxy (obvious why this isn't ideal, but it was better than pure RR) as some our posts either take 10ms or 5500ms
Since the change reduces the peak load you get lower 99% latencies and thus need fewer machines to achieve the same 99% latency on servers