load balancing
termnetworkingcloud
Spreading incoming work across several servers so no one server is overwhelmed.
A load balancer distributes requests by some policy, round robin, least connections, or a health-aware rule, giving both capacity and resilience: if one backend fails, traffic shifts to the rest. It is the workhorse behind almost every scalable service.
Also known as: load-balancing, load balancer, SLB