US Patent 12112212 Controlling system load based on memory bandwidth

Methods, systems, and apparatus, including computer-readable storage media for load. A load balancer can input data to the plurality of computing devices configured to process the input data according to a load-balancing distribution. The load balancer can receive from a first computing device of the plurality of computing devices, data characterizing memory bandwidth for a memory device on the first computing device and over a period of time. The load balancer can determine, at least from the data characterizing the memory bandwidth and a memory bandwidth saturation point for the first computing device, that the first computing device can process additional data within a predetermined latency threshold. In response to the determining, the load balancer can send the additional data to the first computing device.