Patent 10963296 was granted and assigned to Amazon on March, 2021 by the United States Patent and Trademark Office.
Techniques for load balancing based on relative credit balances are described. For example, one embodiment of a method comprises: determining current credit balances for a plurality of compute instances; receiving a request; selecting one of the compute instances to be a destination for the request based on a comparison of the current credit balances; and transmitting the request to the selected compute instance.