Simple, effective load balancing

Imagine you have a set of nodes to allocate work to.

Rather than choosing a random node, choose 2 random nodes and use the one with the minimum load.

Big improvement going from 1 to 2 random nodes. Much smaller improvement going from 2 to 3, and so on.