Platform & DevOps·Running it: capacity, failure and recovery
each customer is assigned a random pair of workers rather than one, so two customers rarely share both and one bad tenant cannot take out everyone.
Shuffle sharding
Also calledshuffle sharded assignment, virtual sharding
Assigning each tenant a random subset of workers, so that any two tenants overlap only partially. With modest numbers it makes the probability of two given tenants sharing an entire subset very small, which means a tenant that poisons its workers damages only a tiny fraction of the others. It is one of the highest-leverage ideas in multi-tenant reliability and it costs essentially nothing but assignment logic.