You can schedule jobs across the two racks, with any given job only using one rack, by specifying #SBATCH --partition rack1,rack2 It'll only use 1 partition, in order of priority (not liti I never found a way for topology to do that - all I could get it to do is to prefer to keep things within a single switch, but not to require it.
Noam