Hi Sean,
unfortunately, the CPU_IDs and GPU IDX given by "scontrol -d show
job JOBID" are not related in any way to the ordering of the
hardware. It seems to be just the sequence of the cores / GPUs
assigned by Slurm.
For reference: The PCI-IDs of the GPUs when run as root outside of
any cgroup:
Could be this quote from the srun man page:
-u, --unbuffered
By default the connection between slurmstepd and the user launched application
is over a pipe. The stdio output written by the application is buffered by the
glibc until it is flushed or the output is set as unbuffered. See setbuf(3). I
Could be this quote from the srun man page:
-u, --unbuffered
By default the connection between slurmstepd and the user launched application
is over a pipe. The stdio output written by the application is buffered by the
glibc until it is flushed or the output is set as unbuffered. See setbuf(3). I
