True, there’s tons of info in qstat -f, however, doesn’t qstat stop showing my
job after it completes, though? Maybe there’s a switch that retrieves “last
data”?
I suppose I could put a qstat -f in as the last thing in the sub job file.
resources_used.cpupercent = 99
resources_used.cput = 00:34:26
resources_used.mem = 11764kb
resources_used.ncpus = 4
resources_used.vmem = 1135264kb
resources_used.walltime = 00:34:28
and then there’s /usr/bin/time which might also help.
From: Beowulf <beowulf-boun...@beowulf.org> on behalf of Gus Correa
<g...@ldeo.columbia.edu>
Date: Tuesday, October 29, 2019 at 11:34 AM
To: "beowulf@beowulf.org" <beowulf@beowulf.org>
Subject: [EXTERNAL] Re: [Beowulf] PBS question
On Tue, Oct 29, 2019 at 2:00 PM Lux, Jim (US 337K) via Beowulf
<beowulf@beowulf.org<mailto:beowulf@beowulf.org>> wrote:
I’m doing some EP job arrays using PBS, and I was wondering if there’s a way to
find out how much resources the job actually consumed.
For instance, if I do a select 1:ncpus=4 does it actually use 4 CPUs?
Likewise, is there a “memory high water mark”.
The idea here is that since my job competes with all the other jobs, the better
I can describe my resource needs (i.e. not over-require) the faster my job gets
through the system.
Or are these things I need to instrument in some other way.
--
ncpus=4 requests 4 cpus/cores, which PBS/Torque will allocate to your job alone
(unless the nodes are tagged as work shared).
It is up to you use these cpus (e.g. MPI: mpirun np=4; OpenMP:
OMP_THREAD_NUM=4) or not (a serial program).
"qstat -f" produces a fair amount of information about the job resources.
The accounting logs, in server_priv/accounting/YYYMMDD also do, if you have
access to them.
You can request a certain amount of memory with the -l (lowercase L) switch of
qsub.
See 'man qsub' for syntax, and 'man pbs_resources' for which resources can be
requested (particularly pmem, pvmem, vmem).
I hope this helps,
Gus Correa
_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org<mailto:Beowulf@beowulf.org> sponsored
by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit
https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit
https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
