[slurm-users] slurmrestd features

2021-07-08 Thread Costin
Hi, Is there a plan for slurmrestd to get expanded? The current api is missing a few pieces of information. for example: https://slurm.schedmd.com/rest_api.html#slurmctldGetNodes does not return how many cores are allocated or how much memory is in use. Ideally this should return all the informati

Re: [slurm-users] Bug: incorrect output directory fails silently

2021-07-08 Thread Killian Murphy
You can't know the file system state at job runtime, but you can catch the case where the output path can't be resolved at job submission time - I expect this will catch the majority of issues (we also see this come up fairly regularly!). On Thu, 8 Jul 2021 at 16:59, Marcus Boden wrote: > I alre

Re: [slurm-users] Bug: incorrect output directory fails silently

2021-07-08 Thread Marcus Boden
I already answered tons of tickets due to this, when our users are confused, that the job silently fails. The problem is, you cannot solve this with a job_submit or cli_filter, as you do not know the situation of the file system at job runtime. Or even on the node in the end. At lest the slurm

Re: [slurm-users] Bug: incorrect output directory fails silently

2021-07-08 Thread Jeffrey T Frey
> I understand that there is no output file to write an error message to, but > it might be good to check the `--output` path during the scheduling, just > like `--account` is checked. > > Does anybody know a workaround to be warned about the error? I would make a feature request of SchedMD to

[slurm-users] Bug: incorrect output directory fails silently

2021-07-08 Thread Dries Boers
Dear Slurm users, I wanted to discuss a bug with you, which has troubled me several times. I could not find a discussion about it through Google nor DDG, although it is mentioned here in a Snakemake Issue. When schedul