Hi Loris,
thanks for all the extra infos and the pointer to the nextflow issue.
That's exactly the conversations that need to happen, to make these
systems work for everybody. From the perspective of the users who need
to manage huge analyses with incredibly complicated job dependencies.
And from
Loris Bennett writes:
> Hi David,
>
> (Thanks for changing the subject to something more appropriate).
>
> David Laehnemann writes:
>
>> Yes, but only to an extent. The linked conversation ends with this:
>>
Do you have any best practice about setting MaxJobCount to a proper
>> number?
>>
>
Hi David,
David Laehnemann writes:
> Hi Loris,
>
> I gave this a new subject, as this has nothing to do with my original
> question.
>
> Maybe this is what you were looking for in the snakemake documentation:
>
> https://snakemake.readthedocs.io/en/latest/executing/grouping.html#job-grouping
>
>
Hi David,
(Thanks for changing the subject to something more appropriate).
David Laehnemann writes:
> Yes, but only to an extent. The linked conversation ends with this:
>
>>> Do you have any best practice about setting MaxJobCount to a proper
> number?
>
>> That depends upon your workload. You
Yes, but only to an extent. The linked conversation ends with this:
>> Do you have any best practice about setting MaxJobCount to a proper
number?
> That depends upon your workload. You could probably set MaxJobCount
to at least 5 with most systems (assuming you have at least a few
gigabytes
On 2/23/23 17:07, David Laehnemann wrote:
In addition, there are very clear limits to how many jobs slurm can
handle in its queue, see for example this discussion:
https://bugs.schedmd.com/show_bug.cgi?id=2366
My 2 cents: Slurm's job limits are configurable, see this Wiki page:
https://wiki.fys
Hi Loris,
I gave this a new subject, as this has nothing to do with my original
question.
Maybe this is what you were looking for in the snakemake documentation:
https://snakemake.readthedocs.io/en/latest/executing/grouping.html#job-grouping
You can basically bundle groups of (snakemake) jobs t
