Re: [slurm-users] Slurm User Group Meeting (SLUG'21) will be held on YouTube on September 21st

. Thanks, Kota ---- 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTT コンピュータ&データサイエンス研究所 革新的コンピューティングアーキテクチャ研究プロジェクト 0422-59-2837 - > -Original Message- > From: slurm-users On Behalf Of Tim > Wickberg > Sent: Tues

Re: [slurm-users] SLURM A100

m.com/nttlabs/nvidia-a100-mig-as-linux-device-66220ca16698 Best, 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTTソフトウェアイノベーションセンタ 分散処理基盤技術プロジェクト 0422-59-2837 - > -Original Message- > From:

Re: [slurm-users] Rate Limiting of RPC calls

ueue doesn't affects such a mysql db query performance. Any thoughts? Best, Kota 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTTソフトウェアイノベーションセンタ 分散処理基盤技術プロジェクト 0422-59-2837 ----- > -Original Message- > From: slu

Re: [slurm-users] Rate Limiting of RPC calls

Thanks Guys! All information is valuable. I'll look up our setting and try to tune our Slurm cluster to get higher performance. Best, Kota 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTTソフトウェアイノベーションセンタ 分散処理基盤技術プロジェクト 0422-59

[slurm-users] Rate Limiting of RPC calls

uch a RateLimit feature? If not, is there way to save Slurm server-side resources? Best, Kota 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTTソフトウェアイノベーションセンタ 分散処理基盤技術プロジェクト 0422-59-2837 -

Re: [slurm-users] How to view GPU indices of the completed jobs?

ebug_info/environ_hostname 2>&1 > > env |grep SLURM > .debug_info/environ_slurm 2>&1 > > env |grep OMP |grep -v OMPI > .debug_info/environ_omp 2>&1 > > env |grep OMPI > .debug_info/environ_openmpi 2>&1 > > env > .debug_info/environ 2>&1

Re: [slurm-users] How to view GPU indices of the completed jobs?

Thank you David! Let me try it. Thinking about our case, I'll try to dump the debug info to somewhere like syslog. Anyway, the idea should be useful to improve our system monitoring. Much appreciated. Best, Kota 露崎　浩太 (Kota Tsuy

Re: [slurm-users] How to view GPU indices of the completed jobs?

> -j -l` too. However, it seems to include any GPU index information > even in AllocGres and AllocTres columns. It DOES NOT seem to include any GPU index, I meant. Sorry. Best. 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.

Re: [slurm-users] How to view GPU indices of the completed jobs?

r, it seems to include any GPU index information even in AllocGres and AllocTres columns. Do I have to turn on some configurations to track the detailed GPU information? Am I missing something? Best regards, 露崎　浩太 (Kota Tsuyuzaki) ko

[slurm-users] How to view GPU indices of the completed jobs?

st regards, ---- 露崎　浩太 (Kota Tsuyuzaki) kota.tsuyuzaki...@hco.ntt.co.jp NTTソフトウェアイノベーションセンタ 分散処理基盤技術プロジェクト 0422-59-2837 -

Re: [slurm-users] How to share GPU resources? (MPS or another way?)

Thanks! The bug report was beneficial. It seems we have to reconsider how to achieve what we want. Cheers, Kota > -Original Message- > From: slurm-users On Behalf Of > Christopher Samuel > Sent: Wednesday, October 9, 2019 11:54 PM > To: slurm-users@lists.schedmd.com > Subject: Re: [slu

Re: [slurm-users] How to share GPU resources? (MPS or another way?)

> On 10/8/19 1:47 AM, Kota Tsuyuzaki wrote: > > GPU is running as well as gres gpu:1. And more, the NVIDIA docs looks > > to describe what I hit > > (https://docs.nvidia.com/deploy/mps/index.html#topic_4_3). That seems like > > the mps-server will be created to each &g

[slurm-users] How to share GPU resources? (MPS or another way?)

'm not sure if it's expected behavior or not. Thus I'd like to hear the opinions because I may be missing something or I may have another way to share GPU resources rather than mps. Does anyone hits the same issue? Would anyone help me? Thanks, ---