Re: [Beowulf] NFS alternative for 200 core compute (beowulf) cluster

2023-08-10 Thread Robert Taylor
Two 4tb spinning drives are not going to have a lot of throughput, and with 40 tasks all working on different files, if it's random IO, I think they will get crushed. What are the sequential read and write rates from any one node doing single threaded io to the nfs server? Can you do a dd test? T

Re: [Beowulf] odd vlan issue

2021-06-16 Thread Robert Taylor
I’ve seen it happen with udp, in my case it was a syslog server, that hardly ever “spoke” so eventually it’s MAC address disappears from the Cam table long before it leaves the arp table and the UDP packets get flooded hoping to find the server. I’ve also seen this happen in an HA environment, Wh

[Beowulf] job packing on lsf8? Any lsf gurus out there?

2019-03-19 Thread Robert Taylor
Hi All. We are on a old version of LSF where I am, lsf8. We are trying to implement job packing on a particular queue, and I find some references online to using RES_REQ = order[-slots] in the lsb.queues file, and SCHED_PER_JOB_SORT=Y in lsb.params However, this doesn't work, as they appear to o

[Beowulf] lsf job packing on lsf8? Any old-school lsf8 guru's here?

2019-03-15 Thread Robert Taylor
Hi All. We are on a old version of LSF where I am, lsf8. We are trying to implement job packing on a particular queue, and I find some references online to using RES_REQ = order[-slots] in the lsb.queues file, and SCHED_PER_JOB_SORT=Y in lsb.params However, this doesn't work, as they appear to o

[Beowulf] lsf job packing on lsf8? Any old-school lsf8 guru's here?

2019-03-14 Thread Robert Taylor
Hi All. We are on a old version of LSF where I am, lsf8. We are trying to implement job packing on a particular queue, and I find some references online to using RES_REQ = order[-slots] in the lsb.queues file, and SCHED_PER_JOB_SORT=Y in lsb.params However, this doesn't work, as they appear to o

[Beowulf] Bright Cluster Manager

2018-05-01 Thread Robert Taylor
Hi Beowulfers. Does anyone have any experience with Bright Cluster Manager? My boss has been looking into it, so I wanted to tap into the collective HPC consciousness and see what people think about it. It appears to do node management, monitoring, and provisioning, so we would still need a job sch

[Beowulf] Cluster Authentication (LDAP,NIS,AD)

2017-12-27 Thread Robert Taylor
Hi cluster gurus. I want to pick the your collective brains. Right now, where I work, we have and isilon, and netapp, which we use for our small 250core compute cluster. We have NIS for authentication and automount maps on the cluster side, and AD for authentication on the windows side, and LDAP f