Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Joe Landman
Mark Hahn wrote: I'm not sure about the "most" part - HP's don't, and it looks like supermicro offers options both ways. all the recent tyan boards I've looked at had dedicated IPMI/OPMA onboard. all HP machines have dedicated ports. but to me this has all the hallmarks of a religious iss

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread John Hearns
On Fri, 2008-08-01 at 12:12 -0400, Mark Hahn wrote: > I'm not sure about the "most" part - HP's don't, and it looks like supermicro > offers options both ways. all the recent tyan boards I've looked at had > dedicated IPMI/OPMA onboard. all HP machines have dedicated ports. > > but to me this

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Maurice Hilarius
Mark Hahn wrote: BTW< where a lot of people are jumping on the "Get IPMI " bandwagon, I suggest getting PDUs with remote IP controlled ports is more useful. the thing I don't like about controlled PDUs is that they're pretty harsh - don't you expect a higher failure rate of node PSUs if you go

[Beowulf] Re: Building new cluster - estimate (Ivan, Oleynik)

2008-08-01 Thread Maurice Hilarius
Chris Samuel <[EMAIL PROTECTED]> wrote: .. > BTW< where a lot of people are jumping on the "Get IPMI " > bandwagon, I suggest getting PDUs with remote IP controlled > ports is more useful. Well, it depends on what you're trying to do, if it's get the system and CPU temperatures then a PDU

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Mark Hahn
using lm_sensors is a poor substitute for IPMI. IMHO the only disadvantage of lm_sensors is the poroblem of building of right sensors.conf file. well, there's the little matter of being able to get data when the node is crashed, offline, busy, etc. I also very much like the ability to quer

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Mike Davis
the thing I don't like about controlled PDUs is that they're pretty harsh - don't you expect a higher failure rate of node PSUs if you go yanking the power this way? I have only seen a handful of different IPMI interfaces, but they all were reasonably reliable. In using the ethernet interf

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Mikhail Kuzminsky
In message from Mark Hahn <[EMAIL PROTECTED]> (Fri, 1 Aug 2008 10:06:17 -0400 (EDT)): ... Plus , with a lot of those PDUs you can add thermal sensors and trigger power off on high temperature conditions. IPMI normally provides all the motherboard's sensors as well. it seems like those are far

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Mark Hahn
the thing I don't like about controlled PDUs is that they're pretty harsh - don't you expect a higher failure rate of node PSUs if you go yanking the power this way? Why? If nodes shutdown, on commands from the scheduler, that is good. And, if they do not, how is cutting power by the PDU socket

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-08-01 Thread Mark Hahn
BTW< where a lot of people are jumping on the "Get IPMI " bandwagon, I suggest getting PDUs with remote IP controlled ports is more useful. the thing I don't like about controlled PDUs is that they're pretty harsh - don't you expect a higher failure rate of node PSUs if you go yanking the power

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-31 Thread Chris Samuel
- "Bill Broadley" <[EMAIL PROTECTED]> wrote: > True, but then again lm_sensors can collects fans speeds and > temperatures. Indeed, but getting it working and calibrated can be, umm, interesting.. -- Christopher Samuel - (03) 9925 4751 - Systems Manager The Victorian Partnership for Advan

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-31 Thread Bill Broadley
Chris Samuel wrote: - "Maurice Hilarius" <[EMAIL PROTECTED]> wrote: No matter what anyone says, your codes are all that really count. Indeed! BTW< where a lot of people are jumping on the "Get IPMI " bandwagon, I suggest getting PDUs with remote IP controlled ports is more useful. Wel

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-31 Thread Chris Samuel
- "Maurice Hilarius" <[EMAIL PROTECTED]> wrote: > No matter what anyone says, your codes are all that > really count. Indeed! > BTW< where a lot of people are jumping on the "Get IPMI " > bandwagon, I suggest getting PDUs with remote IP controlled > ports is more useful. Well, it depends o

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-31 Thread Maurice Hilarius
Ivan Oleynik wrote: Maurice, Valuable information, thanks very much! My pleasure. If you wanted it stacked that way (performance order), then this is more closely aligned (ascending): .. Notice how the performance ramp is pretty close to identical to the price ramp?

Re: [Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-29 Thread Ivan Oleynik
Maurice, Valuable information, thanks very much! > > > If you wanted it stacked that way (performance order), then this is more > closely aligned (ascending): > > BX80574E5410AIntel Quad-Core Xeon E5410 / 2.33 GHz ( 1333 MHz ) - > LGA771 Socket - L2 12 MB ( 2 x 6MB ) - Box $322.00 > OS235

[Beowulf] Re: Building new cluster - estimate (Ivan Oleynik)

2008-07-28 Thread Maurice Hilarius
"Ivan Oleynik" <[EMAIL PROTECTED]> wrote: Subject: [Beowulf] Building new cluster - estimate To: beowulf@beowulf.org .. I am in process of upgrading computational facilities of my lab and considering of building/purchasing 40 node cluster. Before contacting vendors I would like to get some unders