I have done only a few experiments with parallel file systems but
I've run some benchmarks on each one I've encountered.
With regard to Joshua Baker-LePain's comment
I played with PVFS1 a bit back in the day. My impression at the time was
they they were focused on MPI-IO, and the POSIX layer wa
users to cache data-in-progress to scratch space on the nodes. But there's a
definite draw to a single global scratch space that scales automatically with
the cluster itself.
using node-local storage is fine, but really an orthogonal issue.
if people are willing to do it, it's great and scales
Hi Rahul,
I went through a fair amount of work with this sort of thing (specifying
performance and then getting the vendor to bring it up to expectations
when performance didn't come close) and I was happiest with Bonnie++ in
terms of simplicity of use and the range of stats you get. I haven'
On Fri, 25 Sep 2009 at 6:09pm, Mark Hahn wrote
but since 1U nodes are still the most common HPC building block, and most of
them support 4 LFF SATA disks with very little added cost (esp using the
chipset's integrated controller), is there a way to integrate them into a
whole-cluster filesyste
Hi all,
I'm sure you've noticed that disks are incredibly cheap, obscenely large and
remarkably fast (at least in bandwidth). the "cheap" part is the only one
of these that's really an issue, since the question becomes: how to keep
storage infrastructure cost (overhead) dominating the system co
On Fri, Sep 25, 2009 at 3:59 PM, Joe Landman
wrote:
> Looks like your IOP latency is around 50ms. If you think about this, it
> seems a little high, even for a RAID5. I'll do some measurements here on
> our big units and we can compare.
Thanks again Joe!
About the latency:
It could have some
Rahul Nabar wrote:
On Fri, Sep 25, 2009 at 2:38 PM, Rahul Nabar wrote:
We use this to model bonnie++ and other types of workloads. It provides a
great deal of useful information.
More details from the fio benchmark.
On Fri, Sep 25, 2009 at 2:38 PM, Rahul Nabar wrote:
>> We use this to model bonnie++ and other types of workloads. It provides a
>> great deal of useful information.
>
>
More details from the fio benchmark.
###
On Thu, Sep 24, 2009 at 9:06 PM, Joe Landman
wrote:
> I've found fio (http://freshmeat.net/projects/fio/) to be an excellent
> testing tool for disk systems. To use it, compile it (requires libaio), and
> then run it as
>
> fio input.fio
>
> For a nice simple IOP test, try this:
>
> [rando
On Fri, Sep 25, 2009 at 1:35 PM, Michael Will
wrote:
> By the way, if you have to work through a purchasing departement that only
> looks at the cheapest price, but
> you want to go with a specific vendor because of the superior solution and
> technical expertise, then you can
Thanks! I guess I
By the way, if you have to work through a purchasing departement that only
looks at the cheapest price, but
you want to go with a specific vendor because of the superior solution and
technical expertise, then you can
engage the sales engineer / sales person in defining a uniqueness about the
so
On Fri, Sep 25, 2009 at 1:27 PM, Michael Will
wrote:
> Some will have quite technically skilled sales engineering resources, and
> Jeff Layton for sure is somebody with deep
> technical experience.
Absolutely. Jeff has been a great help so far. Even before he
responded to my questions here I've
Rahul,
>From what you posted to the list there is no need to apologize. If there was
>something going on behind
the curtains personally between you and Jeff then that is not really a concern
to the list.
Keep asking questions and keep curious, and keep posting back results that you
find. In fa
On Fri, Sep 25, 2009 at 8:52 AM, Jeff Layton wrote:
>I don't want to take a public list to pick a fight but I don't want Rahul to
>bad mouth me, my reputation, and the company I work for without some
>sort or rebuttal.
Jeff:
I'm sorry that you take this as bad mouthing you. I sincerely
apologi
OK, I've had enough of Rahul's posting to this list so I thought
I would publically respond to his comments since they directly
affect me, my integrity, and the company I work for during the
day.
Heh ... depends on the vendor. We are pretty open and free with our numbers
(to our current/prospec
15 matches
Mail list logo
