Re: [Beowulf] SSD caching for parallel filesystems

On Sun, Feb 10, 2013 at 07:19:44PM +, Andrew Holway wrote: > >> Find me an application that needs big bandwidth and doesn't need massive > >> storage. > > Databases. Lots of databases. blekko's search engine. We own 1/2 petabyte of 160 gig Intel X-25Ms, are bandwidth-limited, and we wouldn't

Re: [Beowulf] SSD caching for parallel filesystems

Vincent, seer of seers, prognosticator of prognosticators, Grendel of Grendels, answer me this (ironically, this will get us back to the OP's question, in a form at least, which would be just swell): "You are charged with creating the most efficient and cost-effective cache layer possible using

Re: [Beowulf] SSD caching for parallel filesystems

this is getting absurd. I think we all know the relative prices and performances of off-the-shelf disks/ssd/ram. each have peculiarities that make their use somewhat complex. - with disks, you have to think about seek time, since it can range from zero to ~15ms. for some workloads, a saving gr

Re: [Beowulf] SSD caching for parallel filesystems

Jim Lux -Original Message- From: Vincent Diepeveen [mailto:d...@xs4all.nl] Sent: Monday, February 11, 2013 4:32 PM To: Lux, Jim (337C) Cc: beowulf@beowulf.org List Subject: Re: [Beowulf] SSD caching for parallel filesystems > > I was responding to your question asking for an example of

Re: [Beowulf] SSD caching for parallel filesystems

On Feb 12, 2013, at 1:13 AM, Lux, Jim (337C) wrote: > Not simulations.. > > Streaming the data out to a Digital to Analog converter.. > > Basic box works like this: > Attitude and guidance simulator gives a parallel bit word that > indicates range and doppler and target type.. that's used to se

Re: [Beowulf] SSD caching for parallel filesystems

On Feb 12, 2013, at 12:39 AM, Joe Landman wrote: > > If you know what you are doing, 3GB/s is so ... several years ago. > c.f. > http://scalability.org/?p=3157 > If you scroll back Joe, The 3GB/s figure is what they posted they were happy to reach with a SSD. That's why i kept using it. >

Re: [Beowulf] SSD caching for parallel filesystems

Not simulations.. Streaming the data out to a Digital to Analog converter.. Basic box works like this: Attitude and guidance simulator gives a parallel bit word that indicates range and doppler and target type.. that's used to set a timer and frequency offset Radar gives a sync pulse to the targ

Re: [Beowulf] SSD caching for parallel filesystems

On Feb 12, 2013, at 12:39 AM, Joe Landman wrote: [snip] > > $10 - $20 /TB? For desktop drives, certainly, you can get the slow > (5400RPM) cheap ones for about $40/TB or so (+/- some). Even for consumers the 7200 RPM raid ones delivering 200MB/s are just 8% more expensive than the cheap ones

Re: [Beowulf] ssd pricing

That's not my question _ my question is: The box you do the radar simulations with. Please describe the box. How many SSD's are in raid there forming a partition of what size and which bandwidth can they deliver to a single motherboard? When using default computer components - i bet you wont'

[Beowulf] ssd pricing

Newegg.. Crucial M4 512GB SATA are $350 each that's substantially discounted from most retailers which are running about $420-500 Avnet, for instance, is quoting $480 CT512M4SSD2 James Lux, P.E. Task Manager, FINDER - Finding In

Re: [Beowulf] SSD caching for parallel filesystems

On 02/11/2013 06:26 PM, Vincent Diepeveen wrote: > You make a joke out of it, > > Yet SSD's you never buy in in huge quantities, whereas for any self The great thing about gross overarching generalizations is that they tend to be incorrect. They are sort of a recursive joke. First, define "hug

Re: [Beowulf] SSD caching for parallel filesystems

Ah you're doing the simulations a lot slower :) No big deal. You get what you pay for :) You're speaking about 1 box here or so? What size SSD array size is in that box, what bandwidth does it deliver to your CPU's and what price did you buy it for Jim? Then we can compare it with a harddrive r

Re: [Beowulf] SSD caching for parallel filesystems

You make a joke out of it, Yet SSD's you never buy in in huge quantities, whereas for any self respecting HPC practicing organisation or company, they buy in massive harddrive storage, so they *can* get every single harddrive for the prices quoted, which is between $10 and $20 a terabyte right

Re: [Beowulf] SSD caching for parallel filesystems

>> In any event, your original statement used to be wholly correct. >> It has >> changed to a certain degree to "SSDs are about IOPs," which isn't >> quite the same thing. However, more pointedly, with modern HDDs >> barely approaching 200MB/s and SSD solutions approaching 2-4GB/s, >> this is a

Re: [Beowulf] SSD caching for parallel filesystems

> Buy in price actually for a company here is $35 already a year ago > for 2TB disks. > They basically have 2 shops selling well in Netherlands and Germany. > I'm not sure they like to get mentionned here, but knowing you know > some German, > you should have no problems figuring out that shop nam

Re: [Beowulf] SSD caching for parallel filesystems

On Feb 11, 2013, at 7:29 PM, Lux, Jim (337C) wrote: >> In any event, your original statement used to be wholly correct. >> It has >> changed to a certain degree to "SSDs are about IOPs," which isn't >> quite the same thing. However, more pointedly, with modern HDDs >> barely approaching 200MB/s

Re: [Beowulf] SSD caching for parallel filesystems

> In any event, your original statement used to be wholly correct. > It has > changed to a certain degree to "SSDs are about IOPs," which isn't > quite the same thing. However, more pointedly, with modern HDDs > barely approaching 200MB/s and SSD solutions approaching 2-4GB/s, this > is an i

Re: [Beowulf] SSD caching for parallel filesystems

Andrew, Companies can deliver to companies things dirt cheap. Companies have basically zero rights compared to citizen. For example if you buy product A, then a customer has the right to return, within a given period of time. A company doesn't have that right, unless agreed contractual. So th

Re: [Beowulf] SSD caching for parallel filesystems

> You seem to have no idea what determines prices when you buy in a lot versus > just 1. Yes indeed. I am obviously clueless in the matter. ___ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscription (digest m