Re: [Beowulf] massive parallel processing application required

2007-02-02 Thread Jim Lux
At 12:57 AM 2/2/2007, Geoff Jacobs wrote: Jim Lux wrote: > (If I go with the FiOS offering though, that may prompt > some re-evaluation) Why? Only a third of the bandwidth of fast ethernet at peak speeds (which you aren't going to see). Hell, an rtl8139 could handle that. > Likewise, a small bu

Re: [Beowulf] massive parallel processing application required

2007-02-02 Thread Robert G. Brown
On Thu, 1 Feb 2007, Jim Lux wrote: At 06:34 PM 2/1/2007, Douglas Eadline wrote: --snip-- > There is some > statistical multiplexing possible (TASI) because people don't talk at > 100% duty cycle, but not a huge amount. You have not met my ... (never mind, you never know where these emails

Re: [Beowulf] massive parallel processing application required

2007-02-02 Thread Geoff Jacobs
Jim Lux wrote: > (If I go with the FiOS offering though, that may prompt > some re-evaluation) Why? Only a third of the bandwidth of fast ethernet at peak speeds (which you aren't going to see). Hell, an rtl8139 could handle that. > Likewise, a small business with half a dozen or a dozen desktops

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Jim Lux
At 06:34 PM 2/1/2007, Douglas Eadline wrote: --snip-- > There is some > statistical multiplexing possible (TASI) because people don't talk at > 100% duty cycle, but not a huge amount. You have not met my ... (never mind, you never know where these emails end up) Hah.. I need 5 Mbps at ho

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Douglas Eadline
--snip-- > There is some > statistical multiplexing possible (TASI) because people don't talk at > 100% duty cycle, but not a huge amount. You have not met my ... (never mind, you never know where these emails end up) -- Doug ___ Beowulf mailing

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Jim Lux
At 03:25 PM 2/1/2007, Mark Hahn wrote: the internet bubble. in those days, it was popular to claim that the network was becoming truely ubiquitous and incomprehensibly fast. for instance: In the long run, ubiquitous and fast IS going to be true (however, latency is in the long run, everyth

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Jim Lux
At 12:26 PM 2/1/2007, Robert G. Brown wrote: On Thu, 1 Feb 2007, Peter St. John wrote: Also, phone companies ARE gradually laying fiber everywhere, and while they may or may not take it right up to your house they'll certainly take it to your neighborhood, and maybe only "finish off" with coppe

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Jim Lux
At 08:25 AM 2/1/2007, Peter St. John wrote: Moore's Law (which has grown in scope since Moore) applies to the aggregate effect of many technologies. Individual techs proceed in fits and starts. Predictions about FLOPS/dollar seem to be sustainable, but e.g. I predict a jump in chip density when

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mark Hahn
the internet bubble. in those days, it was popular to claim that the network was becoming truely ubiquitous and incomprehensibly fast. for instance: In the long run, ubiquitous and fast IS going to be true (however, latency is in the long run, everything is true ;) gross oversupply of fibe

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Jim Lux
At 07:40 AM 2/1/2007, Mark Hahn wrote: Not true. Distributed computing is more and more mainstream. I think too oh, one other snide comment about grid: I suspect the grid-fad could not have happened without the fraud perpetrated by worldcom and others during the internet bubble. in those d

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Robert G. Brown
On Thu, 1 Feb 2007, Peter St. John wrote: Me too. I want a small laser on my rooftop, with prisms splitting to receivers on the roofs of two or four neighbors, with a uucp type friendly free protocol. I guess they should be MASERs but I'm no physicist. Oh, just chop up your microwave oven, lin

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Robert G. Brown
On Thu, 1 Feb 2007, Peter St. John wrote: Moore's Law (which has grown in scope since Moore) applies to the aggregate effect of many technologies. Individual techs proceed in fits and starts. Predictions about FLOPS/dollar seem to be sustainable, but e.g. I predict a jump in chip density when th

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread [EMAIL PROTECTED]
You can try: CMAQ www.cmascenter.org MM5 http://www.mmm.ucar.edu/mm5/ WRF http://www.wrf-model.org/index.php Any of the above could be used and input data can be gathered from many sources. If you want some WRF inputs, let me know. I don't currently have any CMAQ or MM5 inputs though.

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Peter St. John
Mark, On 2/1/07, Mark Hahn <[EMAIL PROTECTED]> wrote: > Moore's Law ... (I guess you could argue that there are generational aspects to the shrink/area thing too, since, for instance, visible-optical gave way to UV and presumably eventually immersion litho. or maybe it'll be imprint litho

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Joshua Baker-LePain
On Thu, 1 Feb 2007 at 11:50am, Mark Hahn wrote but am I alone in thinking that cellphones are one of the suckiest products on the market? No. -- Joshua Baker-LePain Department of Biomedical Engineering Duke University ___ Beowulf mailing list, Beowu

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mark Hahn
Moore's Law (which has grown in scope since Moore) applies to the aggregate effect of many technologies. Individual techs proceed in fits and starts. well, specifically it applies to fields there the primary metric is a function of density. for instance, disk capacity is on an exponential, si

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Peter St. John
Moore's Law (which has grown in scope since Moore) applies to the aggregate effect of many technologies. Individual techs proceed in fits and starts. Predictions about FLOPS/dollar seem to be sustainable, but e.g. I predict a jump in chip density when the price point of vapor deposition manufactur

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mark Hahn
Not true. Distributed computing is more and more mainstream. I think too oh, one other snide comment about grid: I suspect the grid-fad could not have happened without the fraud perpetrated by worldcom and others during the internet bubble. in those days, it was popular to claim that the ne

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Robert G. Brown
On Thu, 1 Feb 2007, Douglas Eadline wrote: For those interested in other engineering and scientific uses take a look at: http://www.talkorigins.org/faqs/genalg/genalg.html Fabulous article, actually. Thanks! I've actually written a parallel GA embedded in a NN training program, and have bee

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Peter St. John
Since I had wanted a cluster to run my GA, I thought about using the GA to configure the cluster. So that's a great link for me! Peter On 2/1/07, Douglas Eadline <[EMAIL PROTECTED]> wrote: > Douglas Eadline wrote: >> If you want to do a little development and impress your friends, >> try playi

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Douglas Eadline
> Douglas Eadline wrote: >> If you want to do a little development and impress your friends, >> try playing with pgapack (Parallel Genetic Algorithm Library) >> >> http://www-fp.mcs.anl.gov/CCST/research/reports_pre1998/comp_bio/stalk/pgapack.html >> >> You can develop a GA on single computer then

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Gerry Creager
Mitchell Wisidagamage wrote: Please don't fall into the trap of thinking "e-Science" requires a tie to the Globus Toolkit to be valid. I do not think this (anymore). I queried Matthew Haynos from IBM who's an expert in this area some time ago as I'm new to grid computing. The silly question

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mitchell Wisidagamage
Please don't fall into the trap of thinking "e-Science" requires a tie to the Globus Toolkit to be valid. I do not think this (anymore). I queried Matthew Haynos from IBM who's an expert in this area some time ago as I'm new to grid computing. The silly questions are from me :o) Answers are

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mitchell Wisidagamage
Now I'm not sure what to do with these data sets. I should program my own application. But how should I be processing them?...without the algorithms for processing I'm lost. :o) http://www.ocean-systems.com/VOSS.htm www.weather.navy.mil/paoweb/starsams.ppt

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Mitchell Wisidagamage
Optimum path routing of ships and/or airplanes, taking into account the winds, currents, sea state, temperatures, etc. Large realtime and climatological databases are available. The path optimization algorithms are simple and fairly well known (A and A-star are two to start with). The challe

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Gerry Creager
Jim Lux wrote: At 02:03 PM 1/31/2007, Robert G. Brown wrote: On Wed, 31 Jan 2007, Mitchell Wisidagamage wrote: Thank you very much for the fire dynamics idea. I will have a look at it. I did try to contact many e-science projects including some researchers at Oxford. But I got no reply. The

Re: [Beowulf] massive parallel processing application required

2007-02-01 Thread Geoff Jacobs
Douglas Eadline wrote: > If you want to do a little development and impress your friends, > try playing with pgapack (Parallel Genetic Algorithm Library) > > http://www-fp.mcs.anl.gov/CCST/research/reports_pre1998/comp_bio/stalk/pgapack.html > > You can develop a GA on single computer then run it

Re: [Beowulf] massive parallel processing application, required

2007-01-31 Thread Steve Heaton
Jan 2007 21:37:23 -0800 From: Jim Lux <[EMAIL PROTECTED]> Subject: Re: [Beowulf] massive parallel processing application required To: Mark Hahn <[EMAIL PROTECTED]>,Mitchell Wisidagamage <[EMAIL PROTECTED]> Cc: beowulf@beowulf.org Message-ID: <[EMAIL PROTECTE

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Jim Lux
At 04:17 PM 1/29/2007, Mitchell Wisidagamage wrote: Hi all, As part of my dissertation, I'm looking for "raw data" which will be used for massive parallel processing using Beuwulf cluster (with the use of PVM or MPI). I tried looking for e-science raw data (and the computations required on it

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Jim Lux
At 05:51 PM 1/31/2007, Mitchell Wisidagamage wrote: [EMAIL PROTECTED] wrote: You can try: CMAQ www.cmascenter.org MM5 http://www.mmm.ucar.edu/mm5/ WRF http://www.wrf-model.org/index.php Any of the above could be used and input data can be gathered from many sources. If you want some WRF inputs

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Jim Lux
At 02:37 PM 1/31/2007, Mark Hahn wrote: worked at a e-science project himself. He told me people, especially is this "e-science" term more popular where you are? I don't really hear it here (Canada, probably NA in general.) many (most) branches of science are so dependent on computers that i

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Jim Lux
At 02:03 PM 1/31/2007, Robert G. Brown wrote: On Wed, 31 Jan 2007, Mitchell Wisidagamage wrote: Thank you very much for the fire dynamics idea. I will have a look at it. I did try to contact many e-science projects including some researchers at Oxford. But I got no reply. Then I went to get s

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Jim Lux
At 03:17 AM 1/31/2007, Mitchell Wisidagamage wrote: Thank you very much for the fire dynamics idea. I will have a look at it. I did try to contact many e-science projects including some researchers at Oxford. But I got no reply. Then I went to get some contacts from a tutor who worked at a e-s

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Gerry Creager
Don't forget the Weather Research and Forecasting model at http://wrf-model.org/users/users.php Mitchell Wisidagamage wrote: [EMAIL PROTECTED] wrote: You can try: CMAQ www.cmascenter.org MM5 http://www.mmm.ucar.edu/mm5/ WRF http://www.wrf-model.org/index.php Any of the above could be used a

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Gerry Creager
No... "e-Science" has been co-opted by "grid" as their own. Collaborative computational science has been around for quite some time. Determining the appropriate degree of distributed computational interprocess communication requires more than trivial examination of the codes in use. Please d

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mitchell Wisidagamage
[EMAIL PROTECTED] wrote: You can try: CMAQ www.cmascenter.org MM5 http://www.mmm.ucar.edu/mm5/ WRF http://www.wrf-model.org/index.php Any of the above could be used and input data can be gathered from many sources. If you want some WRF inputs, let me know. I don't currently have any CMAQ or M

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mitchell Wisidagamage
is this "e-science" term more popular where you are? I don't really hear it here (Canada, probably NA in general.) many (most) branches of science are so dependent on computers that it seems redundant and archaic. "e-science" is huge here, in universities and scientific research . It's as

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mark Hahn
worked at a e-science project himself. He told me people, especially is this "e-science" term more popular where you are? I don't really hear it here (Canada, probably NA in general.) many (most) branches of science are so dependent on computers that it seems redundant and archaic. scientis

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Robert G. Brown
On Wed, 31 Jan 2007, Mitchell Wisidagamage wrote: Thank you very much for the fire dynamics idea. I will have a look at it. I did try to contact many e-science projects including some researchers at Oxford. But I got no reply. Then I went to get some contacts from a tutor who worked at a e-sc

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Peter St. John
Mitchell, I advocate building your own data, which is trivial in mathematics applications. One of the first uses for distributing hard computations to volunteers on the net with idle CPU time was number theory (primality testing, finding primes, for cryptography, for example). A site that provide

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Douglas Eadline
If you want to do a little development and impress your friends, try playing with pgapack (Parallel Genetic Algorithm Library) http://www-fp.mcs.anl.gov/CCST/research/reports_pre1998/comp_bio/stalk/pgapack.html You can develop a GA on single computer then run it on a cluster. -- Doug > Any k

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Dave Wolfson - MCDOTX
Mark Hahn Cc: beowulf@beowulf.org Subject: [SPAM:] - Re: [Beowulf] massive parallel processing application required - Email has different SMTP TO: and MIME TO: fields in the email addresses Numerical weather prediction? Uses a fair bit of initial boundary condition data from other models... Cl

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mitchell Wisidagamage
Thank you very much for the fire dynamics idea. I will have a look at it. I did try to contact many e-science projects including some researchers at Oxford. But I got no reply. Then I went to get some contacts from a tutor who worked at a e-science project himself. He told me people, especiall

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mitchell Wisidagamage
Thank you for the reply. what I mean by massively parallel processing is "compute intensive" problem where I will be able to process on many hosts independently in parallel (by parallelizing the algorithms). Apologies if I'm repeating what you already know. Currently there are 9 hosts on Beowul

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread 06002352
the reason this is such a weird query is that parallel processing is normally motivated by already having something that needs it. I have a hard time imagining what work you've already done that has somehow managed to be not driven by having a compute-intensive job at hand. I have to come u

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mitchell Wisidagamage
Any kind system is fine. It all depends on the type of the "application" I get. I thought of password cracking. But there wouldn't be much substance in the project in it. Any ideas? There's got be lots of transaction processing. When I was working at an ISP we calculated dial-up internet usa

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Robert G. Brown
On Wed, 31 Jan 2007, Mark Hahn wrote: Climate code, especially when coupling between atmosphere and ocean models? seems like it would require some nontrivial physics, not to mention realistic input data. don't most climate codes also depend on huge multi-dimensional FFT's where the transpose

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Mark Hahn
Climate code, especially when coupling between atmosphere and ocean models? seems like it would require some nontrivial physics, not to mention realistic input data. don't most climate codes also depend on huge multi-dimensional FFT's where the transpose is coded as all-to-all? here's an alter

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread Gerry Creager
Numerical weather prediction? Uses a fair bit of initial boundary condition data from other models... Climate code, especially when coupling between atmosphere and ocean models? Both tend to be embarassingly parallel and run w/ MPI. gerry Mark Hahn wrote: As part of my dissertation, I'm looki

Re: [Beowulf] massive parallel processing application required

2007-01-31 Thread John Hearns
Mitchell Wisidagamage wrote: Hi all, As part of my dissertation, I'm looking for "raw data" which will be used for massive parallel processing using Beuwulf cluster (with the use of PVM or MPI). I tried looking for e-science raw data (and the computations required on it) such as bioinformatic

Re: [Beowulf] massive parallel processing application required

2007-01-30 Thread Mark Hahn
As part of my dissertation, I'm looking for "raw data" which will be used for massive parallel processing using Beuwulf cluster (with the use of PVM my "massive", so you mean "embarassingly parallel" (aka loosely coupled)? if so, I'd probably go with password cracking ;) MPI). I tried looking f

Re: [Beowulf] massive parallel processing application required

2007-01-30 Thread Douglas Eadline
You may want to quantify "massively parallel" and define "raw data" (i.e. how many processors and data for which specific application?) -- Doug > Hi all, > As part of my dissertation, I'm looking for "raw data" which will be > used for massive parallel processing using Beuwulf cluster (w

Re: [Beowulf] massive parallel processing application required

2007-01-30 Thread Douglas Eadline
You may want to quantify "massively parallel" and define "raw data" (i.e. how many processors and data for which specific application?) -- Doug > Hi all, > As part of my dissertation, I'm looking for "raw data" which will be > used for massive parallel processing using Beuwulf cluster (w

[Beowulf] massive parallel processing application required

2007-01-30 Thread Mitchell Wisidagamage
Hi all, As part of my dissertation, I'm looking for "raw data" which will be used for massive parallel processing using Beuwulf cluster (with the use of PVM or MPI). I tried looking for e-science raw data (and the computations required on it) such as bioinformatics, fluid dynamics, etc. but w