Hi Joe: You can also run Spark on Docker:
https://amplab.cs.berkeley.edu/2013/10/23/got-a-minute-spin-up-a-spark-cluster-on-your-laptop-with-docker/ Cheers, Bernard On Tue, Nov 26, 2013 at 4:04 PM, Joe Landman <land...@scalableinformatics.com> wrote: > I know there was some discussion of this previously, and I wanted to > point out this update > > http://blog.docker.io/2013/11/docker-0-7-docker-now-runs-on-any-linux-distribution/ > > Interesting that the AUFS dependence is now not blocking things. > > Hopefully I'll get a chance to play with it in a few weeks in an HPC > context, to see what the container performance cost is (if anything). > Hopefully quite low. > > If someone has already done this, please post a link. > > This is an OS level virtual system. Not a hypervisor, or a paravisor, > so it *should*, in theory, be lower latency. It looks like we can > generate Docker files trivially from a machine specification in Tiburon, > though we are very JSON centric these days. > > > > -- > Joseph Landman, Ph.D > Founder and CEO > Scalable Informatics, Inc. > email: land...@scalableinformatics.com > web : http://scalableinformatics.com > twtr : @scalableinfo > phone: +1 734 786 8423 x121 > cell : +1 734 612 4615 > _______________________________________________ > Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing > To change your subscription (digest mode or unsubscribe) visit > http://www.beowulf.org/mailman/listinfo/beowulf _______________________________________________ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
