On 10/29/18 12:44 PM, David Mathog wrote:
[...]
It turns out that getting up to date compilers and libraries has become
quite important for those working on large distributed code bases.
Libraries are harder. Try to build a newer one than ships with CentOS
and it is not uncommon to end up having to build many other libraries
(recursive dependencies) or to hit a brick wall when a kernel
dependency surfaces.
This was my point about building things in a different tree. I do this
with tools I use in https://github.com/joelandman/nlytiq-base , which
gives me a consistent set of tools regardless of the platform.
Unfortunately, some of the software integrates Conda, which makes it
actually harder to integrate what you need. Julia, for all its
benefits, is actually hard to build packages for such that they don't
use Conda.
In biology apps of late there is a distressing tendency for software
to only be supported in a distribution form which is essentially an
entire OS worth of libraries packaged with the one (often very small)
program I actually want to run. (See "bioconda".) Most of these
programs will build just fine from source even on CentOS 6, but often
the only way to download a binary for them is to accept an additional
1Gb (or more) of other stuff.
Yeah, this has become common across many fields. Containers become the
new binaries, so you don't have to live with/accept the platform based
restrictions. This was another point of mine. And Greg K @Sylabs is
getting free exposure here :D
--
Joe Landman
e: joe.land...@gmail.com
t: @hpcjoe
w: https://scalability.org
g: https://github.com/joelandman
l: https://www.linkedin.com/in/joelandman
_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit
http://www.beowulf.org/mailman/listinfo/beowulf