Lmod is quite neat as is the original. Thanks for the tip guys! I don’t suppose that there’s something that also covers windows? We’ve got more than one os to support. WSL isn’t universally available sadly.
On Wed, 21 Aug 2019 at 10:57 am, Skylar Thompson <skylar.thomp...@gmail.com> wrote: > We also use Environment Modules, with a well-established hierarchy for > software installs > (software-name/software-version/OS/OS-version/architecture). Combined with > some custom Tcl functions and common header files for our module files, > this lets us keep the size of most module files very small (2-5 lines). > > If we were to do it again today, maybe we'd use Lmod, but Modules is > functional and has a lot of inertia. > > On Tue, Aug 20, 2019 at 06:50:31PM +0000, Ryan Novosielski wrote: > > Really sounds like you should be using environment modules. What I’d > recommend to anyone starting out today would be Lmod: > https://lmod.readthedocs.io/en/latest/ > > > > Most of the software building/installation packages interface with it. > > > > Generally the software installs are done into a place that’s unique for > each package and version, and maybe even for what compiler it was built > with (see hierarchical). > > > > -- > > ____ > > || \\UTGERS, > |---------------------------*O*--------------------------- > > ||_// the State | Ryan Novosielski - novos...@rutgers.edu > > || \\ University | Sr. Technologist - 973/972.0922 (2x0922) ~*~ RBHS > Campus > > || \\ of NJ | Office of Advanced Research Computing - MSB > C630, Newark > > `' > > > > > On Aug 20, 2019, at 1:11 PM, David Mathog <mat...@caltech.edu> wrote: > > > > > > On a system I am setting up there are a very large number of different > software packages available. The sources live in /usr/local/src and a > small number of the most commonly used ones are installed in > /usr/local/bin, /usr/local/lib and so forth. The issue is that any of the > target end users will only want a couple of these. If they were all fully > installed into /usr/local there would be some name conflicts. They may > also be bringing some of their own versions of these, and while $PATH order > can help there, it would be best to avoid those possible conflicts too. > Users don't have priv's to modify /usr/local, so they cannot > install/uninstall there themselves. > > > > > > So I'm looking for something like > > > > > > setup software_name install > > > setup software_name remove > > > > > > which would install/uninstall the packages (perhaps by symlinks) from > > > > > > /usr/local/src/software_name > > > > > > under the user's home directory. The goal is that the setup scripts > NOT be constructed by hand. It would have a > > > > > > setup software_name install > > > > > > which would emulate a: > > > > > > make install > > > > > > and automatically translate it into the appropriate setup commands. > Some of these packages have hundreds of programs, so anything manual is > going to be very > > > painful. > > > > > > Anybody seen a piece of software like this? > > > > > > I don't expect this to work in all cases. Some of these packages hard > code paths into the binaries and/or scripts. The only hope for them is for > the user to do some variant of: > > > > > > cd $HOMEDIR > > > (cd /usr/local/src; tar -cf - software_name) | tar -xf - > > > cd software_name > > > make clean #pray that it gets everything!!! > > > ./configure --prefix=$HOMEDIR > > > make > > > make install > > > > > > There is a file which documents how to build each package, although it > is nowhere near complete at this time. > > > > > > Docker is already available if the user wants to go that route, which > avoids this whole issue, but at the cost of moving big images around. > > > > > > Thanks, > > > > > > David Mathog > > > mat...@caltech.edu > > > Manager, Sequence Analysis Facility, Biology Division, Caltech > > > _______________________________________________ > > > Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin > Computing > > > To change your subscription (digest mode or unsubscribe) visit > https://beowulf.org/cgi-bin/mailman/listinfo/beowulf > > > > _______________________________________________ > > Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing > > To change your subscription (digest mode or unsubscribe) visit > https://beowulf.org/cgi-bin/mailman/listinfo/beowulf > > -- > Skylar > _______________________________________________ > Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing > To change your subscription (digest mode or unsubscribe) visit > https://beowulf.org/cgi-bin/mailman/listinfo/beowulf >
_______________________________________________ Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing To change your subscription (digest mode or unsubscribe) visit https://beowulf.org/cgi-bin/mailman/listinfo/beowulf
