Re: Parallel make across multiple connected systems.

2024-11-28 Thread Eli Zaretskii
> From: Sean Godsell > Date: Wed, 27 Nov 2024 17:00:27 -0500 > > I was wondering if anyone has any plans to make the actual 'make' command > work across multiple > connected PC systems, via networking of some kind. It could be wireless > networking, ethernet, or even > networking through thund

Re: Parallel make across multiple connected systems.

2024-11-27 Thread Henrik Carlqvist
On Wed, 27 Nov 2024 17:00:27 -0500 Sean Godsell wrote: > I was wondering if anyone has any plans to make the actual 'make' command > work across multiple connected PC systems, via networking of some kind. It > could be wireless networking, ethernet, or even networking through > thunderbolt, usb 4

RE: Parallel make Order Algorithm

2015-07-14 Thread Martin Dorey
> I have the feeling that the second algorithm has a bottleneck: The algorithm you describe is a feature of your makefile(s) rather than make. Make doesn't really know about the traditional three phases of a large C project that you describe. It's just as happy driving an assembler, preparing

Re: Parallel make with distributed systems

2015-05-03 Thread SF Markus Elfring
> The question is, why is it the case that these challenges, tasks, work, > and constraints need to be handled within make itself, > rather than farmed out to a separate process via the SHELL capability? Does it matter to get the accounting for the processor cores right? > Offhand I can't see an

Re: Parallel make with distributed systems

2015-05-03 Thread Paul Smith
On Sun, 2015-05-03 at 09:31 +0200, SF Markus Elfring wrote: > > I have nothing against doing more than that in theory, but before I'd > > agree to add something complex I'd need to understand where the existing > > method fails, and the new method would provide significant benefits. > > I guess th

Re: Parallel make with distributed systems

2015-05-03 Thread SF Markus Elfring
> I have nothing against doing more than that in theory, but before I'd > agree to add something complex I'd need to understand where the existing > method fails, and the new method would provide significant benefits. I guess that there are some software development challenges around the specifica

Re: Parallel make

2015-05-02 Thread Paul Smith
On Thu, 2015-04-30 at 08:18 +0200, SF Markus Elfring wrote: > > GNU make has no built-in capability to use multiple machines: > > How are the chances to integrate additional job submission systems? Well, make already HAS a hook available to anyone who wants to use a different job submission syste

Re: Parallel make

2015-04-29 Thread SF Markus Elfring
> GNU make has no built-in capability to use multiple machines: How are the chances to integrate additional job submission systems? > conceptually it may be a straightforward extension but the effort needed > to communicate between multiple systems over a network, send and receive > results reli

Re: Parallel make

2015-04-29 Thread Edward Welbourne
> We ran into similar things in Linux due to NFS, autofs, and NFS via > apparmor not scaling well when 100 compilers are trying to search for > header files through a long number of sourcedirs. I suppose this can be mitigated by using #include "path/to/file.h" in source, for paths relative to a sm

Re: Parallel make

2015-04-29 Thread Edward Welbourne
> Luckily, if you are building C or C++ code someone has already done all > the necessary work for you. I recommend you investigate the distcc > package: https://code.google.com/p/distcc/ Likewise the icecream project's icecc: https://en.opensuse.org/Icecream https://github.com/icecc/icecream I'

Re: Parallel make

2015-04-29 Thread Kruppa, Jason
Last time I looked at distcc, it still ran the c++ preprocessor on the main machine (to eliminate the risk of different machines having different configurations), and then sent the preprocessed files to the various machines at its disposal. This, in my experience, still does a huge portion of t

Re: Parallel make

2015-04-29 Thread Tim Murphy
Without wanting to turn this into a commercial/advert you might want to consider trying the Electric Cloud Huddle beta since it works with multiple machines in a convenient way and deals with the problems of getting correct parallel builds. It is also free for now at least. Sorry for that :) On 29

Re: Parallel make

2015-04-29 Thread Paul Smith
On Wed, 2015-04-29 at 13:50 -0600, Ryan P. Steele wrote: > The multithreaded version of make (-j#) is wonderful, and we have made > great use of it. Because we're dealing with some very large code, > however, it would be great to be able to parallelize compilation over > multiple machines. I ca

Re: parallel make bug

2000-06-08 Thread Paul D. Smith
%% "P. Jeffrey Ungar" <[EMAIL PROTECTED]> writes: pju> If a command for a rule is a submake, but the command is pju> contained in a variable, then it can't run the submake in pju> parallel. You get an error message: pju> gmake[1]: warning: jobserver unavailable: using -j1. Add `+' to pa