On Tue, Sep 4, 2012 at 10:26 AM, Jonathan Holloway < jonathan.hollo...@gmail.com> wrote:
> > Has anybody had any success in parallelising Subversion checkouts in the > past on a subfolder level > to improve performance at all? > > By this I mean using svn sparse directories with --depth intermediates to > produce a skeleton structure, > such as: > > project > * subfoldera - handled by a checkout thread > * subfolderb - handled by a checkout thread > > http://svnbook.red-bean.com/en/1.5/svn.advanced.sparsedirs.html > > then forking a process/starting a thread to svn update the subfolders? > Does this make sense from a > performance point of view or is the bottleneck of disk I/O always > hit pretty early on by doing this? > > > http://stackoverflow.com/questions/4160070/can-an-svn-checkout-be-multi-threaded > > I've done this with a Python script and the multiprocessing module (and > daemon processes) so far. I > just wanted to check to see if there was an existing solution to this. > You will not be able to do this with SVN 1.7+ as there is a single working copy admin area that will be locked by the first process that obtains the lock. If you are using HTTP(S), you can switch to using the ra_serf library which opens multiple connections to the server and fetches multiple files at once. In 1.8, this will be the new HTTP client library. -- Thanks Mark Phippard http://markphip.blogspot.com/
