Re: "svnadmin load" a huge file

2010-12-31 Thread Daniel Shahaf
Split the dumpfile to smaller dumpfiles or try a newer version of svnadmin.

(or dive into the source and help us plug that memory leak --- compile
with APR pool debugging enabled)

Victor Sudakov wrote on Fri, Dec 31, 2010 at 09:07:32 +0600:
> Colleagues, 
> 
> I have a CVS repository sized 54M with 17751 files. 
> 
> "cvs2svn --dumpfile" produces a dump sized 13G. svnadmin cannot load
> this dump aborting with an out of memory condition on a FreeBSD
> 8.1-RELEASE box with 1G of RAM and 2.5G of swap.
> 
> I really need to convert this repository to SVN. What should i do? Any
> advice is appreciated.
> 
> -- 
> Victor Sudakov,  VAS4-RIPE, VAS47-RIPN
> sip:suda...@sibptus.tomsk.ru


Re: "svnadmin load" a huge file

2010-12-31 Thread Victor Sudakov
Daniel Shahaf wrote:
> Split the dumpfile to smaller dumpfiles 

How do I do that? I have not found such an option in cvs2svn. 
I don't mind writing a script if I knew the idea how to split the dump.
I haven't found any "svnadmin load" option to import part of a dump
either. man what?

> or try a newer version of svnadmin.

I am using subversion-1.6.15, it seems to be the latest ported to
FreeBSD.

> 
> (or dive into the source and help us plug that memory leak --- compile
> with APR pool debugging enabled)

I will try to do that but unfortunately I need some immediate
workaround :(

-- 
Victor Sudakov,  VAS4-RIPE, VAS47-RIPN
sip:suda...@sibptus.tomsk.ru


Re: "svnadmin load" a huge file

2010-12-31 Thread Brian Brophy
I migrated a large CVS repository (25-50 GB) to SVN years ago on SVN 
1.3.  Our repo had many sections (projects) within it.  We had to 
migrate each project independently so that it's team could coordinate 
when they migrated to SVN.  As such, I dumped each project when ready 
and then svnadmin loaded each dump into it's own path/root (so as not to 
overwrite anything previously loaded and unrelated to this project's 
import).


So, you can do it by controlling which path/portion of CVS you use 
cvs2vn to create the dump file from.


Brian


Victor Sudakov wrote:

Daniel Shahaf wrote:
  
Split the dumpfile to smaller dumpfiles 



How do I do that? I have not found such an option in cvs2svn. 
I don't mind writing a script if I knew the idea how to split the dump.

I haven't found any "svnadmin load" option to import part of a dump
either. man what?

  

or try a newer version of svnadmin.



I am using subversion-1.6.15, it seems to be the latest ported to
FreeBSD.

  

(or dive into the source and help us plug that memory leak --- compile
with APR pool debugging enabled)



I will try to do that but unfortunately I need some immediate
workaround :(

  


Re: howto replace a file with a symbolic link (without obstruct error)

2010-12-31 Thread Nick
On Thu, 2010-12-30 at 23:03 +0200, Daniel Shahaf wrote:
> > > I also tried:
> > >  
> > >  svn rm a.txt
> > >  ln -s b.txt a.txt
> 
> At this point you need to:
> 
>  svn add a.txt

Thanks, I'll try it the next time I encounter this situation.




Re: "svnadmin load" a huge file

2010-12-31 Thread Victor Sudakov
Brian Brophy wrote:
> I migrated a large CVS repository (25-50 GB) to SVN years ago on SVN 
> 1.3.  Our repo had many sections (projects) within it.  We had to 
> migrate each project independently so that it's team could coordinate 
> when they migrated to SVN.  As such, I dumped each project when ready 
> and then svnadmin loaded each dump into it's own path/root (so as not to 
> overwrite anything previously loaded and unrelated to this project's 
> import).
> 
> So, you can do it by controlling which path/portion of CVS you use 
> cvs2vn to create the dump file from.

The CVS repository in question (with the size 54M with 17751 files) is
exactly one project. It's the history of a geographical DNS zone for
more than 10 years.

-- 
Victor Sudakov,  VAS4-RIPE, VAS47-RIPN
sip:suda...@sibptus.tomsk.ru


Re: "svnadmin load" a huge file

2010-12-31 Thread Stephen Connolly
Google is your friend: svndumptool

You moght need to append a .py

Also if this is a _top post_ it's three phone what done it... Haven't
figured out how to control where it puts the reply

- Stephen

---
Sent from my Android phone, so random spelling mistakes, random nonsense
words and other nonsense are a direct result of using swype to type on the
screen
On 31 Dec 2010 15:10, "Victor Sudakov"  wrote:
> Daniel Shahaf wrote:
>> Split the dumpfile to smaller dumpfiles
>
> How do I do that? I have not found such an option in cvs2svn.
> I don't mind writing a script if I knew the idea how to split the dump.
> I haven't found any "svnadmin load" option to import part of a dump
> either. man what?
>
>> or try a newer version of svnadmin.
>
> I am using subversion-1.6.15, it seems to be the latest ported to
> FreeBSD.
>
>>
>> (or dive into the source and help us plug that memory leak --- compile
>> with APR pool debugging enabled)
>
> I will try to do that but unfortunately I need some immediate
> workaround :(
>
> --
> Victor Sudakov, VAS4-RIPE, VAS47-RIPN
> sip:suda...@sibptus.tomsk.ru 


Re: "svnadmin load" a huge file

2010-12-31 Thread Daniel Shahaf
> On 31 Dec 2010 15:10, "Victor Sudakov"  wrote:
> > Daniel Shahaf wrote:
> >> (or dive into the source and help us plug that memory leak --- compile
> >> with APR pool debugging enabled)
> >
> > I will try to do that but unfortunately I need some immediate
> > workaround :(
> >

Thanks.  I was referring specifically to -DAPR_POOL_DEBUG=19; there's
more information in HACKING:
http://subversion.apache.org/docs/community-guide/


Stephen Connolly wrote on Fri, Dec 31, 2010 at 16:22:56 +:
> Google is your friend: svndumptool
> 

That's a better suggestion than I would have made.