Setting auto properties after file(s) have been committed.

[Jeremy Conlin]

I just created some auto properties settings for my repository.  I
need to now apply these settings to all the files in my repository.
Is there some automated way to do this or do I have to do it manually?

Thanks,
Jeremy

svn load command does not restore all files from dump

[Jeremy Conlin]

I am trying to move my repository from one server to another.  I am
doing this by dumping the repository and moving the dump file and then
creating and loading a new repository on the new server.

The trouble is on the new server, not all of the files are restored.
The "svnadmin load Repo < dumpfile" command finishes (i.e. still shows
up when I do 'ps -aux') yet the size of the repository folder is not
increasing in size; no new data/files are being added.

Can someone provide some assistance with this situation?

Thanks,
Jeremy

svn dump and load not preserving all files

[Jeremy Conlin]

I am migrating my repository to a new server.  This requires that I
dump the original and the create a new repository on the new server
and use the svnadmin load command to import everything.  I have been
able to do this for a few of my repositories, but one in particular
isn't working.  The dump file for this repository is > 9 GB.  The load
command starts out, but never finishes.  The size of my repository
gets to 2.1 GB and then it seems to stop even though the svnadmin load
command is still running.  Eventually (> 24 hours) the command stops
(finishes) but the size of my repository is only 2.1 GB when it should
be around 9 GB.  Also, not all of the files have been restored.

Is there a limit in the size of a dump file that can be used?  I would
be surprised if that limit were around 9 GB.  I'm sure there are
repositories that are much larger than that.

Any ideas on what could be wrong?

Thanks,
Jeremy

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 1:05 PM, Thomas Loy  wrote:
> Which OS?  Some operating systems have file size limits of 4 GB or less.
>
> Cheers,
>
> Tom Loy
>
The original OS was on a Mac, the new OS is some *nix server, probably
Linux.  I don't believe either of these have limitations as small as
4GB.  Am I wrong?

Thanks,
Jeremy


>
> -Original Message-
> From: Jeremy Conlin [mailto:jlcon...@gmail.com]
> Sent: Tuesday, January 19, 2010 3:03 PM
> To: users@subversion.apache.org
> Subject: svn dump and load not preserving all files
>
> I am migrating my repository to a new server.  This requires that I
> dump the original and the create a new repository on the new server
> and use the svnadmin load command to import everything.  I have been
> able to do this for a few of my repositories, but one in particular
> isn't working.  The dump file for this repository is > 9 GB.  The load
> command starts out, but never finishes.  The size of my repository
> gets to 2.1 GB and then it seems to stop even though the svnadmin load
> command is still running.  Eventually (> 24 hours) the command stops
> (finishes) but the size of my repository is only 2.1 GB when it should
> be around 9 GB.  Also, not all of the files have been restored.
>
> Is there a limit in the size of a dump file that can be used?  I would
> be surprised if that limit were around 9 GB.  I'm sure there are
> repositories that are much larger than that.
>
> Any ideas on what could be wrong?
>
> Thanks,
> Jeremy
>

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 1:05 PM, Mark Phippard  wrote:
> On Tue, Jan 19, 2010 at 3:03 PM, Jeremy Conlin  wrote:
>> I am migrating my repository to a new server.  This requires that I
>> dump the original and the create a new repository on the new server
>> and use the svnadmin load command to import everything.  I have been
>> able to do this for a few of my repositories, but one in particular
>> isn't working.  The dump file for this repository is > 9 GB.  The load
>> command starts out, but never finishes.  The size of my repository
>> gets to 2.1 GB and then it seems to stop even though the svnadmin load
>> command is still running.  Eventually (> 24 hours) the command stops
>> (finishes) but the size of my repository is only 2.1 GB when it should
>> be around 9 GB.  Also, not all of the files have been restored.
>>
>> Is there a limit in the size of a dump file that can be used?  I would
>> be surprised if that limit were around 9 GB.  I'm sure there are
>> repositories that are much larger than that.
>>
>> Any ideas on what could be wrong?
>
> Did you direct the svnadmin output to a file that you could tail and
> look for problems?
>
> FWIW, the final size of the repository ought to be significantly
> smaller than the dump file.  I'd check for things like the final
> number of revisions.  If the command did not throw an error, it
> probably worked.

I did redirect the output to a text file.  The command never throws an
error, but never completes either.  There should be 24 revisions in
the repository, but when I check out from the new server, there is
only 1, so something isn't working right.

Jeremy

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 1:27 PM, Mark Phippard  wrote:
> On Tue, Jan 19, 2010 at 3:21 PM, Jeremy Conlin  wrote:
>> On Tue, Jan 19, 2010 at 1:05 PM, Thomas Loy  wrote:
>>> Which OS?  Some operating systems have file size limits of 4 GB or less.
>>>
>>> Cheers,
>>>
>>> Tom Loy
>>>
>> The original OS was on a Mac, the new OS is some *nix server, probably
>> Linux.  I don't believe either of these have limitations as small as
>> 4GB.  Am I wrong?
>
> I doubt any OS has a limit like that.  What can have a limit is 32-bit
> integers for file size.  Typically if your SVN is compiled with APR
> 1.x then it supports files > 2 GB and if it is compiled with APR 0.9.x
> then it does not.
>
> I do not think this would be your problem anyway.  The dump file is
> streamed into svnadmin, so it does not see it as a 9GB file anyway.
> And for the repository itself, it would only manifest as a problem if
> you had a single revision that was 2 GB.  Given that it is a dump
> file, perhaps if a single file in the dump file was 2 GB it could be a
> problem since the size would too big for it to process.
>
> Remember the limit is for a single file in the filesystem.  For a
> repository, that usually means the revision file, which means you
> would need a revision this big.  The entire repository could still
> have a million revision that were 1.9 GB each and be fine.

I do have about 16 files that are each a few hundred MB in size, but
none (that I'm aware of) is over 1GB.  All of the large files were
originally committed in a single revision.

Jeremy

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 1:34 PM, Mark Phippard  wrote:
> On Tue, Jan 19, 2010 at 3:32 PM, Jeremy Conlin  wrote:
>> I did redirect the output to a text file.  The command never throws an
>> error, but never completes either.  There should be 24 revisions in
>> the repository, but when I check out from the new server, there is
>> only 1, so something isn't working right.
>
> OK, definitely.
>
> And if your dump file is 9 GB with only 24 revisions, there is a good
> chance the problem is the size of a single revision.  Basically make
> sure you are using SVN that was compiled against httpd 2.2/apr 1.x.
>

Yes this is most likely true.  I have about 16 files that are a few
hundred MB each and were all originally committed in the same
revision.

I don't own the server where I'm migrating to.  What command can I run
to determine what the compile options were?

Thanks,
Jeremy

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 2:05 PM, Ryan Schmidt
 wrote:
>
> On Jan 19, 2010, at 14:38, Jeremy Conlin wrote:
>
>> On Tue, Jan 19, 2010 at 1:34 PM, Mark Phippard wrote
>>
>>> Basically make
>>> sure you are using SVN that was compiled against httpd 2.2/apr 1.x.
>>
>> Yes this is most likely true.  I have about 16 files that are a few
>> hundred MB each and were all originally committed in the same
>> revision.
>>
>> I don't own the server where I'm migrating to.  What command can I run
>> to determine what the compile options were?
>
> I'm not aware of a command you could run on the client that would get the 
> server to tell you. You'd have to run e.g. otool on the programs and 
> libraries that are on the server. If you don't have access, ask those who do 
> to do it for you.
>
>

Disregard this message.  I just realized that my new server only has
svn 1.4.2 while my original was using 1.6.  I'm sure that is the
problem.  I feel stupid that I didn't check this earlier.

Thanks,
Jeremy

Re: svn dump and load not preserving all files

[Jeremy Conlin]

On Tue, Jan 19, 2010 at 2:18 PM, Mark Phippard  wrote:
>> Disregard this message.  I just realized that my new server only has
>> svn 1.4.2 while my original was using 1.6.  I'm sure that is the
>> problem.  I feel stupid that I didn't check this earlier.
>
> That should not be a problem in terms of moving a dump file between
> them.  1.4 might not have some features you want, but it should still
> load the file.


I installed svn 1.6.6 in my home directory on the remote server and
used it load the dump file and everything worked without any trouble.
So either the original 1.4.2 on the server was missing some compile
options or it was necessary to use 1.6.6.

Things seem to be looking up now.  Thanks everyone for their help.

Jeremy

Is it possible to restore respository from working copy?

[Jeremy Conlin]

Due to my idiocy, I have deleted my svn repositories.  However, I do
have working copies.  Is it possible to restore some versioning
information from my working copies to a new repository?

Thanks,
Jeremy

Re: Is it possible to restore respository from working copy?

[Jeremy Conlin]

On Wed, Mar 10, 2010 at 8:08 AM, Giulio Troccoli
 wrote:
>> Due to my idiocy, I have deleted my svn repositories.
>> However, I do have working copies.  Is it possible to restore
>> some versioning information from my working copies to a new
>> repository?
>
> Unfortunately I don't think so. You can delete all the .svn directories and 
> then import everything into a new repository but you will lose all your 
> history I'm afraid.

That's what I was afraid of, but I thought I would ask first.

Thanks,
Jeremy

format: Permission denied even when read permissions are set

[Jeremy Conlin]

I just created a new repository, and loaded it with some initial
files.  However when I go to checkout from my repository I get the
following:

$ svn checkout svn+ssh://jlcon...@myserver.com/path/to/repos/Repo CP
Password:
svn: Can't open file '/path/to/repos/Repo/format': Permission denied

I can log via ssh to check on the permissions of format and this is
what they are:

$ ls -lh
total 9.5K
-rw-rw-r--  1 jlconlin jlconlin 229 Mar 11 06:55 README.txt
drwxrwxr-x  2 jlconlin jlconlin   5 Mar 11 06:55 conf
drwxrwxr-x  2 jlconlin jlconlin   2 Mar 11 06:55 dav
drwxrwsr-x  5 jlconlin jlconlin  10 Mar 11 06:56 db
-rw-rw-r--  1 jlconlin jlconlin   2 Mar 11 06:55 format
drwxrwxr-x  2 jlconlin jlconlin  11 Mar 11 06:55 hooks
drwxrwxr-x  2 jlconlin jlconlin   4 Mar 11 06:55 locks


It seems clear to me that I have both read and write permissions for
the 'format' file.  When I log in, I can view the file and see that
the format says '5'.

Does anyone know what is going wrong here?

Thanks,
Jeremy

Re: format: Permission denied even when read permissions are set

[Jeremy Conlin]

On Thu, Mar 11, 2010 at 9:27 AM, David Weintraub  wrote:
> The way svn+ssh works is very strange. svnserve is executed by each
> user that uses the svn+ssh protocol. That means that you have to make
> sure that all of these users are in the same group, and that group has
> read/write permission on the entire Subversion archive. Plus, you have
> to set umask for each user, so when they create a new file in the
> Subversion repository, it is read/writeable by everyone in the group.
>
> Take a look at the Tunneling Over SSH chapter in the Subversion on line book:
> .

Thanks for the reminder.  Currently it is just one user (me) that is
accessing this repository and I know I have access to the files and
folder in the directory as I showed in an earlier email and because I
can go inside and see everything.  What else could be wrong?

Thanks,
Jeremy

Re: format: Permission denied even when read permissions are set

[Jeremy Conlin]

On Thu, Mar 11, 2010 at 10:22 AM, David Weintraub  wrote:
> On Thu, Mar 11, 2010 at 12:07 PM, Jeremy Conlin  wrote:
>> On Thu, Mar 11, 2010 at 9:27 AM, David Weintraub  wrote:
>> Thanks for the reminder.  Currently it is just one user (me) that is
>> accessing this repository and I know I have access to the files and
>> folder in the directory as I showed in an earlier email and because I
>> can go inside and see everything.  What else could be wrong?
>
> Is this Subversion repository on your system or on another system? It
> could very well be that when you login as SSH, you are not exactly the
> user you think you are.
>
> Can you SSH directly into that system, check out your user ID and
> verify that its the ID you think it is?

Yes I can do this and I have verified that I am a member of the group
that owns the files and folders of the repository.  The owning group
has read and write permissions.

>
> (Of course, you SHOULDN'T be able to SSH into the Subversion
> repository because that would allow users to munge the repository
> directly which they shouldn't be doing. But if you can, you can at
> least verify that you are who you think you are.)

How can you prevent this and still allow the users to read and write
to the repository?

Thanks,
Jeremy

Expected format problem

[Jeremy Conlin]

I'll bet this is an oft asked question on this list.  I'm getting the error:

svn: Expected FS format '2'; found format '4'

If I understand correctly, this means that my local version of svn
differs from the remote version of svn.  Is this right?  I installed
1.6.9 today on both my local version and my remote version and got the
above error.  Is there something else that I missed here?

Thanks,
Jeremy

local$ /opt/subversion/bin/svn --versionsvn, version 1.6.9 (r901367)
   compiled Jan 25 2010, 22:25:43

Copyright (C) 2000-2009 CollabNet.
Subversion is open source software, see http://subversion.tigris.org/
This product includes software developed by CollabNet (http://www.Collab.Net/).

The following repository access (RA) modules are available:

* ra_neon : Module for accessing a repository via WebDAV protocol using Neon.
  - handles 'http' scheme
  - handles 'https' scheme
* ra_svn : Module for accessing a repository using the svn network protocol.
  - with Cyrus SASL authentication
  - handles 'svn' scheme
* ra_local : Module for accessing a repository on local disk.
  - handles 'file' scheme
* ra_serf : Module for accessing a repository via WebDAV protocol using serf.
  - handles 'http' scheme
  - handles 'https' scheme




remote$ svn --version
svn, version 1.6.9 (r901367)
   compiled Mar 15 2010, 13:27:12

Copyright (C) 2000-2009 CollabNet.
Subversion is open source software, see http://subversion.tigris.org/
This product includes software developed by CollabNet (http://www.Collab.Net/).

The following repository access (RA) modules are available:

* ra_neon : Module for accessing a repository via WebDAV protocol using Neon.
  - handles 'http' scheme
* ra_svn : Module for accessing a repository using the svn network protocol.
  - handles 'svn' scheme
* ra_local : Module for accessing a repository on local disk.
  - handles 'file' scheme
* ra_serf : Module for accessing a repository via WebDAV protocol using serf.
  - handles 'http' scheme
  - handles 'https' scheme

Re: Expected format problem

[Jeremy Conlin]

On Mon, Mar 15, 2010 at 6:06 PM, Ryan Schmidt
 wrote:
> On Mar 15, 2010, at 16:12, Jeremy Conlin wrote:
>
>> I'll bet this is an oft asked question on this list.  I'm getting the error:
>>
>> svn: Expected FS format '2'; found format '4'
>>
>> If I understand correctly, this means that my local version of svn
>> differs from the remote version of svn.  Is this right?
>
> No, it means the version of Subversion that is directly reading the 
> repository is older than the version of Subversion that created the 
> repository.
>
> "Directly reading" means probably the version of Subversion on the server, 
> assuming you are using a repository access protocol other than file:///.

I am accessing the repository via svn+ssh.  I think the problem is
that I have some version in /usr/bin and another version in
~/usr/local/bin.  When I'm logged in, the version used is
~/usr/local/bin and that is 1.6.9.  The version in /usr/bin is 1.4.2.
Is it possible that these versions are getting mixed up?

Thanks,
Jeremy

Re: Expected format problem

[Jeremy Conlin]

On Mon, Mar 15, 2010 at 9:12 PM, Ryan Schmidt
 wrote:
> On Mar 15, 2010, at 22:09, Jeremy Conlin wrote:
>> On Mon, Mar 15, 2010 at 6:06 PM, Ryan Schmidt wrote:
>>> No, it means the version of Subversion that is directly reading the 
>>> repository is older than the version of Subversion that created the 
>>> repository.
>>>
>>> "Directly reading" means probably the version of Subversion on the server, 
>>> assuming you are using a repository access protocol other than file:///.
>>
>> I am accessing the repository via svn+ssh.  I think the problem is
>> that I have some version in /usr/bin and another version in
>> ~/usr/local/bin.  When I'm logged in, the version used is
>> ~/usr/local/bin and that is 1.6.9.  The version in /usr/bin is 1.4.2.
>> Is it possible that these versions are getting mixed up?
>
> Absolutely. The PATH you've defined for use when you log in via ssh 
> interactively isn't necessarily the same PATH that will be used when 
> connecting via ssh non-interactively (such as when using svn+ssh).
>
>

So what is the correct way to set the PATH?

Jeremy

Re: svn+ssh: Expected FS format '2'; found format '4'

[Jeremy Conlin]

I recently had the same problem.  I never quite got it figured out,
but you may have more success than I did.  The important emails can be
found here:
http://mail-archives.apache.org/mod_mbox/subversion-users/201003.mbox/%3c2588da421003151412p115d5f3fo4324170d8b553...@mail.gmail.com%3e

Jeremy

On Sat, Apr 17, 2010 at 8:58 AM, Rainer Dorsch  wrote:
> Hello,
>
> I tried to checkout from a server via svn+ssh:
>
> r...@blackbox:~/Managed/Daten$ svn checkout
> svn+ssh://rdor...@hdcl037/var/svn/OSSM/svn-repository/trunk OSSM
>
> Enter passphrase for key '/home/rd/.ssh/id_rsa':
> rdor...@hdcl037's password:
> svn: Expected FS format '2'; found format '4'
> r...@blackbox:~/Managed/Daten$
>
> I think the problem is that on the server there is a default installation of
> svn:
>
> hdcl037: rdorsch $ svn --version
> svn, version 1.4.2 (r22196)
>   compiled Nov 20 2006, 07:17:37
>
> Copyright (C) 2000-2006 CollabNet.
> Subversion is open source software, see http://subversion.tigris.org/
> This product includes software developed by CollabNet
> (http://www.Collab.Net/).
>
> The following repository access (RA) modules are available:
>
> * ra_dav : Module for accessing a repository via WebDAV (DeltaV) protocol.
>  - handles 'http' scheme
>  - handles 'https' scheme
> * ra_svn : Module for accessing a repository using the svn network protocol.
>  - handles 'svn' scheme
> * ra_local : Module for accessing a repository on local disk.
>  - handles 'file' scheme
>
> hdcl037: rdorsch $
>
> and a more recent version in a non-standard dir (which is added to my path
> in .bash_profile)
>
> hdcl037: rdorsch $ svn --version
> svn, version 1.6.9 (r901367)
>   compiled Apr 16 2010, 15:19:25
>
> Copyright (C) 2000-2009 CollabNet.
> Subversion is open source software, see http://subversion.tigris.org/
> This product includes software developed by CollabNet
> (http://www.Collab.Net/).
>
> The following repository access (RA) modules are available:
>
> * ra_neon : Module for accessing a repository via WebDAV protocol using Neon.
>  - handles 'http' scheme
> * ra_svn : Module for accessing a repository using the svn network protocol.
>  - with Cyrus SASL authentication
>  - handles 'svn' scheme
> * ra_local : Module for accessing a repository on local disk.
>  - handles 'file' scheme
> * ra_serf : Module for accessing a repository via WebDAV protocol using serf.
>  - handles 'http' scheme
>  - handles 'https' scheme
>
> hdcl037: rdorsch $
>
> I expect that .bash_profile is not executed when I do svn+ssh, but it is when
> I do ssh into the host regularly.
>
> I have now root access to the server containing the repository, I cannot use
> keypair authentification.
>
> Any suggestions are welcome.
>
> Thanks,
> Rainer
>
> --
> Rainer Dorsch
> Lärchenstr. 6
> D-72135 Dettenhausen
> 07157-734133
> email: rdor...@web.de
> jabber: rdor...@jabber.org
> GPG Fingerprint: 5966 C54C 2B3C 42CC 1F4F  8F59 E3A8 C538 7519 141E
> Full GPG key: http://pgp.mit.edu/
>

How to speed up subversion

[Jeremy Conlin]

I have a working copy/respository with many files that are several
hundred MB each.  Whenever I try to check the status of my working
copy or do a commit, it can take a long time (~1 min) before I get a
response.  I don't have any externals and the number of total files in
my repository is ~100.  Has anyone else experienced this or knows how
to speed things up?  I'm running svn 1.6.5 on Mac OSX 10.6.2.

Thanks,
Jeremy

Re: How to speed up subversion

[Jeremy Conlin]

On Wed, Apr 21, 2010 at 9:58 AM, Les Mikesell  wrote:
> On 4/21/2010 10:48 AM, Jeremy Conlin wrote:
>>
>> I have a working copy/respository with many files that are several
>> hundred MB each.  Whenever I try to check the status of my working
>> copy or do a commit, it can take a long time (~1 min) before I get a
>> response.  I don't have any externals and the number of total files in
>> my repository is ~100.  Has anyone else experienced this or knows how
>> to speed things up?  I'm running svn 1.6.5 on Mac OSX 10.6.2.
>
> What client-server protocol are you using?  This could be a problem with DNS
> or the authentication method besides whatever svn has to do.

I am using svn+ssh.  I have several other repositories located on the
same server.  These repositories are smaller in the number of MB and
they also have no speed issues as I have with the "big" one.

Jeremy