High availability

[Ullrich.Jans]

Hi,

I'm running a rather large Subversion installation (>1000 repos, >1 TB total 
storage, >1000 users). I'm looking for advice how to improve our availability. 
We're currently quite good, but I'm a bit worried about e.g. hardware failure. 
Performance is not an issue for now (machine load <2, at about 20 svn-requests 
per second).

How are you out there doing it? I have a few ideas, but I'd like to hear the 
opinions of others and get maybe some pointers for more research.

My ideas:

* use svnsync replication. Drawback: failure needs manual intervention, hook 
scripts need to be transferred manually.
* use an active-passive cluster with e.g. heartbeat. That would be possible, 
the data reside on a SAN anyway.
* use an active-active cluster with two separate machines sharing the storage 
via a cluster fs (GFS? GPFS?) with a HA load balancer in front. Probably the 
sexiest solution ;-)
* I already discarded the idea of using active-active with NFS since I can 
remember the reports of strange failures...

Does anyone here know how other large/high profile sites (e.g. the Apache 
foundation) are ensuring availability? I couldn't find any hints at the 
website...

Cheers,

Ulli

-- 
Ullrich Jans, Specialist, IT-A
Phone: +49 9131 7701-6627, mailto:ullrich.j...@elektrobit.com
Fax: +49 9131 7701-6333, www.elektrobit.com

Elektrobit Automotive GmbH, Am Wolfsmantel 46, 91058 Erlangen, Germany Managing 
Directors: Alexander Kocher, Gregor Zink Register Court Fürth HRB 4886 





Please note: This e-mail may contain confidential information
intended solely for the addressee. If you have received this
e-mail in error, please do not disclose it to anyone, notify
the sender promptly, and delete the message from your system.
Thank you.

SVN without additional copies of the data in the .svn folders

[Christian Möllering]

Hello,

we have started using SVN not only for code, but for all documents used. In 
that case, the additional copies of the data in the .svn folders (on client 
side) take a lot of disk space, while with these kind of data, diffs etc. will 
never be done.

Is it possible to omit these additional copies by option or patch? Or will it 
perhaps be possible in the near future (1.7 brought a lot of enhancements!)?

Best regards

Christian

Re: SVN without additional copies of the data in the .svn folders

[Ryan Schmidt]

On Oct 4, 2012, at 02:18, Christian Möllering wrote:

> we have started using SVN not only for code, but for all documents used. In 
> that case, the additional copies of the data in the .svn folders (on client 
> side) take a lot of disk space, while with these kind of data, diffs etc. 
> will never be done.
> 
> Is it possible to omit these additional copies by option or patch? Or will it 
> perhaps be possible in the near future (1.7 brought a lot of enhancements!)?

No, it's not possible yet. Here's the request:

http://subversion.tigris.org/issues/show_bug.cgi?id=525

Here's the related request to allow compressed pristines:

http://subversion.tigris.org/issues/show_bug.cgi?id=908

Re: High availability

[Nico Kadel-Garcia]

On Thu, Oct 4, 2012 at 3:19 AM,   wrote:
> Hi,
>
> I'm running a rather large Subversion installation (>1000 repos, >1 TB total 
> storage, >1000 users). I'm looking for advice how to improve our 
> availability. We're currently quite good, but I'm a bit worried about e.g. 
> hardware failure. Performance is not an issue for now (machine load <2, at 
> about 20 svn-requests per second).
>
> How are you out there doing it? I have a few ideas, but I'd like to hear the 
> opinions of others and get maybe some pointers for more research.

Go call WanDisco. They have *precisely* this sort of high availability
setup in their commercial offerings, with consensus based selection of
a Subversion "master" among a set of synchronized distinct Subversion
servers, and I strongly suspect it's a lot more economical to buy
their product than spend your time implementing it from scratch.

> My ideas:
>
> * use svnsync replication. Drawback: failure needs manual intervention, hook 
> scripts need to be transferred manually.
> * use an active-passive cluster with e.g. heartbeat. That would be possible, 
> the data reside on a SAN anyway.
> * use an active-active cluster with two separate machines sharing the storage 
> via a cluster fs (GFS? GPFS?) with a HA load balancer in front. Probably the 
> sexiest solution ;-)
> * I already discarded the idea of using active-active with NFS since I can 
> remember the reports of strange failures...
>
> Does anyone here know how other large/high profile sites (e.g. the Apache 
> foundation) are ensuring availability? I couldn't find any hints at the 
> website...
>
> Cheers,
>
> Ulli
>
> --
> Ullrich Jans, Specialist, IT-A
> Phone: +49 9131 7701-6627, mailto:ullrich.j...@elektrobit.com
> Fax: +49 9131 7701-6333, www.elektrobit.com
>
> Elektrobit Automotive GmbH, Am Wolfsmantel 46, 91058 Erlangen, Germany 
> Managing Directors: Alexander Kocher, Gregor Zink Register Court Fürth HRB 
> 4886
>
>
>
>
> 
> Please note: This e-mail may contain confidential information
> intended solely for the addressee. If you have received this
> e-mail in error, please do not disclose it to anyone, notify
> the sender promptly, and delete the message from your system.
> Thank you.
>

Authetication Problem

[Ajay Pawar]

Hi,
 One of the SVN user is not able to connect to the SVN repository.
When he enters the Authentication Credentials the Authentication POP UP windows 
comes again-2.

Need your help.

Regards,
Ajay Pawar

Re: Authetication Problem

[vishwajeet singh]

On Thu, Oct 4, 2012 at 2:27 PM, Ajay Pawar wrote:

>  Hi,
>
>  One of the SVN user is not able to connect to the SVN repository.
>
> When he enters the Authentication Credentials the Authentication POP UP
> windows comes again-2.
>

which protocol you are running subversion server ?

Please check Apache log if you are using http protocol and also what's the
authentication configuration on Apache side.


> 
>
> ** **
>
> Need your help.
>
> ** **
>
> Regards,
>
> Ajay Pawar
>
> ** **
>
> ** **
>
> This message contains information that may be privileged or confidential
> and is the property of the KPIT Cummins Infosystems Ltd. It is intended
> only for the person to whom it is addressed. If you are not the intended
> recipient, you are not authorized to read, print, retain copy, disseminate,
> distribute, or use this message or any part thereof. If you receive this
> message in error, please notify the sender immediately and delete all
> copies of this message. KPIT Cummins Infosystems Ltd. does not accept any
> liability for virus infected mails.
>



-- 
Vishwajeet Singh
+91-9657702154 | dextrou...@gmail.com | http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn:
http://www.linkedin.com/in/singhvishwajeet

RE: Authetication Problem

[Cooke, Mark]

Hello,

Please post in plain text without the un-enforceable footnote if possible, 
thanks!

> -Original Message-
> From: Ajay Pawar [mailto:ajay.pa...@kpitcummins.com] 
> Sent: 04 October 2012 09:57
> To: users@subversion.apache.org
> Cc: Ajay Pawar
> Subject: Authetication Problem
> 
> Hi,
> 
> One of the SVN user is not able to connect to the SVN repository.
> 
> When he enters the Authentication Credentials the 
> Authentication POP UP windows comes again-2.

It helps to give more background information about your configuration.  What 
sort of authentication are you using, how are you serving subversion (apache, 
svnserve, http(s), etc), client used (TortoiseSVN, command line etc).

However, I recently had issues with specific users and it turned out to be 
"unusual" characters in the password.  In our case a "£" (UK currency) sign.  
Can you ask the user to try a different (simpler) password?

~ Mark C

> Need your help.
> 
> Regards,
> 
> Ajay Pawar

RE: High availability

[Ullrich.Jans]

Hi Nico,

> -Original Message-
> From: Nico Kadel-Garcia [mailto:nka...@gmail.com]
> Sent: Thursday, October 04, 2012 10:30 AM
> To: Jans Ullrich
> Cc: users@subversion.apache.org
> Subject: Re: High availability
> 
> Go call WanDisco. They have *precisely* this sort of high availability
> setup in their commercial offerings, with consensus based selection of
> a Subversion "master" among a set of synchronized distinct Subversion
> servers, and I strongly suspect it's a lot more economical to buy
> their product than spend your time implementing it from scratch.

That's part of the problem: at 1000+ users, their licensing costs tend to 
become rather high. (At least, last time I checked - currently, I can't seem
to find a price list.) 

I'll call them anyway, but doing my job properly will require me to at least
look at the cost of alternatives.

Cheers,

Ulli



Please note: This e-mail may contain confidential information
intended solely for the addressee. If you have received this
e-mail in error, please do not disclose it to anyone, notify
the sender promptly, and delete the message from your system.
Thank you.

RE: Authetication Problem

[Ajay Pawar]

We are using https protocol.

Where do I find the Apache log file on the server machine ?

Thanks

From: vishwajeet singh [mailto:dextrou...@gmail.com]
Sent: Thursday, October 04, 2012 2:35 PM
To: Ajay Pawar
Cc: users@subversion.apache.org
Subject: Re: Authetication Problem


On Thu, Oct 4, 2012 at 2:27 PM, Ajay Pawar 
mailto:ajay.pa...@kpitcummins.com>> wrote:
Hi,
 One of the SVN user is not able to connect to the SVN repository.
When he enters the Authentication Credentials the Authentication POP UP windows 
comes again-2.

which protocol you are running subversion server ?

Please check Apache log if you are using http protocol and also what's the 
authentication configuration on Apache side.


Need your help.

Regards,
Ajay Pawar



This message contains information that may be privileged or confidential and is 
the property of the KPIT Cummins Infosystems Ltd. It is intended only for the 
person to whom it is addressed. If you are not the intended recipient, you are 
not authorized to read, print, retain copy, disseminate, distribute, or use 
this message or any part thereof. If you receive this message in error, please 
notify the sender immediately and delete all copies of this message. KPIT 
Cummins Infosystems Ltd. does not accept any liability for virus infected mails.



--
Vishwajeet Singh
+91-9657702154 | dextrou...@gmail.com | 
http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn: 
http://www.linkedin.com/in/singhvishwajeet

Re: Authetication Problem

[vishwajeet singh]

On Thu, Oct 4, 2012 at 3:06 PM, Ajay Pawar wrote:

>  We are using https protocol.
>
> ** **
>
> Where do I find the Apache log file on the server machine ?
>

That again depends on OS you are running on windows it will be in same
directory as Apache install directory on linux it will be in /var/log/httpd/

Are you using ldap authentication ? If so in a likely scenario his password
might be locked.


> 
>
> ** **
>
> Thanks
>
> ** **
>
> *From:* vishwajeet singh [mailto:dextrou...@gmail.com]
> *Sent:* Thursday, October 04, 2012 2:35 PM
> *To:* Ajay Pawar
> *Cc:* users@subversion.apache.org
> *Subject:* Re: Authetication Problem
>
> ** **
>
> ** **
>
> On Thu, Oct 4, 2012 at 2:27 PM, Ajay Pawar 
> wrote:
>
> Hi,
>
>  One of the SVN user is not able to connect to the SVN repository.
>
> When he enters the Authentication Credentials the Authentication POP UP
> windows comes again-2.
>
> ** **
>
> which protocol you are running subversion server ?
>
> ** **
>
> Please check Apache log if you are using http protocol and also what's the
> authentication configuration on Apache side.
>
>  
>
>   
>
> Need your help.
>
>  
>
> Regards,
>
> Ajay Pawar
>
>  
>
>  
>
>
> This message contains information that may be privileged or confidential
> and is the property of the KPIT Cummins Infosystems Ltd. It is intended
> only for the person to whom it is addressed. If you are not the intended
> recipient, you are not authorized to read, print, retain copy, disseminate,
> distribute, or use this message or any part thereof. If you receive this
> message in error, please notify the sender immediately and delete all
> copies of this message. KPIT Cummins Infosystems Ltd. does not accept any
> liability for virus infected mails. 
>
>
>
> 
>
> ** **
>
> --
> Vishwajeet Singh
> +91-9657702154 | dextrou...@gmail.com | http://bootstraptoday.com
> Twitter: http://twitter.com/vishwajeets | LinkedIn:
> http://www.linkedin.com/in/singhvishwajeet
>
> This message contains information that may be privileged or confidential
> and is the property of the KPIT Cummins Infosystems Ltd. It is intended
> only for the person to whom it is addressed. If you are not the intended
> recipient, you are not authorized to read, print, retain copy, disseminate,
> distribute, or use this message or any part thereof. If you receive this
> message in error, please notify the sender immediately and delete all
> copies of this message. KPIT Cummins Infosystems Ltd. does not accept any
> liability for virus infected mails.
>



-- 
Vishwajeet Singh
+91-9657702154 | dextrou...@gmail.com | http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn:
http://www.linkedin.com/in/singhvishwajeet

RE: Authetication Problem

[Ajay Pawar]

Visual SVN Server 2.5.5
OS Windows Server 2003
Client Tortoise SVN 1.7.5
Basic Authentication - LDAP

From: vishwajeet singh [mailto:dextrou...@gmail.com]
Sent: Thursday, October 04, 2012 3:10 PM
To: Ajay Pawar
Cc: users@subversion.apache.org
Subject: Re: Authetication Problem


On Thu, Oct 4, 2012 at 3:06 PM, Ajay Pawar 
mailto:ajay.pa...@kpitcummins.com>> wrote:
We are using https protocol.

Where do I find the Apache log file on the server machine ?

That again depends on OS you are running on windows it will be in same 
directory as Apache install directory on linux it will be in /var/log/httpd/

Are you using ldap authentication ? If so in a likely scenario his password 
might be locked.


Thanks

From: vishwajeet singh 
[mailto:dextrou...@gmail.com]
Sent: Thursday, October 04, 2012 2:35 PM
To: Ajay Pawar
Cc: users@subversion.apache.org
Subject: Re: Authetication Problem


On Thu, Oct 4, 2012 at 2:27 PM, Ajay Pawar 
mailto:ajay.pa...@kpitcummins.com>> wrote:
Hi,
 One of the SVN user is not able to connect to the SVN repository.
When he enters the Authentication Credentials the Authentication POP UP windows 
comes again-2.

which protocol you are running subversion server ?

Please check Apache log if you are using http protocol and also what's the 
authentication configuration on Apache side.


Need your help.

Regards,
Ajay Pawar



This message contains information that may be privileged or confidential and is 
the property of the KPIT Cummins Infosystems Ltd. It is intended only for the 
person to whom it is addressed. If you are not the intended recipient, you are 
not authorized to read, print, retain copy, disseminate, distribute, or use 
this message or any part thereof. If you receive this message in error, please 
notify the sender immediately and delete all copies of this message. KPIT 
Cummins Infosystems Ltd. does not accept any liability for virus infected mails.



--
Vishwajeet Singh
+91-9657702154 | 
dextrou...@gmail.com | http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn: 
http://www.linkedin.com/in/singhvishwajeet

This message contains information that may be privileged or confidential and is 
the property of the KPIT Cummins Infosystems Ltd. It is intended only for the 
person to whom it is addressed. If you are not the intended recipient, you are 
not authorized to read, print, retain copy, disseminate, distribute, or use 
this message or any part thereof. If you receive this message in error, please 
notify the sender immediately and delete all copies of this message. KPIT 
Cummins Infosystems Ltd. does not accept any liability for virus infected mails.



--
Vishwajeet Singh
+91-9657702154 | dextrou...@gmail.com | 
http://bootstraptoday.com
Twitter: http://twitter.com/vishwajeets | LinkedIn: 
http://www.linkedin.com/in/singhvishwajeet

Re: Authetication Problem

[Thorsten Schöning]

Guten Tag Ajay Pawar,
am Donnerstag, 4. Oktober 2012 um 11:36 schrieben Sie:

> Where do I find the Apache log file on the server machine ?

You should really be better prepared when asking for support on
mailing lists, often details are everything. Not only that your httpd
can be installed anyway on your server, even for default locations you
should at least provide the OS of your server. And no, we can't tell
you how to "find" it. ;-)

Mit freundlichen Grüßen,

Thorsten Schöning

-- 
Thorsten Schöning   E-Mail:thorsten.schoen...@am-soft.de
AM-SoFT IT-Systeme  http://www.AM-SoFT.de/

Telefon.030-2 1001-310
Fax...05151-  9468- 88
Mobil..0178-8 9468- 04

AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow

Authentication Error

[Ajay Pawar]

Hi

I am facing an authentication problem, I am not able to connect to the SVN 
repository.
When I enter user credentials i.e. User and Password the Authentication Windows 
again pop -up.

Details of the Server and client machine :

Using Visual Server 2.5.5 on windows server 2003
Client machine  having Tortoise SVN 1.7.5

Authentication  Details :
1. Use Windows Authentication
2. Basic Authentication

Using LDAP Integration  for login to SVN

Thanks in advance

Ajay Pawar

Re: High availability

[Daniel Shahaf]

ullrich.j...@elektrobit.com wrote on Thu, Oct 04, 2012 at 07:19:10 +:
> Does anyone here know how other large/high profile sites (e.g. the Apache 
> foundation) are ensuring availability? I couldn't find any hints at the 
> website...

https://www.apache.org/dev/machines

We use raidz2 plus dual SSDs for a 'cache' vdev, and additionally we
keep an svnsync mirror on the other side of the ocean.  For futher
questions feel free to ping on .

The amount of data is under 200GB, at last count.

> 
> Cheers,
> 
> Ulli
> 
> -- 
> Ullrich Jans, Specialist, IT-A
> Phone: +49 9131 7701-6627, mailto:ullrich.j...@elektrobit.com
> Fax: +49 9131 7701-6333, www.elektrobit.com
> 
> Elektrobit Automotive GmbH, Am Wolfsmantel 46, 91058 Erlangen, Germany 
> Managing Directors: Alexander Kocher, Gregor Zink Register Court Fürth HRB 
> 4886 
> 
> 
> 
> 
> 
> Please note: This e-mail may contain confidential information
> intended solely for the addressee. If you have received this
> e-mail in error, please do not disclose it to anyone, notify
> the sender promptly, and delete the message from your system.
> Thank you.
> 

svn:eol-style native and reintegrate merge

[James French]

Hi,

Using svn 1.7.6 and working on a dev branch I wrote a script to set 
svn:eol-style=native on all source code files, because we develop on Mac and 
PC. When I tried to check in it kept failing on files that had inconsistent 
line endings so I kept fixing them until I was able to check in. So far so 
good. The diff of the checkin showed that files with consistent line endings 
(99% of them) simply had the svn:eol-style=native property on them which is 
what I expected. Now that I come to reintegrate however I have had a shock - it 
has converted all files to unix line endings (and I'm on a PC). We do our sync 
up merges with the --ignore-eol-style style switch (to be honest I'm not sure 
exactly what this does). I tried reintegrating with and without switch and it 
does the same - everything has unix line endings. Maybe its just some weird 
glitch and it won't really change the line endings but I'm too scared to check 
in to find out. Tomorrow I'm going to try with 1.6 and see what that does.

What the hell is going on?

Cheers,
James

svn:eol-style native and reintegrate merge

[James French]

Hi,

Using svn 1.7.6 and working on a dev branch I wrote a script to set 
svn:eol-style=native on all source code files, because we develop on Mac and 
PC. When I tried to check in it kept failing on files that had inconsistent 
line endings so I kept fixing them until I was able to check in. So far so 
good. The diff of the checkin showed that files with consistent line endings 
(99% of them) simply had the svn:eol-style=native property on them which is 
what I expected. Now that I come to reintegrate however I have had a shock - it 
has converted all files to unix line endings (and I'm on a PC). We do our sync 
up merges with the --ignore-eol-style style switch (to be honest I'm not sure 
exactly what this does). I tried reintegrating with and without switch and it 
does the same - everything has unix line endings. Maybe its just some weird 
glitch and it won't really change the line endings but I'm too scared to check 
in to find out. Tomorrow I'm going to try with 1.6 and see what that does.

What the hell is going on?

Cheers,
James

svn:eol-style native and reintegrate merge

[James French]

Hi,

Using svn 1.7.6 and working on a dev branch I wrote a script to set 
svn:eol-style=native on all source code files, because we develop on Mac and 
PC. When I tried to check in it kept failing on files that had inconsistent 
line endings so I kept fixing them until I was able to check in. So far so 
good. The diff of the checkin showed that files with consistent line endings 
(99% of them) simply had the svn:eol-style=native property on them which is 
what I expected. Now that I come to reintegrate however I have had a shock - it 
has converted all files to unix line endings (and I'm on a PC). We do our sync 
up merges with the --ignore-eol-style style switch (to be honest I'm not sure 
exactly what this does). I tried reintegrating with and without switch and it 
does the same - everything has unix line endings. Maybe its just some weird 
glitch and it won't really change the line endings but I'm too scared to check 
in to find out. Tomorrow I'm going to try with 1.6 and see what that does.

What the hell is going on?

Cheers,
James

Re: svn:eol-style native and reintegrate merge

[Thorsten Schöning]

Guten Tag James French,
am Donnerstag, 4. Oktober 2012 um 23:38 schrieben Sie:

> Now
> that I come to reintegrate however I have had a shock - it has
> converted all files to unix line endings (and I'm on a PC).

On native eol-style, Subversion internally stores LF line endings.

> Note that Subversion will actually store the file in the repository
> using normalized LF EOL markers regardless of the operating system.
> This is basically transparent to the user, though.

http://svnbook.red-bean.com/en/1.7/svn.advanced.props.file-portability.html#svn.advanced.props.special.eol-style

> We do
> our sync up merges with the --ignore-eol-style style switch (to be
> honest I'm not sure exactly what this does).

> --ignore-eol-style:
>   Ignore changes in EOL style.

I would expect that your merges set the new native eol-property on the
files you committed and Subversion harmonizes files to LF line endings,
but all other changes to line endings get ignored. Which should be
what you expect, as native eol-property says that the subversion
client should handle line endings on commits and updates depending on
your OS.

> I tried reintegrating
> with and without switch and it does the same - everything has unix
> line endings.

Where exactly has anything Unix line endings? After your merge in the
working copy, but before a commit or after a commit in another,
updated working copy? I think this is the real problem and everything
is working fine, you just have to look to the files after the proper
operation. If there is a problem it surely is in the handling after
fetching files form the repo, as in the repo as documented above each
file should have Unix line endings in your case.

In my opinion I think the better approach is to use proper tools which
work with different line endings and for example define which to use
as part of a code style.

Mit freundlichen Grüßen,

Thorsten Schöning

-- 
Thorsten Schöning   E-Mail:thorsten.schoen...@am-soft.de
AM-SoFT IT-Systeme  http://www.AM-SoFT.de/

Telefon.030-2 1001-310
Fax...05151-  9468- 88
Mobil..0178-8 9468- 04

AM-SoFT GmbH IT-Systeme, Brandenburger Str. 7c, 31789 Hameln
AG Hannover HRB 207 694 - Geschäftsführer: Andreas Muchow