Re: Installing a svn server on openshift
Yuri Nachitov wrote: > Does anyone install the svn server on openshift or other PaaS ? Yes. ( http://www.catb.org/esr/faqs/smart-questions.html ?) Andreas
svnrdump produce a strange dump file
Hello, I have a Subversion 1.6.17 server running on Debian Linux and access through HTTPS. I used both Subversion 1.8.10 and Subversion 1.9.2 to produce a partial dump of the repository: svnrdump dump -r 51686:77787 https://myhost/subversion/repository/PROJECT/trunk/amodule | gzip > amodule.dump.gz I got a version 3 dump which has the following trouble: almost all files content begins with a strange "SVN" binary sequence. Here is an excerpt of the dump itself for such a file: Node-path: trunk/amodule/pom.xml Node-kind: file Node-action: add Prop-delta: true Prop-content-length: 10 Text-delta: true Text-content-length: 3271 Text-content-md5: 1e6f17c85e486bfec9b0f71291cad435 Content-length: 3281 PROPS-END SVN^@^@^@<99>9^C<99>9<80><99>9http://maven.apache.org/POM/4.0.0"; xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";> As a result, load operation fails as Text-content-md5 cannot be verified. According to documentation svnrdump is compatible with Subversion server 1.4 for dump. What is wrong ? Thank you in advance for your help -- Yves Martin
SVN/Apache - Log full transaction I/O across clients.
I've recently configured svn usage logs with:
LogFormat "%h %t %u (%{SVN-REPOS-NAME}e %{SVN-ACTION}e) %s (%I/%O in %Ts) %k
\"%{User-Agent}i\"" svn
CustomLog /var/log/svn/svn-usage.log svn env=SVN-ACTION
mod_logio is enabled, so I'm getting values written to each of the above
fields, but when testing with a full checkout of a ~420Mb repo (excluding
pristine), I get variable results depending on the client. Sometimes the log
entry appears within 4 seconds and reports ~1MB:
192.168.1.2 [01/Oct/2015:11:42:50 +0100] user (svn get-inherited-props /trunk
r1084) 200 (543/292 in 0s) 4 "SVN/1.8.13 (x64-microsoft-windows) serf/1.3.8"
192.168.1.2 [01/Oct/2015:11:42:50 +0100] user (svn checkout-or-export /trunk
r1084) 200 (726/11527999 in 11s) 5 "SVN/1.8.13 (x64-microsoft-windows)
serf/1.3.8"
Sometimes the log only reports the checkout, but with the correct size:
192.168.1.2 [01/Oct/2015:11:43:55 +0100] user (svn checkout-or-export /trunk
r1084) 200 (729/665066747 in 171s) 3 "SVN/1.7.20 neon/0.29.6"
The exact %I, %O and %T will vary a little with each test, but the log entry
appears after the first ~5s/~10MB of a checkout that takes 3 minutes. The
difference between the above two is that the first checkout is via command-line
SVn (part of Tortoise), using Serf and the latter is via the OSX developer
tools svn command line (Currently 1.7.20 and built against Neon).
I've disabled compression both at SVNCompressionLevel and disabling
mod_deflate. (The data sizes logged were much smaller previously, but the issue
was still there).
Is there a way I can ensure the log is only written after the full request has
been serviced? The data over time will be really useful in gauging usage over
time.
Environment:
* Debian Jessie/Apache 2.4.10
* mod_dav_svn 1.8.14 Compiled from source. - Basic auth. No SSL.
* Client: Windows 7 - Command line (From Tortoise SVN 1.8.13) / OSX Yosemite
shell (1.7.20 from OSX Developer Tools)
Config:
SVNCompressionLevel 0
SVNCacheTextDeltas On
SVNCacheFullTexts On
SVNCacheRevProps On
SVNInMemoryCacheSize 262144
Common repo config (Path and AuthName set per Location)
AuthType Basic
AuthUserFile xxx
Require valid-user
AuthzSVNAccessFile yyy
Order allow,deny
Allow from all
# Common SVN.
DAV svn
# Misc:
Options +FollowSymLinks +Indexes
SVNIndexXSLT "/svnindex.xsl"
Thanks,
Terry.
Re: :Installing a svn server on openshift
Sorry, I need to update my question If anyone (Andreas Stieger, for example) knowing how to install the svn server on PaaS (openshift, heroku, etc) please tell me how to do it. I need to maintain the simple svn server with root access to authz file with user list. Thank you! четверг, 1 октября 2015 г. пользователь Yuri Nachitov написал: > Hello! > > Does anyone install the svn server on openshift or other PaaS ? > >
Re: svnrdump produce a strange dump file
Yves Martin writes: > I got a version 3 dump which has the following trouble: almost all files > content begins with a strange "SVN" binary sequence. That's normal: dump is a binary format and that is the start of some data in svndiff format. > As a result, load operation fails as Text-content-md5 cannot be verified. Load will handle svndiff format so that is not the cause of the failure. > According to documentation svnrdump is compatible with Subversion server > 1.4 for dump. What is wrong ? Your dump file may be corrupt but you have not provided enough details for us to be able to determine what caused it. You could start by giving us the commands you used to dump and load and the error message you received. If you are manipulating the dump file and assuming that it is a text file then you may corrupt it. -- Philip Martin WANdisco
Re: SVN/Apache - Log full transaction I/O across clients.
On Thu, Oct 1, 2015 at 12:57 PM, Terry Dooher
wrote:
> I've recently configured svn usage logs with:
>
> LogFormat "%h %t %u (%{SVN-REPOS-NAME}e %{SVN-ACTION}e) %s (%I/%O in %Ts) %k
> \"%{User-Agent}i\"" svn
> CustomLog /var/log/svn/svn-usage.log svn env=SVN-ACTION
>
> mod_logio is enabled, so I'm getting values written to each of the above
> fields, but when testing with a full checkout of a ~420Mb repo (excluding
> pristine), I get variable results depending on the client. Sometimes the log
> entry appears within 4 seconds and reports ~1MB:
>
> 192.168.1.2 [01/Oct/2015:11:42:50 +0100] user (svn get-inherited-props /trunk
> r1084) 200 (543/292 in 0s) 4 "SVN/1.8.13 (x64-microsoft-windows) serf/1.3.8"
> 192.168.1.2 [01/Oct/2015:11:42:50 +0100] user (svn checkout-or-export /trunk
> r1084) 200 (726/11527999 in 11s) 5 "SVN/1.8.13 (x64-microsoft-windows)
> serf/1.3.8"
>
> Sometimes the log only reports the checkout, but with the correct size:
>
> 192.168.1.2 [01/Oct/2015:11:43:55 +0100] user (svn checkout-or-export /trunk
> r1084) 200 (729/665066747 in 171s) 3 "SVN/1.7.20 neon/0.29.6"
>
> The exact %I, %O and %T will vary a little with each test, but the log entry
> appears after the first ~5s/~10MB of a checkout that takes 3 minutes. The
> difference between the above two is that the first checkout is via
> command-line SVn (part of Tortoise), using Serf and the latter is via the OSX
> developer tools svn command line (Currently 1.7.20 and built against Neon).
>
> I've disabled compression both at SVNCompressionLevel and disabling
> mod_deflate. (The data sizes logged were much smaller previously, but the
> issue was still there).
>
> Is there a way I can ensure the log is only written after the full request
> has been serviced? The data over time will be really useful in gauging usage
> over time.
>
> Environment:
> * Debian Jessie/Apache 2.4.10
> * mod_dav_svn 1.8.14 Compiled from source. - Basic auth. No SSL.
> * Client: Windows 7 - Command line (From Tortoise SVN 1.8.13) / OSX Yosemite
> shell (1.7.20 from OSX Developer Tools)
>
> Config:
>
> SVNCompressionLevel 0
> SVNCacheTextDeltas On
> SVNCacheFullTexts On
> SVNCacheRevProps On
> SVNInMemoryCacheSize 262144
>
>
> Common repo config (Path and AuthName set per Location)
> AuthType Basic
> AuthUserFile xxx
> Require valid-user
> AuthzSVNAccessFile yyy
>
> Order allow,deny
> Allow from all
>
> # Common SVN.
> DAV svn
>
> # Misc:
> Options +FollowSymLinks +Indexes
> SVNIndexXSLT "/svnindex.xsl"
>
> Thanks,
>
> Terry.
I think this is because 1.8+serf uses "skelta style updates" instead
of "bulk updates". With skelta mode the client uses a separate HTTP
request for each resource that needs to be fetched (instead of pulling
the entire update through a massive http request/response). See here:
http://subversion.apache.org/docs/release-notes/1.8.html#neon-deleted
As explained there, you can configure the server to "prefer" bulk
update mode, if you wish. That might give you back the ability to
measure the checkouts as one huge HTTP response.
--
Johan
svn stats
Dear SVN people, is there a way to get some statistics out of SVN repositories without checking out the whole repository? When I say statistics I mean numbers like this: - number of checkins / developer / repo - number of lines of code / developer - number of lines of code / repository path I used statsvn as a separate tool but it checks out everything. As we have a huge repo, this is not a good option. Thanks and br, Gábor V.
Re: svnrdump produce a strange dump file
On Thu, Oct 1, 2015 at 4:19 AM, Yves Martin wrote: > Hello, > > I have a Subversion 1.6.17 server running on Debian Linux and access through > HTTPS. > > I used both Subversion 1.8.10 and Subversion 1.9.2 to produce a partial dump > of the repository: *Why*? If you have a subversion 1.6.17 server, why wouldn't you use the the local svnadmin dump command for maximum binary compatibility? I'm not saying it shouldn't work, just wondering why you're even bothering. If you're doing an rsync or scp to a remote system and doing the svndump there, you're running the risk of transferring content in the middle of an atomic operation and thus confusing the system. > svnrdump dump -r 51686:77787 > https://myhost/subversion/repository/PROJECT/trunk/amodule | gzip > > amodule.dump.gz Does anyone actually use "svnrdump"? I've not explored it myself, but don't see where it's a big advantage over a remote "ssh hostname svnadmin dump" command, which avoids the kind of confusion I just described. I'd start there, to avoid certain levels of uncertainty and incompatibility with an out of date and no longer supported Subversion release with a more modern tool that may not have been thoroughly tested with it.
Re: svnrdump produce a strange dump file
On Oct 1, 2015, at 8:29, Nico Kadel-Garcia wrote: > > On Thu, Oct 1, 2015 at 4:19 AM, Yves Martin wrote: >> Hello, >> >> I have a Subversion 1.6.17 server running on Debian Linux and access through >> HTTPS. >> >> I used both Subversion 1.8.10 and Subversion 1.9.2 to produce a partial dump >> of the repository: > > *Why*? If you have a subversion 1.6.17 server, why wouldn't you use > the the local svnadmin dump command for maximum binary compatibility? > I'm not saying it shouldn't work, just wondering why you're even > bothering. I interpreted "access through HTTPS" as meaning the *only* access is through HTTPS. svnadmin requires a local shell on the server.
Re: svnrdump produce a strange dump file
On Thu, 2015-10-01 at 09:29 -0400, Nico Kadel-Garcia wrote: > If you're doing an rsync or scp to a remote system and doing the > svndump there, you're running the risk of transferring content in the > middle of an atomic operation and thus confusing the system. > > > svnrdump dump -r 51686:77787 > > https://myhost/subversion/repository/PROJECT/trunk/amodule | gzip > > > amodule.dump.gz > Does anyone actually use "svnrdump"? I've not explored it myself, but > don't see where it's a big advantage over a remote "ssh hostname > svnadmin dump" command, which avoids the kind of confusion I just > described. I'd start there, to avoid certain levels of uncertainty and > incompatibility with an out of date and no longer supported Subversion > release with a more modern tool that may not have been thoroughly > tested with it. What is interesting with svnrdump is that it is efficient to generate a "partial" dump, in term of revision range and selected path ! What "svnadmin dump" is not able to do without scanning a large part of the full repository (10 GiB)... Indeed you were right. As there is no merge tool for format 3 dumps, I decided to rsync over ssh the repository and run svnadmin dump on my workstation to avoid disturbing users. Thank you for that tip -- Yves Martin
Re: :Installing a svn server on openshift
The answer to "How do I install X" is always "As explained in the manual. Please read it, and if you have done so and it's still unclear, come back and ask specific questions about the unclear parts". The manual, in this case, is svnbook.org. Cheers, Daniel Yuri Nachitov wrote on Thu, Oct 01, 2015 at 14:02:01 +0300: > Sorry, I need to update my question > > If anyone (Andreas Stieger, for example) knowing how to install the svn > server on PaaS (openshift, heroku, etc) please tell me how to do it. > > I need to maintain the simple svn server with root access to authz file > with user list. > > > Thank you! > > четверг, 1 октября 2015 г. пользователь Yuri Nachitov написал: > > > Hello! > > > > Does anyone install the svn server on openshift or other PaaS ? > > > >
