Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Philipp Kern
On Mon, Sep 02, 2013 at 11:27:33AM +0200, Tollef Fog Heen wrote: > ]] Luca Filipozzi > > On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > > > Luca Filipozzi writes: > > > > Why do you say that when you haven't even asked? > > > Because I thought the answer was going to be “no

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Philipp Kern
On Sun, Sep 01, 2013 at 09:07:47PM +0100, Stephen Gran wrote: > luca is not asking, "why aren't you using the new shiny", he's asking, > "why hasn't a proposal for a project that does string searching used one > of the already available, off the shelf string searching programs". > > Asking someone

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Ian Jackson
Tollef Fog Heen writes ("Re: How git performs when you throw all of Debian at it"): > ]] Luca Filipozzi > > We also run kfreebsd, with some challenge, but we have it. > > It's not really an option for codesearch since codesearch needs systemd, > though. W

Re: How git performs when you throw all of Debian at it

2013-09-02 Thread Tollef Fog Heen
]] Luca Filipozzi > On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > > Luca Filipozzi writes: > > > Why do you say that when you haven't even asked? > > Because I thought the answer was going to be “not in the Linux kernel, > > no chance”. > > We also run kfreebsd, with som

Re: How git performs when you throw all of Debian at it

2013-09-01 Thread Stephen Gran
This one time, at band camp, Philipp Kern said: > On Sat, Aug 31, 2013 at 04:12:11PM +, Luca Filipozzi wrote: > > I'm curious why there's no apparent appetite for hdfs / solr / etc. > > I don't know how far regex matching is with solr these days. This > implementation is AFAIK based on [1]. Bu

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Ben Hutchings
On Sat, 2013-08-31 at 22:22 +0200, Adam Borowski wrote: > On Sat, Aug 31, 2013 at 12:44:21AM +0100, Ben Hutchings wrote: > > > Funny that you ask. What's the usual competitor for ZFS? > > > btrfs is included in stock kernels, doesn't take massive amounts of > > > memory, > > > and has a different

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Adam Borowski
On Sat, Aug 31, 2013 at 12:44:21AM +0100, Ben Hutchings wrote: > > Funny that you ask. What's the usual competitor for ZFS? > > btrfs is included in stock kernels, doesn't take massive amounts of memory, > > and has a different approach to deduplication. > > and is slower than any of its competit

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Philipp Kern
On Sat, Aug 31, 2013 at 04:12:11PM +, Luca Filipozzi wrote: > I'm curious why there's no apparent appetite for hdfs / solr / etc. I don't know how far regex matching is with solr these days. This implementation is AFAIK based on [1]. But then the tool exists and would need to be thrown away co

Re: How git performs when you throw all of Debian at it

2013-08-31 Thread Luca Filipozzi
On Sat, Aug 31, 2013 at 12:40:08AM +0200, Michael Stapelberg wrote: > Luca Filipozzi writes: > > Why do you say that when you haven't even asked? > Because I thought the answer was going to be “not in the Linux kernel, > no chance”. We also run kfreebsd, with some challenge, but we have it. > >

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Adam Borowski
On Sat, Aug 31, 2013 at 12:32:47AM +0100, Dmitrijs Ledkovs wrote: > On 30 August 2013 20:55, Steven Chamberlain wrote: > > Hi, > > > >> [...] using git instead of the file system for storing the contents > >> of Debian Code Search. The hope was that it would lead to fewer disk > >> seeks and less

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Ben Hutchings
On Sat, 2013-08-31 at 01:21 +0200, Adam Borowski wrote: > On Fri, Aug 30, 2013 at 10:14:25PM +, Luca Filipozzi wrote: > > On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > > > Steven Chamberlain writes: > > > > Wouldn't ZFS be a more natural way to do something like this? >

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Dmitrijs Ledkovs
On 30 August 2013 20:55, Steven Chamberlain wrote: > Hi, > >> [...] using git instead of the file system for storing the contents >> of Debian Code Search. The hope was that it would lead to fewer disk >> seeks and less data due to gits delta-encoding > > Wouldn't ZFS be a more natural way to do s

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Adam Borowski
On Fri, Aug 30, 2013 at 10:14:25PM +, Luca Filipozzi wrote: > On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > > Steven Chamberlain writes: > > > Wouldn't ZFS be a more natural way to do something like this? > > Possibly, but I have zero hopes of getting it set up and supp

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Holger Levsen
Hi, On Samstag, 31. August 2013, Luca Filipozzi wrote: > We are much more amenable to "how could I improve X so that it can run > faster" than we are to... I'd like to chime in and say a big thanks to DSA! piuparts.debian.org is running very very smoothly (and fast) now, thanks to the awesome ga

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Michael Stapelberg
Hi Luca, Luca Filipozzi writes: > Why do you say that when you haven't even asked? Because I thought the answer was going to be “not in the Linux kernel, no chance”. > To address this specific thread, the challenge with ZFS is not that we don't > like the idea (I'm keen on it, actually) but that

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Luca Filipozzi
On Fri, Aug 30, 2013 at 10:49:48PM +0200, Michael Stapelberg wrote: > Steven Chamberlain writes: > > Wouldn't ZFS be a more natural way to do something like this? > Possibly, but I have zero hopes of getting it set up and supported by > DSA, so we can’t use it for this service. Why do you say tha

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Steven Chamberlain
On 30/08/13 21:49, Michael Stapelberg wrote: > Steven Chamberlain writes: >> Wouldn't ZFS be a more natural way to do something like this? > Possibly, but I have zero hopes of getting it set up and supported by > DSA, so we can’t use it for this service. Oh I see. That's fair enough, but there i

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Michael Stapelberg
Hi Steven, Steven Chamberlain writes: > Wouldn't ZFS be a more natural way to do something like this? Possibly, but I have zero hopes of getting it set up and supported by DSA, so we can’t use it for this service. -- Best regards, Michael -- To UNSUBSCRIBE, email to debian-devel-requ...@lists

Re: How git performs when you throw all of Debian at it

2013-08-30 Thread Steven Chamberlain
Hi, > [...] using git instead of the file system for storing the contents > of Debian Code Search. The hope was that it would lead to fewer disk > seeks and less data due to gits delta-encoding Wouldn't ZFS be a more natural way to do something like this? A choice of gzip, lzjb and more recently