Re: [tor-dev] Remote descriptor fetching

2013-07-23 Thread Damian Johnson
>> - see the >> example at the start of its docs... >> >> https://stem.torproject.org/api/descriptor/remote.html >> https://stem.torproject.org/_modules/stem/descriptor/remote.html > > These two links don't work for me for some reason. Very strange. It didn't work when I just tried clicking them f

Re: [tor-dev] Remote descriptor fetching

2013-07-23 Thread Karsten Loesing
On 7/22/13 5:32 AM, Damian Johnson wrote: > Hi Karsten, I've finally finished implementing stem's module for > remote descriptor fetching. Its usage is pleasantly simple Great stuff! > - see the > example at the start of its docs... > > https://stem.torproject.org/api/descriptor/remote.html > ht

Re: [tor-dev] Remote descriptor fetching

2013-07-21 Thread Damian Johnson
Hi Karsten, I've finally finished implementing stem's module for remote descriptor fetching. Its usage is pleasantly simple - see the example at the start of its docs... https://stem.torproject.org/api/descriptor/remote.html https://stem.torproject.org/_modules/stem/descriptor/remote.html https://

Re: [tor-dev] Remote descriptor fetching

2013-06-10 Thread Kostas Jakeliunas
Hi folks! > Indeed, this would be pretty bad. I'm not convinced that moria1 > provides truncated responses though. It could also be that it > compresses results for every new request and that compressed responses > randomly differ in size, but are still valid compressions of the same > input. K

Re: [tor-dev] Remote descriptor fetching

2013-06-09 Thread Karsten Loesing
Hi Damian! On 6/9/13 5:07 AM, Damian Johnson wrote: >> Indeed, this would be pretty bad. I'm not convinced that moria1 >> provides truncated responses though. It could also be that it >> compresses results for every new request and that compressed responses >> randomly differ in size, but are st

Re: [tor-dev] Remote descriptor fetching

2013-06-08 Thread Damian Johnson
> Indeed, this would be pretty bad. I'm not convinced that moria1 > provides truncated responses though. It could also be that it > compresses results for every new request and that compressed responses > randomly differ in size, but are still valid compressions of the same > input. Kostas, do y

Re: [tor-dev] Remote descriptor fetching

2013-06-05 Thread Karsten Loesing
On 6/1/13 9:18 PM, Damian Johnson wrote: > Thanks Karsten, thanks Kostas! It's a little disturbing that moria1 is > providing truncated responses but guess we'll dig into that more > later. Indeed, this would be pretty bad. I'm not convinced that moria1 provides truncated responses though. It co

Re: [tor-dev] Remote descriptor fetching

2013-06-01 Thread Damian Johnson
Thanks Karsten, thanks Kostas! It's a little disturbing that moria1 is providing truncated responses but guess we'll dig into that more later. Great points about needing a more flexible downloader. Here's another attempt, this time with a DescriptorDownloader class that's a bit similar to our pres

Re: [tor-dev] Remote descriptor fetching

2013-05-28 Thread Kostas Jakeliunas
On Tue, May 28, 2013 at 2:50 AM, Damian Johnson wrote: > So far, so good. By my read of the man pages this means that gzip or > python's zlib module should be able to handle the decompression. > However, I must be missing something... > > % wget http://128.31.0.34:9131/tor/server/all.z > > [...] >

Re: [tor-dev] Remote descriptor fetching

2013-05-28 Thread Karsten Loesing
On 5/28/13 1:50 AM, Damian Johnson wrote: > Hi Karsten. I'm starting to look into remote descriptor fetching, a > capability of metrics-lib that stem presently lacks [1][2]. The spec > says that mirrors provide zlib compressed data [3], and the > DirectoryDownloader handles this via a InflaterInput

[tor-dev] Remote descriptor fetching

2013-05-27 Thread Damian Johnson
Hi Karsten. I'm starting to look into remote descriptor fetching, a capability of metrics-lib that stem presently lacks [1][2]. The spec says that mirrors provide zlib compressed data [3], and the DirectoryDownloader handles this via a InflaterInputStream [4]. So far, so good. By my read of the ma