Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Antoine Pitrou
Chris Withers simplistix.co.uk> writes: > > Well, it's locked at 25% on a quad core box, so yeah, I'd say something > is wrong > > I guess I could try profile it and finding out where most of the time is > being spent? I guess you could indeed :-) Antoine.

Re: [Python-Dev] standard library mimetypes module pathologically broken?

2009-08-12 Thread Jacob Rus
Benjamin Peterson wrote: > It looks like you need to add some tests for the bugs you fixed to > test_mimetypes. While you're at it, you could improve that test > generally, since it's not exactly extensive. Okay, I'll try to do this sometime in the next few days, if I get the chance. > Then, you

Re: [Python-Dev] www/svn python.org status update

2009-08-12 Thread Gregory P. Smith
On Wed, Aug 12, 2009 at 9:33 AM, Thomas Wouters wrote: > > I replaced the RAID controller, the old data was still intact, so I brought > the temporary machine down and the new machine up. Everything seems to work > just fine, so happy svn-up'ing. > (I will reboot mail.python.org for a few minutes,

Re: [Python-Dev] www/svn python.org status update

2009-08-12 Thread Thomas Wouters
I replaced the RAID controller, the old data was still intact, so I brought the temporary machine down and the new machine up. Everything seems to work just fine, so happy svn-up'ing. (I will reboot mail.python.org for a few minutes, to check its serial console configuration, but that shouldn't af

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Guido van Rossum
On Wed, Aug 12, 2009 at 8:34 AM, Chris Withers wrote: > Guido van Rossum wrote: >> >> Try instrumenting the actual calls to the lowest-level socket methods >> (recv() and send()) and log for each one the arguments, return time, >> and how long it took. > > Can I do that in python code? Probably if

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Chris Withers
Guido van Rossum wrote: Try instrumenting the actual calls to the lowest-level socket methods (recv() and send()) and log for each one the arguments, return time, and how long it took. Can I do that in python code? You might see a pattern. Is this on Windows? Well, yes, but I'm not 100%. Th

Re: [Python-Dev] [issue6673] Py3.1 hangs in coroutine and eats up all memory

2009-08-12 Thread Antoine Pitrou
Stefan Behnel behnel.de> writes: > > IMHO, that's pretty far from obvious when you look at the code. A "yield" wrapped in a list comprehension looks far from obvious IMO anyway, whether in 2.x or 3.x. It's this kind of "smart" writing tricks people find that only makes code more difficult to rea

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Guido van Rossum
s/return time/return size/ On Wed, Aug 12, 2009 at 8:07 AM, Guido van Rossum wrote: > Try instrumenting the actual calls to the lowest-level socket methods > (recv() and send()) and log for each one the arguments, return time, > and how long it took. You might see a pattern. Is this on Windows? >

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Guido van Rossum
Try instrumenting the actual calls to the lowest-level socket methods (recv() and send()) and log for each one the arguments, return time, and how long it took. You might see a pattern. Is this on Windows? It's embarrassing, we've had problems with socket speed on Windows since 1999 and they're sti

Re: [Python-Dev] [issue6673] Py3.1 hangs in coroutine and eats up all memory

2009-08-12 Thread Stefan Behnel
Nick Coghlan wrote: > Stefan Behnel wrote: >> This is also an important issue for other Python implementations. Cython >> simply transforms comprehensions into the equivalent for-loop, so when we >> implement PEP 342 in Cython, we will have to find a way to emulate >> CPython's behaviour here (unle

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Chris Withers
Antoine Pitrou wrote: Chris Withers simplistix.co.uk> writes: However, I'm kinda stumped on where to start with debugging the difference. I've tried upping the buffer size as suggested in the issue, but it's had no effect... Then perhaps it's not the same bug. Please take a look at CPU utili

Re: [Python-Dev] [issue6673] Py3.1 hangs in coroutine and eats up all memory

2009-08-12 Thread Nick Coghlan
Stefan Behnel wrote: > This is also an important issue for other Python implementations. Cython > simply transforms comprehensions into the equivalent for-loop, so when we > implement PEP 342 in Cython, we will have to find a way to emulate > CPython's behaviour here (unless we decide to stick with

Re: [Python-Dev] standard library mimetypes module pathologically broken?

2009-08-12 Thread Nick Coghlan
Nick Coghlan wrote: > Benjamin Peterson wrote: >> >> If python-dev was more interested, we would have a policy for this. *cough* >> > > PEP 5 isn't enough? (I'll grant that PEP could probably do with > mentioning the use of warnings.warn(DeprecationWarning) explicitly, but > the policy itself se

Re: [Python-Dev] standard library mimetypes module pathologically broken?

2009-08-12 Thread Nick Coghlan
Benjamin Peterson wrote: > > If python-dev was more interested, we would have a policy for this. *cough* > PEP 5 isn't enough? (I'll grant that PEP could probably do with mentioning the use of warnings.warn(DeprecationWarning) explicitly, but the policy itself seems fine) Cheers, Nick. -- Nic

Re: [Python-Dev] [issue6673] Py3.1 hangs in coroutine and eats up all memory

2009-08-12 Thread Stefan Behnel
[moving this from the bug tracker] Alexandre Vassalotti wrote: > Alexandre Vassalotti added the comment: > > Not a bug. > > The list comprehension in your chunker: > > while True: > target.send([ (yield) for i in range(chunk_size) ]) > > is equivalent to the following generator in

Re: [Python-Dev] how to debug httplib slowness

2009-08-12 Thread Antoine Pitrou
Chris Withers simplistix.co.uk> writes: > > However, I'm kinda stumped on where to start with debugging the > difference. I've tried upping the buffer size as suggested in the issue, > but it's had no effect... Then perhaps it's not the same bug. Please take a look at CPU utilization during th

[Python-Dev] how to debug httplib slowness

2009-08-12 Thread Chris Withers
Hi All, I'd like to work on this issue: http://bugs.python.org/issue2576 Specifically, in my case, while IE can download a 150Mb file from a local server in about 3 seconds, httplib takes over 20 minutes! However, I'm kinda stumped on where to start with debugging the difference. I've tried

[Python-Dev] Study on communication and collaboration i n software development teams

2009-08-12 Thread Martin Gelhaus
Dear Python developer, within the scope of my diploma thesis at the University of Paderborn, Germany, with the title "Study about communication and collaboration in software development in teams" I am conducting a survey of members of software development teams. I would be very grateful if yo

Re: [Python-Dev] standard library mimetypes module pathologically broken?

2009-08-12 Thread Eric Smith
Benjamin Peterson wrote: Then, you might garner some more reviews by putting your patch up on Rietveld; it makes reviewing much painful. "... much _less_ painful", I hope! ___ Python-Dev mailing list Python-Dev@python.org http://mail.python.org/mailm