Re: [Python-Dev] Replace useless %.100s by %s in PyErr_Format()

2011-03-24 Thread Victor Stinner
Le jeudi 24 mars 2011 à 13:22 +0100, M.-A. Lemburg a écrit : > BTW: Why do you think that %.100s is not supported in > PyErr_Format() in Python 2.x ? PyString_FromFormatV() > does support this. The change to use Unicode error strings > introduced the problem, since PyUnicode_FromFormatV() for > som

[Python-Dev] Unload a module written in C

2011-03-24 Thread Victor Stinner
Hi, I am trying to understand why I am unable to unload my faulthandler module (implemented in C). Antoine pointed me _PyImport_FixupExtensionObject() comment which gave me a first clue: Modules which do support multiple initialization set their m_size field to a non-negative number (indica

Re: [Python-Dev] Unload a module written in C

2011-03-25 Thread Victor Stinner
Le vendredi 25 mars 2011 à 10:24 +0100, Stefan Behnel a écrit : > "Martin v. Löwis", 25.03.2011 07:59: > >> Is there a bug somewhere, or do I misunderstood something important? > > > > Module unloading is simply not implemented, and would be very difficult > > to implement. > > Are you saying that

Re: [Python-Dev] Unload a module written in C

2011-03-25 Thread Victor Stinner
Le vendredi 25 mars 2011 à 07:59 +0100, "Martin v. Löwis" a écrit : > > Is there a bug somewhere, or do I misunderstood something important? > > Module unloading is simply not implemented, and would be very difficult > to implement. My problem is that if Python is embeded, my module will still be

Re: [Python-Dev] Embedded Python startup is slow

2011-03-25 Thread Victor Stinner
Le jeudi 24 mars 2011 à 22:40 -0400, R. David Murray a écrit : > On Fri, 25 Mar 2011 01:20:34 +0100, Paul Boddie wrote: > > Since this topic has come up a few times before, I thought it might be time > > to > > collect references to it as well as to other topics that people doing > > embedded w

Re: [Python-Dev] Unload a module written in C

2011-03-25 Thread Victor Stinner
Le vendredi 25 mars 2011 à 21:14 +1000, Nick Coghlan a écrit : > On Fri, Mar 25, 2011 at 8:14 PM, Victor Stinner > wrote: > > Le vendredi 25 mars 2011 à 07:59 +0100, "Martin v. Löwis" a écrit : > >> > Is there a bug somewhere, or do I misunderstood something imp

Re: [Python-Dev] I plan to push faulthandler into Python 3.3 in one week

2011-03-25 Thread Victor Stinner
Le jeudi 24 mars 2011 à 00:49 +0100, Victor Stinner a écrit : > If nobody complains, I plan to push my faulthandler module into Python > 3.3 in one week. It's a module to display the Python backtrace on a > segfault, on a user signal or after a timeout. I created a feature repo

Re: [Python-Dev] Security implications of pep 383

2011-03-29 Thread Victor Stinner
Le mardi 29 mars 2011 à 19:23 +0100, Michael Foord a écrit : > Hey all, > > Not sure how real the security risk is here: > > http://blog.omega-prime.co.uk/?p=107 > > Basically he is saying that if you store a list of blacklisted files > with names encoded in big-5 (or some other non-utf8

Re: [Python-Dev] Security implications of pep 383

2011-03-29 Thread Victor Stinner
Le mardi 29 mars 2011 à 22:40 +0200, Lennart Regebro a écrit : > The lesson here seems to be "if you have to use blacklists, and you > use unicode strings for those blacklists, also make sure the string > you compare with doesn't have surrogates". No. '\u4f60\u597d'.encode('big5').decode('latin1')

Re: [Python-Dev] Security implications of pep 383

2011-03-29 Thread Victor Stinner
Le mardi 29 mars 2011 à 22:45 +0200, Lennart Regebro a écrit : > On Tue, Mar 29, 2011 at 22:40, Lennart Regebro wrote: > > The lesson here seems to be "if you have to use blacklists, and you > > use unicode strings for those blacklists, also make sure the string > > you compare with doesn't have s

[Python-Dev] Test "Force Build" on custom buildbots

2011-03-30 Thread Victor Stinner
Hi, I'm testing my faulthandler repository on the custom buildbots, here are some remarks and issues. The form still refers to SVN ('Branch to build' is relative to http://svn.python.org/projects/python.) => the branch is relative to hg.python.org/ I cannot write "#" in the branch field to speci

Re: [Python-Dev] Test "Force Build" on custom buildbots

2011-03-30 Thread Victor Stinner
Le mercredi 30 mars 2011 à 17:59 +0200, Victor Stinner a écrit : > I'm testing my faulthandler repository on the custom buildbots, here are > some remarks and issues. Oh, I forgot something: there is an error on hg purge. Example on a Windows buildbot: C:\Program Files\Mercu

[Python-Dev] faulthandler is now part of Python 3.3

2011-03-30 Thread Victor Stinner
Hi, I pushed my faulthandler module into the default branch (Python 3.3). Since one week, I fixed a lot of bugs (platform issues), improved the tests and Antoine wrote a new implementation of dump_backtraces_later() using a thread (instead of SIGALRM+alarm()). It should now work on all platforms (

[Python-Dev] Use regrtest.py --timeout on buildbots

2011-03-31 Thread Victor Stinner
Hi, I just added a --timeout option to Lib/test/regrtest.py: if a test (one function, not a whole file) takes more than TIMEOUT seconds, the traceback is dumped and it exits. I tested it on 3 buildbots with a timeout of 5 minutes and it worked as expected: see #11727 for examples. It would be ni

Re: [Python-Dev] [Python-checkins] cpython: Issue #11393: get more information on assertion error (test_faulthandler)

2011-03-31 Thread Victor Stinner
> > http://hg.python.org/cpython/rev/61626c3f3a54 > >... > > -assert (b -a)>= pause > > +assert (b - a)>= pause, "{{}}< {{}}".format(b - a, pause) > > > +assert (b - a)>= pause, "{{}}< {{}}".format(b - a, pause) > > >>> a,b,pause = 0,0,1 > >>> "{{}} < {{}}".format(b - a, pause

Re: [Python-Dev] warn_unused_result warnings

2011-03-31 Thread Victor Stinner
Le 01/04/2011 01:11, Benjamin Peterson a écrit : I'm rather sick of seeing this warnings on all compiles, so I propose we enable the -Wno-unused-results option. I judge that most of the cases where this occurs are error reporting functions, where not much with return code can be done. Can't we tr

Re: [Python-Dev] Impaired Usability of the Mercurial Source Viewer

2011-03-31 Thread Victor Stinner
Le 01/04/2011 01:15, Raymond Hettinger a écrit : The Hg source viewer needs to be tweaked to improve its usability. What we've got now is a step backwards from the previous svn viewer. Looking at http://hg.python.org/cpython/file/default/Lib/linecache.py for example, there are two issues. 1)

Re: [Python-Dev] Use regrtest.py --timeout on buildbots

2011-04-01 Thread Victor Stinner
Le jeudi 31 mars 2011 à 18:35 +0200, Victor Stinner a écrit : > Hi, > > I just added a --timeout option to Lib/test/regrtest.py: if a test (one > function, not a whole file) takes more than TIMEOUT seconds, the > traceback is dumped and it exits. I tested it on 3 buildbots with a

Re: [Python-Dev] Unicode module names (Was: Python 3.3 release schedule posted)

2011-04-03 Thread Victor Stinner
Le samedi 02 avril 2011 à 16:06 +0300, anatoly techtonik a écrit : > On Thu, Mar 24, 2011 at 2:41 AM, Victor Stinner > wrote: > > > > I am still working on the import machinery to fix last bugs related to > > Unicode. So it will be possible to do an useless "import ca

Re: [Python-Dev] Python 3.3 release schedule posted

2011-04-03 Thread Victor Stinner
Le samedi 02 avril 2011 à 16:00 +0300, anatoly techtonik a écrit : > Do you have an estimate of Python 3.2.1 release? FYI I introduced (and then fixed) two regressions specific to Windows in Python 3.2: http://bugs.python.org/issue11272 (input) http://bugs.python.org/issue11395 (print) Issue #112

Re: [Python-Dev] [Python-checkins] cpython: Issue #11707: Fast C version of functools.cmp_to_key()

2011-04-05 Thread Victor Stinner
I don't think that the following change conforms to the PEP 399: there is only a test for the C version. Victor Le mardi 05 avril 2011 à 11:34 +0200, raymond.hettinger a écrit : > http://hg.python.org/cpython/rev/a03fb2fc3ed8 > changeset: 69150:a03fb2fc3ed8 > user:Raymond Hettinger > d

Re: [Python-Dev] Make test failed issues for phyton 3.2 on centos5.5

2011-04-11 Thread Victor Stinner
> [1/1] test_zipfiles > test test_zipfiles crashed -- : No module named > test_zipfiles It means that you don't have a module named test_zipfiles. Retry with "test_zipfile" :-) You may open an issue (including details) for your failures. Victor ___ Py

Re: [Python-Dev] Hg question

2011-04-12 Thread Victor Stinner
Le mardi 12 avril 2011 à 14:35 -0400, Alexander Belopolsky a écrit : > I was preparing a commit to 3.2 and default branches and mistakenly > used -m insread of -l commit option. As a result, I have > > $ hg out > comparing with ssh://h...@hg.python.org/cpython > searching for changes > changeset:

Re: [Python-Dev] http://docs.python.org/py3k/ pointing to 2.7

2011-04-15 Thread Victor Stinner
Le vendredi 15 avril 2011 à 13:34 +0200, Jesus Cea a écrit : > http://docs.python.org/py3k/ takes you to 2.7, by default. > > Should we update it to point to 3.2?. If the point is to promote Python 3... > > I would point it to 3.2, with a big "access to documentation to legacy > 2.7" (beside the

[Python-Dev] Drop OS/2 and VMS support?

2011-04-19 Thread Victor Stinner
Hi, I asked one year ago if we should drop OS/2 support: Andrew MacIntyre, our OS/2 maintainer, answered: http://mail.python.org/pipermail/python-dev/2010-April/099477.html Extract: << The 3.x branch needs quite a bit of work on OS/2 to deal with Unicode, as OS/2 was one of the earlier OSes with

Re: [Python-Dev] Drop OS/2 and VMS support?

2011-04-19 Thread Victor Stinner
Le mardi 19 avril 2011 à 15:20 -0400, Doug Hellmann a écrit : > > The Python core team is not really representative of the Python > > community users, so I think this needs a different approach: > > > > Instead of simply deprecating OSes without notice to the general > > Python community, how abou

Re: [Python-Dev] [Python-checkins] cpython: Issue #11223: Add threading._info() function providing informations about the

2011-04-20 Thread Victor Stinner
Hi, Le mardi 19 avril 2011 à 22:42 -0400, Terry Reedy a écrit : > On 4/19/2011 5:59 PM, victor.stinner wrote: > > >Issue #11223: Add threading._info() function providing informations > > about the > > thread implementation. > > Since this is being documented, making it part of the public ap

[Python-Dev] Buildbots and faulthandler

2011-04-20 Thread Victor Stinner
Hi, The new faulthandler module is now fully functional and it has no more known issue. Its timeout feature is used on regrtest to dump the Python backtrace and exit if a test takes more than 1 hour. Using the regrtest timeout and faulthandler signal handlers (enable in regrtest), I started to co

Re: [Python-Dev] [Python-checkins] cpython: Issue #11223: Add threading._info() function providing informations about the

2011-04-20 Thread Victor Stinner
Le mercredi 20 avril 2011 à 20:24 +1000, Nick Coghlan a écrit : > On Wed, Apr 20, 2011 at 6:20 PM, Victor Stinner > wrote: > > Hi, > > > > Le mardi 19 avril 2011 à 22:42 -0400, Terry Reedy a écrit : > >> On 4/19/2011 5:59 PM, victor.stinner wrote: > >> &

Re: [Python-Dev] [Python-checkins] cpython: Issue #11223: Add threading._info() function providing informations about the

2011-04-20 Thread Victor Stinner
Le mercredi 20 avril 2011 à 11:57 -0500, Benjamin Peterson a écrit : > 2011/4/20 Victor Stinner : > > Le mercredi 20 avril 2011 à 20:24 +1000, Nick Coghlan a écrit : > >> On Wed, Apr 20, 2011 at 6:20 PM, Victor Stinner > >> wrote: > >> > Hi, > >&g

Re: [Python-Dev] [Python-checkins] cpython (merge 3.2 -> default): Correctly merging #9319 into 3.3?

2011-04-25 Thread Victor Stinner
Le lundi 25 avril 2011 à 04:47 +0200, Jesus Cea a écrit : > If a patch in 3.2 is not applicable in 3.3, a "null merge" should be > done. Correct. Sorry, I forgot that. And yes, the 3.2 fix was not applicable to 3.3, that's why I forgot to merge. > If not, next developer tring to merge will find s

Re: [Python-Dev] Drop OS/2 and VMS support?

2011-04-25 Thread Victor Stinner
Le mardi 19 avril 2011 à 23:21 +0200, "Martin v. Löwis" a écrit : > > Well, not "remove" directly, but plan to remove it using the PEP 11 > > procedure (mark OS/2 and VMS as unsupported, and remove the code in > > Python 3.4). > > I think the PEP 11 procedure is just right for this. It *is* a call

Re: [Python-Dev] [Python-checkins] cpython (3.2): Issue #11919: try to fix test_imp failure on some buildbots.

2011-04-26 Thread Victor Stinner
Le mardi 26 avril 2011 à 10:03 -0400, Jim Jewett a écrit : > This seems to be changing what is tested -- are you saying that > filenames with an included directory name are not intended to be > supported? The test checks the Python parser, not the imp module :-) I don't understand why: sometimes,

Re: [Python-Dev] [Python-checkins] cpython: PyGILState_Ensure(), PyGILState_Release(), PyGILState_GetThisThreadState() are

2011-04-30 Thread Victor Stinner
Le mercredi 27 avril 2011 à 20:18 -0400, Jim Jewett a écrit : > Would it be a problem to make them available a no-ops? > > On 4/26/11, victor.stinner wrote: > > http://hg.python.org/cpython/rev/75503c26a17f > > changeset: 69584:75503c26a17f > > user:Victor St

[Python-Dev] Raise OSError or RuntimeError in the OS module?

2011-05-02 Thread Victor Stinner
Hi, I introduced recently the signal.pthread_sigmask() function (issue #8407). pthread_sigmask() (the C function) returns an error code using errno codes. I choosed to raise a RuntimeError using this error code, but I am not sure that RuntimeError is the best choice. It is more an OS error than

Re: [Python-Dev] [Python-checkins] cpython (2.7): Issue #10276: test_zlib checks that inputs of 2 GB are handled correctly by

2011-05-03 Thread Victor Stinner
Le mardi 03 mai 2011 à 16:22 +0200, Nadeem Vawda a écrit : > On Tue, May 3, 2011 at 3:19 PM, victor.stinner > wrote: > > +# Issue #10276 - check that inputs of 2 GB are handled correctly. > > +# Be aware of issues #1202, #8650, #8651 and #10276 > > +class ChecksumBigBufferTestCase(unittest.TestCas

[Python-Dev] The zombi thread of the Tcl library

2011-05-04 Thread Victor Stinner
Hi, I have a question: would it be possible to mask all signals in the Tcl thread? To understand the question, let's see the context... I'm working on signals, especially on pthread_sigmask(), and I'm trying to understand test_signal failures. test_signal fails if the _tkinter module is loaded,

Re: [Python-Dev] The zombi thread of the Tcl library

2011-05-04 Thread Victor Stinner
Le mercredi 04 mai 2011 à 12:05 +0200, Antoine Pitrou a écrit : > On Wed, 04 May 2011 10:58:42 +0200 > Victor Stinner wrote: > > > > Tcl_Finalize() exits the thread, but this function is never called in > > Python. Anyway, it is not possible to unload a module implemen

Re: [Python-Dev] [Python-checkins] cpython (2.7): Issue #10276: test_zlib checks that inputs of 2 GB are handled correctly by

2011-05-05 Thread Victor Stinner
Le mercredi 04 mai 2011 à 15:40 -0700, Ethan Furman a écrit : > Victor Stinner wrote: > > Le mardi 03 mai 2011 à 16:22 +0200, Nadeem Vawda a écrit : > >> On Tue, May 3, 2011 at 3:19 PM, victor.stinner > >> wrote: > >>> +# Issue #10276 - check that inputs of

Re: [Python-Dev] [Python-checkins] cpython (2.7): Issue #10276: test_zlib checks that inputs of 2 GB are handled correctly by

2011-05-05 Thread Victor Stinner
Le jeudi 05 mai 2011 à 05:07 -0700, Ethan Furman a écrit : > ... hence the resulting file is one less than 2GB. Yep, it's 0x7FFF because it's INT_MAX, the biggest value storable in an int. The zlib module stores the buffer size into an int in Python 2.7 (and Py_ssize_t in Python 3.3). Victor

Re: [Python-Dev] [Python-checkins] cpython (3.2): Avoid codec spelling issues by just using the utf-8 default.

2011-05-05 Thread Victor Stinner
Le jeudi 05 mai 2011 à 18:54 -0400, Alexander Belopolsky a écrit : > On Thu, May 5, 2011 at 6:32 PM, M.-A. Lemburg wrote: > .. > >> Either way, the code is simpler by just using the default. > > > > ... as long as the casual reader knows what the default it :-) > > > > .. or cares. I this partic

[Python-Dev] Commit changelog: issue number and merges

2011-05-09 Thread Victor Stinner
Hi, Commit changelogs are important to understand why the code was changed. I regulary use hg blame to search which commit introduced a particular line of code, and I am always happy if I can find an issue number because it usually contains the whole story. And since the migration to Mercurial, w

Re: [Python-Dev] [Python-checkins] cpython: _PyImport_LoadDynamicModule() encodes the module name explicitly to ASCII

2011-05-09 Thread Victor Stinner
Le lundi 09 mai 2011 à 09:00 -0400, Jim Jewett a écrit : > Are you asserting that all foreign modules (or at least all handled by > this) are in C, as opposed to C++ or even Java or Fortran? (And the C > won't change?) C and C++ identifiers are restricted to ASCII. I don't know for Fortran or Jav

Re: [Python-Dev] Commit changelog: issue number and merges

2011-05-09 Thread Victor Stinner
Le lundi 09 mai 2011 à 09:08 -0500, Benjamin Peterson a écrit : > It seems like something that should be solved by tools like a display > visual graph indicating what is merged. (like Bazaar) Yeah, we could fix buildbot, hg.python.org website, improve hg log, and all other tools using Mercurial. B

Re: [Python-Dev] [Python-checkins] cpython: _PyImport_LoadDynamicModule() encodes the module name explicitly to ASCII

2011-05-09 Thread Victor Stinner
Le mardi 10 mai 2011 à 09:52 +1000, Neil Hodgson a écrit : >Some C and C++ implementations currently allow non-ASCII > identifiers and the forthcoming C1X and C++0x language standards > include non-ASCII identifiers. The allowed characters are specified in > Annexes of the respective standards.

Re: [Python-Dev] [Python-checkins] cpython: _PyImport_LoadDynamicModule() encodes the module name explicitly to ASCII

2011-05-10 Thread Victor Stinner
Le lundi 09 mai 2011 à 22:18 -0500, Michael Urman a écrit : > On Mon, May 9, 2011 at 20:08, Neil Hodgson wrote: > > Yes, Windows will use UTF-16 as it does for almost everything. From > > a user's point of view, these should both just be seen as Unicode. > > I'm not convinced this is correct fo

Re: [Python-Dev] [Python-checkins] cpython (2.7): (Merge 3.1) Issue #12012: ssl.PROTOCOL_SSLv2 becomes optional

2011-05-11 Thread Victor Stinner
Le mercredi 11 mai 2011 à 19:05 +0200, Éric Araujo a écrit : > Le 10/05/2011 01:52, victor.stinner a écrit : > > http://hg.python.org/cpython/rev/3c87a13980be > > changeset: 70001:3c87a13980be > > branch: 2.7 > > parent: 69996:c9f07c69b138 > > user

[Python-Dev] Success x86 XP-4 2.7 buildbot without any log and should be a failure

2011-05-17 Thread Victor Stinner
Hi, I broke recently all tests of CJK encodings (#12057) in Python 2.7 (sorry, it is now fixed). But the "x86 XP-4 2.7" buildbot is green, I don't understand how (the bug was not fixed in the build 894): http://www.python.org/dev/buildbot/all/builders/x86%20XP-4%202.7/builds/894 This build doe

Re: [Python-Dev] "packaging" merge imminent

2011-05-17 Thread Victor Stinner
Le mardi 17 mai 2011 à 17:36 +0200, Tarek Ziadé a écrit : > - addition of Lib/packaging > - addition of test/test_packaging.py > - changes in Lib/sysconfig.py > - addition of Lib/sysconfig.cfg Does setup.py continue to use the "old" distutils module? I fixed recently some bugs in distutils. Shoul

Re: [Python-Dev] [RELEASED] Python 3.2.1 rc 1

2011-05-18 Thread Victor Stinner
Le mercredi 18 mai 2011 à 12:58 +0200, Georg Brandl a écrit : > On 18.05.2011 12:49, Nick Coghlan wrote: > > On Wed, May 18, 2011 at 5:57 PM, Georg Brandl wrote: > >> On 18.05.2011 08:34, "Martin v. Löwis" wrote: > > That's great, but where is the list if changes? > > All changes are

Re: [Python-Dev] [RELEASED] Python 3.2.1 rc 1

2011-05-18 Thread Victor Stinner
Le mercredi 18 mai 2011 à 13:35 +0200, Georg Brandl a écrit : > On 18.05.2011 13:26, Victor Stinner wrote: > > >> See > >> > >> http://dev.pocoo.org/~gbrandl/news.html > >> > >> which I made as an experiment a while ago. > > >

[Python-Dev] Don't set local variable in a list comprehension or generator

2011-05-18 Thread Victor Stinner
Hi, ''.join(c for c in 'abc') and ''.join([c for c in 'abc']) do create a temporary c variable. In this case, the variable is useless and requires two opcodes: STORE_FAST(c), LOAD_FAST(c). The variable is not available outside the list comprehension/generator. I would like to remove the variable

Re: [Python-Dev] Don't set local variable in a list comprehension or generator

2011-05-18 Thread Victor Stinner
Le mercredi 18 mai 2011 à 16:19 +0200, Nadeem Vawda a écrit : > I'm not sure why you would encounter code like that in the first place. Well, I found the STORE_FAST/LOAD_FAST "issue" while trying to optimize the this module which reimplements rot13 using a dict in Python 3: d = {} for c in (65, 9

Re: [Python-Dev] Don't set local variable in a list comprehension or generator

2011-05-19 Thread Victor Stinner
Le jeudi 19 mai 2011 à 10:47 +1200, Greg Ewing a écrit : > Victor Stinner wrote: > > >squares = (x*x for x in range(1)) > > What bytecode would you optimise that into? I suppose that you have the current value of range(1) on the stack: DUP_TOP; BINARY_MULTIPLY; gi

Re: [Python-Dev] Don't set local variable in a list comprehension or generator

2011-05-19 Thread Victor Stinner
Le mercredi 18 mai 2011 à 21:44 -0400, Terry Reedy a écrit : > On 5/18/2011 5:34 PM, Victor Stinner wrote: > > You initial example gave me the impression that the issue has something > to do with join in particular, or even comprehensions in particular. It > is really

Re: [Python-Dev] [Python-checkins] cpython: Issue #12120, Issue #12119: tests were missing a sys.dont_write_bytecode check

2011-05-19 Thread Victor Stinner
Python 3.3 is not supposed to create .pyc files in the same directory than the .py files. So I don't understand the following code. Le jeudi 19 mai 2011 à 19:56 +0200, tarek.ziade a écrit : > http://hg.python.org/cpython/rev/9d1fb6a9104b > changeset: 70207:9d1fb6a9104b > user:Tarek Ziade

[Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-23 Thread Victor Stinner
Hi, In Python 2, codecs.open() is the best way to read and/or write files using Unicode. But in Python 3, open() is preferred with its fast io module. I would like to deprecate codecs.open() because it can be replaced by open() and io.TextIOWrapper. I would like your opinion and that's why I'm wri

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 15:24 +1000, Nick Coghlan a écrit : > On Tue, May 24, 2011 at 10:08 AM, Victor Stinner > wrote: > > It's trivial to replace a call to codecs.open() by a call to open(), > > because the two API are very close. The main different is that > >

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 08:16 +, Vinay Sajip a écrit : > So I would also want to keep codecs.open() and friends, at least for now Well, I would agree to keep codecs.open() (if we patch it to reuse TextIOWrapper and add a note to say that it is kept for backward compatibiltiy and open() should b

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 10:03 +0200, M.-A. Lemburg a écrit : > Please read PEP 100 regarding StreamReader and StreamWriter. > Those codecs parts were explicitly designed to be stateful, > unlike the stateless encoder/decoder methods. Yes, it is possible to implement stateful StreamReader and Stream

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 08:16 +, Vinay Sajip a écrit : > > I opened an issue for this idea. Brett and Marc-Andree Lemburg don't > > want to deprecate codecs.open() & friends because they want to be able > > to write code working on Python 2 and on Python 3 without any change. I > > don't think i

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 12:42 +0200, Łukasz Langa a écrit : > Wiadomość napisana przez Walter Dörwald w dniu 2011-05-24, o godz. 12:16: > > >> I don't see which usecase is not covered by TextIOWrapper. But I know > >> some cases which are not supported by StreamReader/StreamWriter. > > > > This co

Re: [Python-Dev] [Python-checkins] cpython: Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl

2011-05-24 Thread Victor Stinner
Le mardi 24 mai 2011 à 11:27 -0400, Terry Reedy a écrit : > > > > +.. function:: RAND_bytes(num) > > + > > + Returns *num* cryptographically strong pseudo-random bytes. > > + > > + .. versionadded:: 3.3 > > + > > +.. function:: RAND_pseudo_bytes(num) > > + > > + Returns (bytes, is_cryptograph

Re: [Python-Dev] [Python-checkins] Daily reference leaks (234021dcad93): sum=61

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 15:13 +1000, Nick Coghlan a écrit : > On Wed, May 25, 2011 at 1:09 PM, wrote: > > results for 234021dcad93 on branch "default" > > > > > > test_packaging leaked [128, 128, 128] references, sum=384 > > Is there a new cache in

Re: [Python-Dev] [Python-checkins] cpython: Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 15:09 +1000, Nick Coghlan a écrit : > The RAND_bytes() documentation should probably make it clearer that > unlike the random module and RAND_pseudo_bytes(), RAND_bytes() can > *fail* (by raising SSLError) if it isn't in a position to provide the > requested random data.

Re: [Python-Dev] [Python-checkins] cpython: Issue #12049: Add RAND_bytes() and RAND_pseudo_bytes() functions to the ssl

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 08:59 +0300, Petri Lehtinen a écrit : > So it seems to me that RAND_bytes() either returns cryptographically > strong data or fails (is it possible to detect the failure with the > Python function? Should this be documented?). RAND_bytes() raises an SSLError on error. You

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 11:38 +0200, M.-A. Lemburg a écrit : > You are missing the point: we have StreamReader and StreamWriter APIs > on codecs to allow each codecs to implement more efficient ways of > encoding and decoding streams. > > Examples of such optimizations are reading the stream in

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 15:43 +0200, M.-A. Lemburg a écrit : > For UTF-16 it would e.g. make sense to always read data in blocks > with even sizes, removing the trial-and-error decoding and extra > buffering currently done by the base classes. For UTF-32, the > blocks should have size % 4 == 0. >

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 13:10 +0200, Victor Stinner a écrit : > codecs is always faster (between 1.07 and 1.15 times faster than io) to > read the whole content of file using read(-1). Something should maybe be > optimized in TextIOWrapper.read() ;-) Oh, I understood: it's maybe

Re: [Python-Dev] Extending os.chown() to accept user/group names

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 18:46 +0200, Charles-François Natali a écrit : > While we're at it, adding a "recursive" argument to this shutil.chown > could also be useful. I don't like the idea of a recursive flag. I would prefer a "map-like" function to "apply" a function on all files of a directory

Re: [Python-Dev] multibytecodex

2011-05-25 Thread Victor Stinner
Le mercredi 25 mai 2011 à 23:41 +0200, Laura Creighton a écrit : > One reason I didn't implement the classes yet is that I couldn't > understand two points in how they are supposed to work. But it seems > that there are really two bugs, as I've been pointed to: > http://bugs.python.org/issue12100

Re: [Python-Dev] [Python-checkins] cpython: Avoid useless "++" at the end of functions

2011-05-26 Thread Victor Stinner
Le jeudi 26 mai 2011 à 08:13 -0400, Eric Smith a écrit : > If you're ever going to add code at the end of these functions, it's > unlikely you'll remember that you need to add these increments back in. You don't have to remember. Test the result of the function, it will not give the expected outpu

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-27 Thread Victor Stinner
Le vendredi 27 mai 2011 10:17:29, M.-A. Lemburg a écrit : > > I think that the readahead algorithm is much more faster than trying to > > avoid partial input, and it's not a problem to have partial input if you > > use an incremental decoder. > > Depends on where you're coming from. For non-seekab

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-27 Thread Victor Stinner
Le vendredi 27 mai 2011 15:33:07, Benjamin Peterson a écrit : > 2011/5/27 Victor Stinner : > > You have until the release of Python 3.3 to prove that StreamReader > > and/or StreamWriter can be faster than TextIOWrapper. If you can prove > > it using a patch and a benchmark, I

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-27 Thread Victor Stinner
Le vendredi 27 mai 2011 16:01:14, Nick Coghlan a écrit : > On Fri, May 27, 2011 at 11:42 PM, M.-A. Lemburg wrote: > > Wrong order: first write a PEP, then discuss, then get approval, > > then patch. > > Indeed. > > If another committer says "please revert and better justify this > change" then w

Re: [Python-Dev] Deprecate codecs.open() and StreamWriter/StreamReader

2011-05-27 Thread Victor Stinner
Le vendredi 27 mai 2011 15:42:10, M.-A. Lemburg a écrit : > If we'd go by your reasoning for deprecating and eventually > removing parts of the stdlib or Python's subsystems, we'll end > up with a barebone version of Python. That's not what we want > and it's not what our users want. I don't want

Re: [Python-Dev] [RELEASE] Python 2.7.2 release candidate 1

2011-05-30 Thread Victor Stinner
Hi, Le lundi 30 mai 2011 06:47:40, Ralf Schmitt a écrit : > Benjamin Peterson writes: > > The 2.7.2 changelog is at: > > http://hg.python.org/cpython/file/439396b06416/Misc/NEWS > > The news file mentions that issue 1195 ("Problems on Linux with Ctrl-D > and Ctrl-C during raw_input") is fix

Re: [Python-Dev] [RELEASE] Python 2.7.2 release candidate 1

2011-05-30 Thread Victor Stinner
Le lundi 30 mai 2011 10:46:39, Ralf Schmitt a écrit : > Victor Stinner writes: > >> Does one need special roundup rights to reopen issues? > > > > Oh, I forgot that one. Please reopen the issue, I will apply your fix > > instead of mine. > > I would love

Re: [Python-Dev] [Python-checkins] cpython: Close #12028: Make threading._get_ident() public, rename it to

2011-05-31 Thread Victor Stinner
Le mardi 31 mai 2011 10:37:15, Nick Coghlan a écrit : > I was just wrong, but the wording is still confusing since it has been > copied from _thread.ident. "Thread" means something other than > "threading.Thread" in that module, while in the threading docs, it > typically refers to the actual objec

Re: [Python-Dev] [Python-checkins] cpython: Add NEWS and whatsnew entries for the packaging module

2011-06-03 Thread Victor Stinner
Le vendredi 03 juin 2011 17:28:48, eric.araujo a écrit : > +packaging > +- > + > +:mod:`distutils` has undergone additions and refactoring under a new name, > +:mod:`packaging`, to allow developers to break backward compatibility. > +:mod:`distutils` is still provided in the standard librar

Re: [Python-Dev] [Python-checkins] cpython (3.1): Do not add txt files twice.

2011-06-05 Thread Victor Stinner
I added the "if dir=='cjkencodings':" to msi.py, based on tests for other subdirectories in Lib/tests/. Can you explain me why cjkencodings should not have a special case? The fix should maybe be ported to 3.2, 3.3 and 2.7. Victor Le dimanche 05 juin 2011 11:00:30, martin.v.loewis a écrit : > h

[Python-Dev] Buildbots and regrtest timeout

2011-06-06 Thread Victor Stinner
Hi, Stephan Krah asked me to change how the default timeout is defined for regrtest (issue #12250): "The implicit timeout in regrtest.py makes it harder to write automated test scripts for 3rd party modules. First, you have to remember to set --timeout=0 for long running tests. Then, you have to

[Python-Dev] Byte filenames in the posix module on Windows

2011-06-07 Thread Victor Stinner
Hi, Last november, we "decided" (right?) to deprecate bytes filenames in the posix module on Windows in Python 3.2 and drop the support in 3.3: see "Removal of Win32 ANSI API" thread on python-dev. Python 3.2 has been released, so we should shift the versions numbers. I would like to take car

Re: [Python-Dev] [Python-checkins] cpython (2.7): Merge

2011-06-08 Thread Victor Stinner
Le jeudi 09 juin 2011 à 02:30 +0200, brian.curtin a écrit : > http://hg.python.org/cpython/rev/f1509fc75435 > changeset: 70715:f1509fc75435 > branch: 2.7 > parent: 70661:6e7a98cfcfab > user:Brian Curtin > date:Wed Jun 08 19:29:53 2011 -0500 > summary: > Merge FYI thi

Re: [Python-Dev] cpython (3.2): Fix #11583. Changed os.path.isdir to use GetFileAttributes instead of os.stat.

2011-06-09 Thread Victor Stinner
Le jeudi 09 juin 2011 à 08:16 +0200, Georg Brandl a écrit : > On 06/09/11 02:00, brian.curtin wrote: > > http://hg.python.org/cpython/rev/88e318166eaf > > changeset: 70713:88e318166eaf > > branch: 3.2 > > parent: 70700:0aa3064d1cef > > user:Brian Curtin > > date:Wed Jun

Re: [Python-Dev] Python jails

2011-06-11 Thread Victor Stinner
Le 11/06/2011 02:41, R. David Murray a écrit : I haven't read through your post, but if you don't know about it I suspect that you will be interested in the following: http://code.activestate.com/pypm/pysandbox/ I'm pretty sure Victor will be happy to have someone else interested in this t

Re: [Python-Dev] Lazy unpacking for struct module

2011-06-13 Thread Victor Stinner
Le dimanche 12 juin 2011 à 10:27 -0700, Raymond Hettinger a écrit : > I do suggest that you publish your code as a third-party module > to make the optional available and to validate whether there > is any real interest in this. See the Hachoir project: it is a lazy parser supporting sub-structure

Re: [Python-Dev] [Python-checkins] cpython: edit and rewrite

2011-06-19 Thread Victor Stinner
Le samedi 18 juin 2011 à 02:51 +0200, benjamin.peterson a écrit : > .. function:: dump_traceback(file=sys.stderr, all_threads=True) > > - Dump the traceback of all threads, or of the current thread if > *all_threads* > - is ``False``, into *file*. > + Dump the traceback of all threads int

Re: [Python-Dev] [Python-checkins] devguide: Add a communications section to the devguide FAQ (closes #11690)

2011-06-19 Thread Victor Stinner
Le dimanche 19 juin 2011 à 16:51 +0200, nick.coghlan a écrit : > +Where should I ask general Python questions? > + > + > +General Python questions should still go to `python-list`_ or `python-tutor`_ > +or similar resources, such as StackOverflow_ or ``#p

Re: [Python-Dev] EuroPython Language Summit report

2011-06-24 Thread Victor Stinner
Le vendredi 24 juin 2011 à 10:52 +0200, Mark Dickinson a écrit : > - [Armin Ronacher] Python 3's Unicode support still has some dark areas. What? Unicode support is perfect in Python 3! > One example: when opening a text file for reading and writing, the default > encoding used depends o

Re: [Python-Dev] EuroPython Language Summit report

2011-06-24 Thread Victor Stinner
Le vendredi 24 juin 2011 à 16:30 -0400, Terry Reedy a écrit : > > I see two options to improve the situation. > > The third is to make utf-8 the default. I believe this *is* the proper > long term solution and both options are contrary to this. Oh yes, I also prefer this option, but I suspect th

[Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-28 Thread Victor Stinner
In Python 2, open() opens the file in binary mode (e.g. file.readline() returns a byte string). codecs.open() opens the file in binary mode by default, you have to specify an encoding name to open it in text mode. In Python 3, open() opens the file in text mode by default. (It only opens the binar

Re: [Python-Dev] EuroPython Language Summit report

2011-06-28 Thread Victor Stinner
Le mardi 28 juin 2011 à 14:41 +0100, Michael Foord a écrit : > On 24/06/2011 15:55, R. David Murray wrote: > > On Fri, 24 Jun 2011 10:52:40 +0200, Mark Dickinson > > wrote: > >> EuroPython 2011 Language Summit > >> === > > [...] > >> Unicode character classes is a

Re: [Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-28 Thread Victor Stinner
Le mardi 28 juin 2011 à 16:02 +0200, M.-A. Lemburg a écrit : > How about a more radical change: have open() in Py3 default to > opening the file in binary mode, if no encoding is given (even > if the mode doesn't include 'b') ? I tried your suggested change: Python doesn't start. sysconfig uses t

Re: [Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-28 Thread Victor Stinner
> > I don't think that Windows developer even know that they are writing > > files into the ANSI code page. MSDN documentation of > > WideCharToMultiByte() warns developer that the ANSI code page is not > > portable, even accross Windows computers: > > Probably true. But for many uses they also do

Re: [Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-28 Thread Victor Stinner
Le mardi 28 juin 2011 à 09:33 -0700, Toshio Kuratomi a écrit : > Issuing a warning like "open used without explicit encoding may lead > to errors" if open() is used without an explicit encoding would help > a little (at least, people who get errors would then have an inkling > that the culprit migh

Re: [Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-29 Thread Victor Stinner
Le mercredi 29 juin 2011 à 10:18 +0200, M.-A. Lemburg a écrit : > Victor Stinner wrote: > > Le mardi 28 juin 2011 à 16:02 +0200, M.-A. Lemburg a écrit : > >> How about a more radical change: have open() in Py3 default to > >> opening the file in binary mode, if no enco

Re: [Python-Dev] open(): set the default encoding to 'utf-8' in Python 3.3?

2011-06-29 Thread Victor Stinner
Le mercredi 29 juin 2011 à 09:21 +0200, Baptiste Carvello a écrit : > By the way, I just thought that for real programming, I would love to have a > -Wcrossplatform command switch, which would warn for all unportable > constructs > in one go. That way, I don't have to remember which parts of 'os

Re: [Python-Dev] [Python-checkins] cpython (3.2): Issue #12400: runtest() truncates the StringIO stream before a new test

2011-06-29 Thread Victor Stinner
Le mercredi 29 juin 2011 à 13:05 -0400, Terry Reedy a écrit : > On 6/29/2011 11:30 AM, victor.stinner wrote: > > > summary: > >Issue #12400: runtest() truncates the StringIO stream before a new test > > > > files: > >Lib/test/regrtest.py | 1 + > >1 files changed, 1 insertions(+), 0 de

Re: [Python-Dev] time.sleep(-1) behaviour

2011-06-30 Thread Victor Stinner
Le jeudi 30 juin 2011 à 21:13 +0200, Ulrich Eckhardt a écrit : > Hi! > > This is a request for clarification for the thread "how to call a function > for > evry 10 seconds" from the user mailinglist/newsgroup. > > > The gist is this: > 1. On Linux/Python 2.6, time.sleep(-1.0) raises an IOError

<    21   22   23   24   25   26   27   28   29   30   >