Python 2.7 crashed during compilation on HP PA-RISC

[Don Chen]

Hello,
I am compiling Python2.7 on a HP11i PA-RISC machine and received a segmentation 
fault.

Platform Information
"uname -a" = HP-UX hpdev2 B.11.11 U 9000/800 2280874925 unlimited-user 
license

Steps
1) uncompress Python tgz file
2) run "configure CC=aCC CXX=aCC"
3) make

Result: Segmentation fault at library generation time.
$> ranlib libpython2.7.a
 aCC -Ae  -Wl,-E -Wl,+s -o python \
Modules/python.o \
libpython2.7.a -lnsl -lrt -ldld  -lpthread   -lm
sh[3]: 15168 Bus error(coredump)
*** Error exit code 138

Analysis: core file generated by Python executable
$> file python
   python: PA-RISC2.0 shared executable dynamically linked -not stripped
$> file libpython2.7.a
   libpython2.7.a: archive file -PA-RISC2.0 relocatable library
$> strings core|more
   http://mail.python.org/pipermail/python-bugs-list/2010-July/104448.html) with 
a similar topic but the compiler generated segmentation fault instead. In this 
case the core file seems
to be from Python itself. I have attached Makefile for your reference.

Thank you for your help!

Don
# Generated automatically from Makefile.pre by makesetup.
# Top-level Makefile for Python
#
# As distributed, this file is called Makefile.pre.in; it is processed
# into the real Makefile by running the script ./configure, which
# replaces things like @spam@ with values appropriate for your system.
# This means that if you edit Makefile, your changes get lost the next
# time you run the configure script.  Ideally, you can do:
#
#   ./configure
#   make
#   make test
#   make install
#
# If you have a previous version of Python installed that you don't
# want to overwrite, you can use "make altinstall" instead of "make
# install".  Refer to the "Installing" section in the README file for
# additional details.
#
# See also the section "Build instructions" in the README file.

# === Variables set by makesetup ===

MODOBJS=  Modules/threadmodule.o  Modules/signalmodule.o  
Modules/posixmodule.o  Modules/errnomodule.o  Modules/pwdmodule.o  
Modules/_sre.o  Modules/_codecsmodule.o  Modules/_weakref.o  
Modules/zipimport.o  Modules/symtablemodule.o  Modules/xxsubtype.o
MODLIBS=$(LOCALMODLIBS) $(BASEMODLIBS)

# === Variables set by configure
VERSION=2.7
srcdir= .


CC= aCC -Ae
CXX=aCC
MAINCC= $(CC)
LINKCC= $(PURIFY) $(MAINCC)
AR= ar
RANLIB= ranlib
SVNVERSION= echo Unversioned directory
HGVERSION=  
HGTAG=  
HGBRANCH=   

GNULD=  no

# Shell used by make (some versions default to the login shell, which is bad)
SHELL=  /bin/sh

# Use this to make a link between python$(VERSION) and python in $(BINDIR)
LN= ln

# Portable install script (configure doesn't always guess right)
INSTALL=./install-sh -c
INSTALL_PROGRAM=${INSTALL}
INSTALL_SCRIPT= ${INSTALL}
INSTALL_DATA=   ${INSTALL} -m 644
# Shared libraries must be installed with executable mode on some systems;
# rather than figuring out exactly which, we always give them executable mode.
# Also, making them read-only seems to be a good idea...
INSTALL_SHARED= ${INSTALL} -m 555

MAKESETUP=  $(srcdir)/Modules/makesetup

# Compiler options
OPT=-DNDEBUG -O
BASECFLAGS=  -Olimit 1500
CFLAGS= $(BASECFLAGS) -g $(OPT) $(EXTRA_CFLAGS)
# Both CPPFLAGS and LDFLAGS need to contain the shell's value for setup.py to
# be able to build extension modules using the directories specified in the
# environment variables
CPPFLAGS=   -I. -IInclude -I$(srcdir)/Include 
LDFLAGS=
LDLAST= 
SGI_ABI=
CCSHARED=   +z
LINKFORSHARED=  -Wl,-E -Wl,+s
ARFLAGS=rc
# Extra C flags added for building the interpreter object files.
CFLAGSFORSHARED=
# C flags used for building the interpreter object files
PY_CFLAGS=  $(CFLAGS) $(CPPFLAGS) $(CFLAGSFORSHARED) -DPy_BUILD_CORE


# Machine-dependent subdirectories
MACHDEP=hp-ux11

# Install prefix for architecture-independent files
prefix= /usr/local

# Install prefix for architecture-dependent files
exec_prefix=${prefix}

# Install prefix for data files
datarootdir=${prefix}/share

# Expanded directories
BINDIR= ${exec_prefix}/bin
LIBDIR= ${exec_prefix}/lib
MANDIR= ${datarootdir}/man
INCLUDEDIR= ${prefix}/include
CONFINCLUDEDIR= $(exec_prefix)/include
SCRIPTDIR=  $(prefix)/lib

# Detailed destination directories
BINLIBDEST= $(LIBDIR)/python$(VERSION)
LIBDEST=$(SCRIPTDIR)/python$(VERSION)
INCLUDEPY=  $(INCLUDEDIR)/python$(VERSION)
CONFINCLUDEPY=  $(CONFINCLUDEDIR)/python$(VERSION)
LIBP=   $(LIBDIR)/python$(VERSION)

# Symbols used for using shared libraries
SO= .sl
LDSHARED=   ld -b $(LDFLAGS)
BLDSHARED=  ld -b $(LDFLAGS)
LDCXXSHARED=ld -b
DESTSHARED= $(

[issue14370] enumerate() lead to system crashes

[Stefan Krah]

Stefan Krah  added the comment:

I can reproduce this with Python 3.2 on Linux-2.4.32/i686 with 512M of
RAM. The machine does not crash, it freezes completely in the same
manner as with a fork bomb. A hard reboot is required.

--
nosy: +skrah
type: performance -> resource usage

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14370] list.extend() called on an iterator of the list itself leads to an infinite loop

[Petri Lehtinen]

Petri Lehtinen  added the comment:

This has the same effect:

a = list(range(5))
a.extend(iter(a))

So the problem is not in enumerate but in list.extend()

--
nosy: +petri.lehtinen
title: enumerate() lead to system crashes -> list.extend() called on an 
iterator of the list itself leads to an infinite loop

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14370] list.extend() called on an iterator of the list itself leads to an infinite loop

[Charles-François Natali]

Charles-François Natali  added the comment:

I think you're simply running OOM, and Linux is thrashing to death.
If you wait long enough, the process should get nuked by the OOM killer (well, 
in theory).

What happens if you disable swap altogether ('swapoff -a')?
You can also change to strict overcommitting ('echo 2 > 
/proc/sys/vm/overcommit_memory').

Anyway, I guess you would get the same effect by simply running
list(range())...

--
nosy: +neologix

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue3367] Uninitialized value read in parsetok.c

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

bump, what is the status of this?  Was it fixed?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14198] Backport parts of the new memoryview documentation

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

Stefan, I just want to point out this issue, if you are touching 2.7:
http://bugs.python.org/issue10538
Do you think it merits being fixed?

--
nosy: +krisvale

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10211] BufferObject doesn't support new buffer interface

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

Bumping this.  Do we want this fixed as a bug in 2.7 or left alone?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10212] struct.unpack and cStringIO.StringIO don't support new buffer

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

The patch is still there.  Any new consensus?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9787] Release the TLS lock during allocations

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

I'll rework this for python 3.x and see where that gets us.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14198] Backport parts of the new memoryview documentation

[Stefan Krah]

Stefan Krah  added the comment:

Kristj??n Valur J??nsson  wrote:
> Stefan, I just want to point out this issue, if you are touching 2.7:
> http://bugs.python.org/issue10538
> Do you think it merits being fixed?

I think so. A patch would be appreciated, since the issue touches the
old buffer interface (which I haven't looked at in detail at all).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10538] PyArg_ParseTuple("s*") does not always incref object

[Stefan Krah]

Changes by Stefan Krah :


--
nosy: +skrah

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue3367] Uninitialized value read in parsetok.c

[Stefan Krah]

Stefan Krah  added the comment:

It isn't fixed. Also, there's now an additional invalid read in
sys_update_path():

$ valgrind --db-attach=yes --suppressions=Misc/valgrind-python.supp ./python 
==20258== Memcheck, a memory error detector
==20258== Copyright (C) 2002-2010, and GNU GPL'd, by Julian Seward et al.
==20258== Using Valgrind-3.6.1 and LibVEX; rerun with -h for copyright info
==20258== Command: ./python
==20258== 
Python 3.3.0a1+ (default:0554183066b5, Mar 20 2012, 10:47:41) 
[GCC 4.4.3] on linux
Type "help", "copyright", "credits" or "license" for more information.
==20258== Invalid read of size 8
==20258==at 0x4C9F6F: sys_update_path (sysmodule.c:1742)
==20258==by 0x4CA268: PySys_SetArgvEx (sysmodule.c:1830)
==20258==by 0x4CA28F: PySys_SetArgv (sysmodule.c:1836)
==20258==by 0x4D9930: Py_Main (main.c:647)
==20258==by 0x41AE1F: main (python.c:63)
==20258==  Address 0x5a58048 is 0 bytes after a block of size 8 alloc'd
==20258==at 0x4C27878: malloc (vg_replace_malloc.c:236)
==20258==by 0x41DF90: PyMem_Malloc (object.c:1841)
==20258==by 0x41ACC4: main (python.c:25)
==20258== 
==20258== 
==20258==  Attach to debugger ? --- [Return/N/n/Y/y/C/c]  n
>>> 
==20258== Conditional jump or move depends on uninitialised value(s)
==20258==at 0x52B030: parsetok (parsetok.c:207)
==20258==by 0x52AD51: PyParser_ParseFileFlagsEx (parsetok.c:108)
==20258==by 0x4BFCDA: PyParser_ASTFromFile (pythonrun.c:1973)
==20258==by 0x4BDB5A: PyRun_InteractiveOneFlags (pythonrun.c:1196)
==20258==by 0x4BD83D: PyRun_InteractiveLoopFlags (pythonrun.c:1106)
==20258==by 0x4BD6E2: PyRun_AnyFileExFlags (pythonrun.c:1075)
==20258==by 0x4D9118: run_file (main.c:306)
==20258==by 0x4D9C0B: Py_Main (main.c:720)
==20258==by 0x41AE1F: main (python.c:63)
==20258==

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14262] Allow using decimals as arguments to `timedelta`

[Ram Rachum]

Ram Rachum  added the comment:

"I'm not completly conviced by the need of supporting Decimal in timedelta 
constructor. Why do you use Decimal if the result should be a timedelta? Why 
not using timedelta directly?"

What do you mean, "Why not using timedelta directly?" How could I use timedelta 
directly in the timedelta constructor? I'm creating a timedelta, I don't have 
one ready.

I'm getting an `n_hours` variable for some component of my system. And this 
value happens to come as a `Decimal`. I want to create a `timedelta` out of it. 
So I'd want to be able to do `timedelta(hours=n_hours)` rather than 
`timedelta(hours=float(n_hours))`.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14302] Move python.exe to bin/

[Giampaolo Rodola']

Changes by Giampaolo Rodola' :


--
nosy: +giampaolo.rodola

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Serhiy Storchaka]

New submission from Serhiy Storchaka :

ZIP File Format Specification 
(http://www.pkware.com/documents/casestudies/APPNOTE.TXT) supports bzip2 
compression since at least 2003. Since bzip2 contained in Python standart 
library, it would be nice to add support for these method in zipfile. This will 
allow to process more foreign zip files and create more compact distributives.

The proposed patch adds new method ZIP_BZIP2, which is automatically detecting 
when unpacking and that can be used for packing.

--
components: Library (Lib)
files: bzip2_in_zip.patch
keywords: patch
messages: 156394
nosy: storchaka
priority: normal
severity: normal
status: open
title: Add support for bzip2 compression to the zipfile module
type: enhancement
versions: Python 3.3
Added file: http://bugs.python.org/file24956/bzip2_in_zip.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14366] Supporting bzip2 and lzma compression in zip files

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

Issue #14371: Add support for bzip2 compression to the zipfile module.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14262] Allow using decimals as arguments to `timedelta`

[STINNER Victor]

STINNER Victor  added the comment:

"I'm getting an `n_hours` variable for some component of my system.
And this value happens to come as a `Decimal`."

Can't you modify your program to use timedelta instead of Decimal for n_hours?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14228] It is impossible to catch sigint on startup in python code

[Charles-François Natali]

Charles-François Natali  added the comment:

> for everybody who is not *programming* python (imagine there is a *real* 
> user) the tracebacks are useless. Even worse, because the error messages are 
> *changing*, because of different library parts not catching the exception.

Well, I also use it sometimes ;-)

> The problem here is that the user is confronted with unwanted output, 
> produced by the interpreter, which is not possible to be caught by a 
> programmer to prevent this situation happening.

You can start the interpreter with '-S' to avoid importing the site
module, then:

"""
import signal
signal.signal(signal.SIGINT, signal.SIG_DFL)

import site
site.main()

[...]
"""

or

"""
try:
import site
site.main()

import signal
signal.signal(signal.SIGINT, signal.SIG_DFL)
except KeyboardInterrupt:
whatever

[...]
"""

Or we could change Py_InitializeEx() to setup the signal handlers
after having imported the site module:
"""
--- cpython-93769b8ff40b/Python/pythonrun.c 2012-01-19
10:29:48.0 +
+++ cpython/Python/pythonrun.c  2012-03-20 11:27:37.0 +
@@ -313,9 +313,6 @@
 if (initfsencoding(interp) < 0)
 Py_FatalError("Py_Initialize: unable to load the file system codec");

-if (install_sigs)
-initsigs(); /* Signal handling stuff, including initintr() */
-
 initmain(); /* Module __main__ */
 if (initstdio() < 0)
 Py_FatalError(
@@ -333,6 +330,9 @@

 if (!Py_NoSiteFlag)
 initsite(); /* Module site */
+
+if (install_sigs)
+initsigs(); /* Signal handling stuff, including initintr() */
"""

Note, however, that there will always be a race window, if the signal
is delivered after the signal handlers have been setup and the first
line of the user code is executed.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14370] list.extend() called on an iterator of the list itself leads to an infinite loop

[Giampaolo Rodola']

Changes by Giampaolo Rodola' :


--
nosy: +giampaolo.rodola

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14262] Allow using decimals as arguments to `timedelta`

[Ram Rachum]

Ram Rachum  added the comment:

In some cases we indeed use a timedelta directly, but sometimes we get a 
"number of hours", and in those cases it's more convenient for us to work with 
"number of hours" directly.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14228] It is impossible to catch sigint on startup in python code

[Charles-François Natali]

Charles-François Natali  added the comment:

> Or we could change Py_InitializeEx() to setup the signal handlers
> after having imported the site module:

Note that I don't really like this solution, because it's better to
setup handlers for fatal signals (SIGPIPE, SIGXF...) before executing
arbitrary Python code (site).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14228] It is impossible to catch sigint on startup in python code

[Antoine Pitrou]

Antoine Pitrou  added the comment:

> > Or we could change Py_InitializeEx() to setup the signal handlers
> > after having imported the site module:
> 
> Note that I don't really like this solution, because it's better to
> setup handlers for fatal signals (SIGPIPE, SIGXF...) before executing
> arbitrary Python code (site).

Agreed. I think we'd better disable SIGINT initialization when a certain
environment variable is set.
(AFAICT, the issue is only about SIGINT since it's the only one where
the default behaviour is overriden)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14311] ConfigParser does not parse utf-8 files with BOM bytes

[Łukasz Langa]

Changes by Łukasz Langa :


--
resolution:  -> duplicate
stage: needs patch -> committed/rejected
status: open -> closed
superseder:  -> Python3: guess text file charset using the BOM
versions:  -Python 2.7, Python 3.2

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue7651] Python3: guess text file charset using the BOM

[Łukasz Langa]

Changes by Łukasz Langa :


--
assignee:  -> lukasz.langa

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14372] Fix all invalid usage of borrowed references

[STINNER Victor]

New submission from STINNER Victor :

I fixed the issues #14211 and #14231. These issues were invalid usage of 
borrowed reference: the reference can be destroyed before the reference is used.

Armin Rigo replied:

"I will attempt a last time to mention that the docstrings in borrowed_ref_*.py 
used to say they were *examples*.

That means: (1) find any internal or external C function that returns a 
borrowed reference; (2) find all callers and write down all the places that 
don't immediately either Py_INCREF() the returned value or immediately forget 
about it; (3) for each such place, either come up painfully with a complicated 
explanation of why it's safe in all possible cases, or in doubt, just fix it by 
adding Py_INCREF()/Py_DECREF().

What I did in writing these two borrowed_ref_*.py was to do instead (3') spend 
a few hours figuring out how to exploit the issue until we get a segfault.  I 
did it for two examples, but what I'm definitely not going to do is spend N 
times a few hours for a large number N.  If python-dev people just fix the two 
examples, remove the crashers, and just forget about the issue, then well, the 
point is missed, but I'm not going to fight it."

Sorry Armin, I didn't know that the issue of borrowed was a generic issue and 
more code need to be fixed. So I'm opening this issue to track of invalid usage 
of borrowed references.

--
components: Interpreter Core, Library (Lib)
messages: 156401
nosy: haypo
priority: normal
severity: normal
status: open
title: Fix all invalid usage of borrowed references
type: crash
versions: Python 3.3

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14372] Fix all invalid usage of borrowed references

[STINNER Victor]

Changes by STINNER Victor :


--
nosy: +arigo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue7652] Merge C version of decimal into py3k.

[Stefan Krah]

Stefan Krah  added the comment:

We need to decide what to do with the different limits of the 64-bit and
32-bit versions:

   MAX_EMAX

default context 10**9-1 
64-bit 10**18-1
32-bit42500   


I think it would be annoying to have the values in DefaultContext, 
ExtendedContext and BasicContext depend on the machine.

The best thing might be to use Emax=10**8-1 and Emin=-(10**8-1) throughout.
I don't think many applications depend on having Emax=10**9-1. If they do,
they'll have to use the 64-bit version.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14372] Fix all invalid usage of borrowed references

[STINNER Victor]

STINNER Victor  added the comment:

> (1) find any internal or external C function that returns a borrowed reference

Doc/data/refcounts.dat can be used for that:

PyCell_GET
PyDict_GetItem
PyDict_GetItemString
PyErr_Occurred
PyEval_GetBuiltins
PyEval_GetLocals
PyEval_GetGlobals
PyEval_GetFrame
PyFile_Name
PyFunction_GetClosure
PyFunction_GetCode
PyFunction_GetDefaults
PyFunction_GetGlobals
PyFunction_GetModule
Py_InitModule
Py_InitModule3
Py_InitModule4
PyImport_AddModule
PyImport_GetModuleDict
PyList_GET_ITEM
PyList_GetItem
PyMethod_Class
PyMethod_Function
PyMethod_GET_CLASS
PyMethod_GET_FUNCTION
PyMethod_GET_SELF
PyMethod_Self
PyModule_GetDict
PyObject_Init
PySequence_Fast_GET_ITEM
PySys_GetObject
PySys_GetXOptions
PyThreadState_GetDict
PyTuple_GET_ITEM
PyTuple_GetItem
PyWeakref_GET_OBJECT
PyWeakref_GetObject

(this list may be incomplete, it should be checked)

Not affected (always return NULL):

PyErr_NoMemory
PyErr_Set...

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14369] make __closure__ writable

[Andrew Svetlov]

Andrew Svetlov  added the comment:

Please update the doc also. I think changing from 'Read-only' to 'Writable' in 
Doc/reference/datamodel.rst is enough.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14373] C implementation of functools.lru_cache

[Matt Joiner]

New submission from Matt Joiner :

functools.lru_cache is optimized to the point that it may benefit from a C 
implementation.

--
components: Interpreter Core, Library (Lib)
messages: 156405
nosy: anacrolix, rhettinger
priority: normal
severity: normal
status: open
title: C implementation of functools.lru_cache
type: performance
versions: Python 3.3

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

What if add more hacking? If long integer already used for buffering and 
checking, let use it for swapping and splitting too.

With my patch (attached) codecs.utf_16_be_decode runs 5% faster (on 32-bit 
Linux, I was not tested 64-bit). And of cause no pointers -- no aliasing 
warnings.

--
nosy: +storchaka
Added file: http://bugs.python.org/file24957/utf16_decoder_shift.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[STINNER Victor]

STINNER Victor  added the comment:

> With my patch (attached) codecs.utf_16_be_decode runs 5% faster (on 32-bit 
> Linux, I was not tested 64-bit). And of cause no pointers -- no aliasing 
> warnings.

Your patch is wrong: you need to use & 0x to get lower 16 bits
when reading a UTF-16 unit. For example, (Py_UCS2)(block >> 32) should
be written (Py_UCS2)((block >> 32) & 0x).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14373] C implementation of functools.lru_cache

[Matt Joiner]

Changes by Matt Joiner :


Added file: http://bugs.python.org/file24958/functools.lru_cache-in-c

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

Heh. This was in previous version of my patch. I have removed '& 0xu' and 
parents for simplicity. GCC produces same binaries for both sources. But you 
can return it back. It has effect only on plathforms with non-16-bit short, but 
now Python not supports they (Python is not well portable on exotic plathforms).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9787] Release the TLS lock during allocations

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

New patch, based on the cpython tip.

--
Added file: http://bugs.python.org/file24959/tlspatch.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


Added file: http://bugs.python.org/file24960/utf16_decoder_shift_2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14302] Move python.exe to bin/

[VanL]

VanL  added the comment:

As Éric mentioned, there are two proposals here:

1. Move the python exe
2. Change 'Scripts' to 'bin'

As for #1, what about letting the location of the python binary be an install 
option:

[ ] Put python.exe into binaries directory and add to PATH?

And then make it unchecked by default in 3.3, checked by default in 3.4, and 
then remove the option for 3.5?

As for #2, I don't see a lot of resistance; the issues seem to mostly be with 
#1. Could #2 move into 3.3?

--
nosy: +VanL

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9787] Release the TLS lock during allocations

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

hm, for some reason this patch isn't viewable in side-by-side

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue12684] profile does not dump stats on exception like cProfile does

[Matt Joiner]

Changes by Matt Joiner :


Added file: http://bugs.python.org/file24961/profiler-unhandled-exceptions.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14369] make __closure__ writable

[Yury Selivanov]

Yury Selivanov  added the comment:

> Please update the doc also. I think changing from 'Read-only' to 'Writable' 
> in Doc/reference/datamodel.rst is enough.

Updated in writable_closure_03.patch.  Thanks.

--
Added file: http://bugs.python.org/file24962/writable_closure_03.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9720] zipfile writes incorrect local file header for large files in zip64

[David Andrzejewski]

Changes by David Andrzejewski :


--
nosy: +dandrzejewski

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Jason Killen  added the comment:

I'm adding a patch for test_smtpd.py.  This version includes the changes in my 
previous patch and adds sending HELO before the commands in the test.  Works 
good for me.

--
Added file: http://bugs.python.org/file24963/test_smtpd.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13694] asynchronous connect in asyncore.dispatcher does not set addr

[Matt Joiner]

Matt Joiner  added the comment:

This patch is a shoo-in, can someone review and commit this?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue12684] profile does not dump stats on exception like cProfile does

[Matt Joiner]

Matt Joiner  added the comment:

I attached a minimal patch that additionally tidies the exception handling for 
{cP,p}rofile.runctx.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[STINNER Victor]

STINNER Victor  added the comment:

> It has effect only on plathforms with non-16-bit short

The problem is for 64-bit long: "long >> 32" returns the 32 higher
bits (32..64), not 16 bits (32..48).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Martin v . Löwis]

Changes by Martin v. Löwis :


Added file: http://bugs.python.org/file24964/bzip2_in_zip_review.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14310] Socket duplication for windows

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

A new patch with fixes and documentation.
And yes, socket.share() does in fact perform duplication, because 
socket.close() can be performed immediately afterwards.

--
Added file: http://bugs.python.org/file24965/duplicate.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14310] Socket duplication for windows

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

hm, patch doesn't work, removing the [mq] section

--
Added file: http://bugs.python.org/file24966/duplicate.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14310] Socket duplication for windows

[Kristján Valur Jónsson]

Changes by Kristján Valur Jónsson :


Removed file: http://bugs.python.org/file24966/duplicate.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14310] Socket duplication for windows

[Kristján Valur Jónsson]

Changes by Kristján Valur Jónsson :


--
Removed message: http://bugs.python.org/msg156418

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Martin v . Löwis]

Martin v. Löwis  added the comment:

Can you please submit a contributor form?

http://python.org/psf/contrib/contrib-form/
http://python.org/psf/contrib/

--
nosy: +loewis

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14374] Compiling Python 2.7.2 on HP11i PA-RISC ends with segmentation fault in Python executable

[donchen]

New submission from donchen :

Hello,
I am compiling Python2.7 on a HP11i PA-RISC machine and received a segmentation 
fault.

Platform Information
   "uname -a" = HP-UX hpdev2 B.11.11 U 9000/800 2280874925 unlimited-user 
license
 
Steps
1) uncompress Python tgz file
2) run "configure CC=aCC CXX=aCC"
3) make

Result: Segmentation fault at library generation time.
$> ranlib libpython2.7.a
   aCC -Ae  -Wl,-E -Wl,+s -o python \
   Modules/python.o \
   libpython2.7.a -lnsl -lrt -ldld  -lpthread   -lm
sh[3]: 15168 Bus error(coredump)
*** Error exit code 138
 
Analysis: core file generated by Python executable
$> file python
   python: PA-RISC2.0 shared executable dynamically linked -not stripped
$> file libpython2.7.a
   libpython2.7.a: archive file -PA-RISC2.0 relocatable library
$> strings core|more
http://mail.python.org/pipermail/python-bugs-list/2010-July/104448.html) with 
a similar topic but the compiler generated segmentation fault instead. In this 
case the core file seems
to be from Python itself. I have attached Makefile for your reference.
 
Thank you for your help!

--
components: Library (Lib)
files: Makefile
messages: 156420
nosy: donchen
priority: normal
severity: normal
status: open
title: Compiling Python 2.7.2 on HP11i PA-RISC ends with segmentation fault in 
Python executable
type: crash
versions: Python 2.7
Added file: http://bugs.python.org/file24967/Makefile

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13694] asynchronous connect in asyncore.dispatcher does not set addr

[Roundup Robot]

Roundup Robot  added the comment:

New changeset 1c0058991740 by Giampaolo Rodola' in branch 'default':
Fix issue #13694: asynchronous connect in asyncore.dispatcher does not set addr.
http://hg.python.org/cpython/rev/1c0058991740

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13694] asynchronous connect in asyncore.dispatcher does not set addr

[Roundup Robot]

Roundup Robot  added the comment:

New changeset 4e5ddde76dbe by Giampaolo Rodola' in branch '2.7':
Fix issue #13694: asynchronous connect in asyncore.dispatcher does not set addr.
http://hg.python.org/cpython/rev/4e5ddde76dbe

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13694] asynchronous connect in asyncore.dispatcher does not set addr

[Roundup Robot]

Roundup Robot  added the comment:

New changeset a5add01e96be by Giampaolo Rodola' in branch '3.2':
Fix issue #13694: asynchronous connect in asyncore.dispatcher does not set addr.
http://hg.python.org/cpython/rev/a5add01e96be

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13694] asynchronous connect in asyncore.dispatcher does not set addr

[Giampaolo Rodola']

Giampaolo Rodola'  added the comment:

Done. Sorry for the delay.

--
resolution:  -> fixed
stage: patch review -> committed/rejected
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14302] Move python.exe to bin/

[Martin v . Löwis]

Martin v. Löwis  added the comment:

I'm still opposed to having the path manipulated by default, but Brian is 
working on a patch to edit the path with the default being off. If python.exe 
stays in the toplevel directory, it means that two entries have to be added to 
the path, making it even more messy and bloated than path editing already is. 
So I still think that it should be all in bin in the long term.

Anybody opposed to changing scripts to bin please speak up; I'm happy to change 
it for the next alpha release, and let people object here in this issue (with 
the potential of reverting the change if there is too much opposition).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10212] struct.unpack and cStringIO.StringIO don't support new buffer

[Terry J. Reedy]

Terry J. Reedy  added the comment:

Stefan, since you have been working on Memoryview, any opinions?

--
nosy: +skrah

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Martin v . Löwis]

Martin v. Löwis  added the comment:

The patch looks good. Can you also provide a test case?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14374] Compiling Python 2.7.2 on HP11i PA-RISC ends with segmentation fault in Python executable

[Martin v . Löwis]

Martin v. Löwis  added the comment:

I don't think we will be able to help. Can you run the generated Python under a 
debugger and find out what happened?

If not, just try disabling optimization in the compiler and see whether this 
helps.

--
nosy: +loewis

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[R. David Murray]

R. David Murray  added the comment:

Hmm.  I'm certain that QUIT shouldn't require HELO, and I wouldn't expect that 
NOOP would either.  

I just checked the RFC. The *only* command that requires HELO/EHLO is MAIL (and 
by implication RCPT, since it in turn requires MAIL).  See 
http://tools.ietf.org/html/rfc5321#section-4.1.4.

Sorry to keep bouncing this back.  I appreciate the work you are doing.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14354] Crash in _ctypes_alloc_callback

[Joe Rumsey]

Joe Rumsey  added the comment:

It's maybe not directly relevant to fixing this, but I worked around it on the 
project where this came up by redefining dice as (c_int * 4) and col as 
(c_uint8 * 3) in the union, then using ctypes.cast to get those as pointers to 
the actual struct.  That seems to work just fine for now.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Jason Killen  added the comment:

smtpd.py does not require HELO before NOOP or QUIT.  I added them to 
test_smtpd.py because I felt it made test_smtpd.py well written as opposed to 
doing the least the spec requires.  That said I suppose I should have added 
QUITs to every test also if that's the way I really feel.

I'll make the change and post a diff.

I don't mind this going back and forth.  It's my first time around and I'm glad 
I've been helpful.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Removed file: http://bugs.python.org/file24948/smtpd_nogo.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Removed file: http://bugs.python.org/file24826/smtpd_nogo.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Removed file: http://bugs.python.org/file24949/test_smtpd_nogo.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Added file: http://bugs.python.org/file24968/smtpd.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Removed file: http://bugs.python.org/file24968/smtpd.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Changes by Jason Killen :


Added file: http://bugs.python.org/file24969/smtpd.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14375] Add socketserver.running property

[Giampaolo Rodola']

New submission from Giampaolo Rodola' :

Patch in attachment adds a "running" property to figure out whether the server 
is running or not.

Also it raises an exception in case the server has already been started or 
stopped. IMO such an event should be prevented beforehand as it signals an 
application error.

Finally, __repr__ has been modified in order to reflect the current server 
status.

--
files: socketserver.patch
keywords: patch
messages: 156432
nosy: giampaolo.rodola, pitrou
priority: normal
severity: normal
stage: patch review
status: open
title: Add socketserver.running property
versions: Python 3.3
Added file: http://bugs.python.org/file24970/socketserver.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14249] unicodeobject.c: aliasing warnings

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

"(unsigned short)(long >> 32)" returns the 16 bits (32..48) if short is 16-bit. 
I agree that this variant is more strict and reliable (and this was my original 
version) and if you do not find it verbose and redundant, so be it. The 
difference will be noticeable only on a very exotic platform (with a 9-bit 
chars, for example), where the original code also will not work. Frankly, in 
this straightforward patch hacking is less than in the original code.

I made a mistake with the microbenchmark. In fact, acceleration is not 5%, but 
20-40%.

./python -m timeit -s 'import codecs; d = codecs.utf_16_be_decode; x = (" " * 
1000).encode("utf-16be")' 'd(x)'
./python -m timeit -s 'import codecs; d = codecs.utf_16_be_decode; x = 
("\u263A" * 1000).encode("utf-16be")' 'd(x)'

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Jason Killen  added the comment:

Ok I think this quote from the spec referenced pretty much sums it up. 

"The NOOP, HELP, EXPN, VRFY, and RSET commands can be used at any time   during 
a session, or without previously initializing a session.  SMTP   servers SHOULD 
process these normally (that is, not return a 503 code) even if no EHLO command 
has yet been received; clients SHOULD open a session with EHLO before sending 
these commands."

All in all either way fits the spec, choose your favorite.

--
Added file: http://bugs.python.org/file24971/test_smtpd.py

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14375] Add socketserver running property

[Giampaolo Rodola']

Changes by Giampaolo Rodola' :


--
title: Add socketserver.running property -> Add socketserver running property

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14375] Add socketserver running property

[Giampaolo Rodola']

Changes by Giampaolo Rodola' :


--
keywords: +needs review -patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[R. David Murray]

R. David Murray  added the comment:

If you mean "either way in the test", that's true.  But what we need to test is 
that the smtpd server we are providing matches the spec, which means that we 
need to confirm that it does *accept* QUIT, NOOP, etc without a previous HELO.  
Also testing that it accepts them after a HELO has been issued would be a bonus 
:)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

I am working on this. Should I add tests to test_zipfile.py or create new 
test_zipfile_bzip2.py?

It would add a note that the bzip2 compression can understand not all programs 
(and do not understand the older versions of Python), but understands the 
Info-Unzip? My English is not enough for the documentation.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9720] zipfile writes incorrect local file header for large files in zip64

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
nosy: +storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14302] Move python.exe to bin/

[Glenn Linderman]

Glenn Linderman  added the comment:

msg156410 sounds good to me... +1

If the conversion is optional in 3.3, that would seem to solve the problem; if 
BinaryDir is added, people can use that for 3.3; if people want to use software 
that hasn't migrated yet, they choose the default path of least resistance, 
leaving things where they are but with BinaryDir pointing there.

PATH manipulations would be simpler, being a single PATH entry, so tying that 
to choosing the non-default option seems practical.

This would allow people that don't need the compatibility with installers that 
don't understand the new structure, to continue to function, gives the 
installer people a test bed if they don't get things done by the time 3.3 
ships, gives people that prefer the consistency across platform structures the 
ability to have it, as long as they don't need the intsaller... in short, one 
question at install time could allow us to have our cake and eat it too!

Clearly the launcher may need some adjustments for this, but BinaryDir should 
suffice to help it do the right thing for both types of installation.

--
nosy: +v+python

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Jason Killen  added the comment:

Yes, "either way" in the test.  The server shouldn't expect them and the client 
can do it either way.

I'm adding a patch that tests with and without HELO for those commands that can 
be sent either way.

--
Added file: http://bugs.python.org/file24972/test_smtpd.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue11273] asyncore creates selec (or poll) on every iteration

[Giampaolo Rodola']

Giampaolo Rodola'  added the comment:

I agree it would be great to do this, in fact I'm using a modified version of 
asyncore supporting register(), unregister() and modify() methods for file 
descriptors, and the performance benefits are enormous.

On the other hand, it appears to be quite difficult to integrate such a massive 
change into asyncore in a fully backward compatible manner. At least, it's not 
clear to me how to do this without breaking code relying on map's parameter and 
asyncore.socket_map.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue13797] Allow objects implemented in pure Python to export PEP 3118 buffers

[Alex Gaynor]

Alex Gaynor  added the comment:

FWIW pypy has an __buffer__ method (used exclusively internally, AFAIK), which 
has semantics similar to your first proposal.

--
nosy: +alex

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[R. David Murray]

R. David Murray  added the comment:

I think we're close.

You new test 'test_HELO_RSET_syntax' should be named just 'test_HELO_RSET'.

And could you please add tests for RCPT and DATA generating the 'no HELO' error?

Thanks.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue9720] zipfile writes incorrect local file header for large files in zip64

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

I am afraid that the problem is more complicated. With the option 
allowZip64=True all files need to write with this extension, because size of 
local file header may change and there will be after compression just go back 
and rewrite it.

Now it appears that the Zip64 option simply does not work.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14269] SMTPD server does not enforce client starting mail transaction with HELO or EHLO

[Jason Killen]

Jason Killen  added the comment:

Removed '_syntax' apparently I fix that before but didn't regen the patch.

Added tests for noHELO before some commands to test that failures happen as 
expected.

--
Added file: http://bugs.python.org/file24973/test_smtpd.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14375] Add socketserver running property

[R. David Murray]

Changes by R. David Murray :


--
type:  -> enhancement

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14154] reimplement the bigmem test memory watchdog as a subprocess

[Charles-François Natali]

Charles-François Natali  added the comment:

Here's a patch flushing stdout explicitely (should not be necessay
unless the watchdog crashes, but...).
Also, redirect stderr to /dev/null.

--
Added file: http://bugs.python.org/file24974/mem_watchdog_2.diff

___
Python tracker 

___diff --git a/Lib/test/memory_watchdog.py b/Lib/test/memory_watchdog.py
new file mode 100644
--- /dev/null
+++ b/Lib/test/memory_watchdog.py
@@ -0,0 +1,28 @@
+"""Memory watchdog: periodically read the memory usage of the main test process
+and print it out, until terminated."""
+# stdin should refer to the process' /proc//statm: we don't pass the
+# process' PID to avoid a race condition in case of - unlikely - PID recycling.
+# If the process crashes, reading from the /proc entry will fail with ESRCH.
+
+
+import os
+import sys
+import time
+
+
+try:
+page_size = os.sysconf('SC_PAGESIZE')
+except (ValueError, AttributeError):
+try:
+page_size = os.sysconf('SC_PAGE_SIZE')
+except (ValueError, AttributeError):
+page_size = 4096
+
+while True:
+sys.stdin.seek(0)
+statm = sys.stdin.read()
+data = int(statm.split()[5])
+sys.stdout.write(" ... process data size: {data:.1f}G\n"
+ .format(data=data * page_size / (1024 ** 3)))
+sys.stdout.flush()
+time.sleep(1)
diff --git a/Lib/test/support.py b/Lib/test/support.py
--- a/Lib/test/support.py
+++ b/Lib/test/support.py
@@ -36,20 +36,10 @@
 multiprocessing = None
 
 try:
-import faulthandler
-except ImportError:
-faulthandler = None
-
-try:
 import zlib
 except ImportError:
 zlib = None
 
-try:
-import fcntl
-except ImportError:
-fcntl = None
-
 __all__ = [
 "Error", "TestFailed", "ResourceDenied", "import_module",
 "verbose", "use_resources", "max_memuse", "record_original_stdout",
@@ -1151,62 +1141,26 @@
 def __init__(self):
 self.procfile = '/proc/{pid}/statm'.format(pid=os.getpid())
 self.started = False
-self.thread = None
-try:
-self.page_size = os.sysconf('SC_PAGESIZE')
-except (ValueError, AttributeError):
-try:
-self.page_size = os.sysconf('SC_PAGE_SIZE')
-except (ValueError, AttributeError):
-self.page_size = 4096
-
-def consumer(self, fd):
-HEADER = "l"
-header_size = struct.calcsize(HEADER)
-try:
-while True:
-header = os.read(fd, header_size)
-if len(header) < header_size:
-# Pipe closed on other end
-break
-data_len, = struct.unpack(HEADER, header)
-data = os.read(fd, data_len)
-statm = data.decode('ascii')
-data = int(statm.split()[5])
-print(" ... process data size: {data:.1f}G"
-   .format(data=data * self.page_size / (1024 ** 3)))
-finally:
-os.close(fd)
 
 def start(self):
-if not faulthandler or not hasattr(faulthandler, '_file_watchdog'):
-return
 try:
-rfd = os.open(self.procfile, os.O_RDONLY)
+f = open(self.procfile, 'r')
 except OSError as e:
 warnings.warn('/proc not available for stats: {}'.format(e),
   RuntimeWarning)
 sys.stderr.flush()
 return
-pipe_fd, wfd = os.pipe()
-# set the write end of the pipe non-blocking to avoid blocking the
-# watchdog thread when the consumer doesn't drain the pipe fast enough
-if fcntl:
-flags = fcntl.fcntl(wfd, fcntl.F_GETFL)
-fcntl.fcntl(wfd, fcntl.F_SETFL, flags|os.O_NONBLOCK)
-# _file_watchdog() doesn't take the GIL in its child thread, and
-# therefore collects statistics timely
-faulthandler._file_watchdog(rfd, wfd, 1.0)
+
+watchdog_script = findfile("memory_watchdog.py")
+self.mem_watchdog = subprocess.Popen([sys.executable, watchdog_script],
+ stdin=f, 
stderr=subprocess.DEVNULL)
+f.close()
 self.started = True
-self.thread = threading.Thread(target=self.consumer, args=(pipe_fd,))
-self.thread.daemon = True
-self.thread.start()
 
 def stop(self):
-if not self.started:
-return
-faulthandler._cancel_file_watchdog()
-self.thread.join()
+if self.started:
+self.mem_watchdog.terminate()
+self.mem_watchdog.wait()
 
 
 def bigmemtest(size, memuse, dry_run=True):
@@ -1234,7 +1188,7 @@
 "not enough memory: %.1fG minimum needed"
 % (size * memuse / (1024 ** 3)))
 
-if real_max_memuse and verbose and faulthandler and threading:
+if real_max_memuse an

[issue14373] C implementation of functools.lru_cache

[Giampaolo Rodola']

Changes by Giampaolo Rodola' :


--
nosy: +giampaolo.rodola

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14371] Add support for bzip2 compression to the zipfile module

[Martin v . Löwis]

Martin v. Löwis  added the comment:

Please add it to test_zipfile.

As for the documentation, I propose the wording

"bzip2 compression was added to the zip file format in 2001. However, even more 
recent tools (including older Python releases) may not support it, causing 
either refusal to process the zip file altogether, or faiilure to extract 
individual files."

I'm not a native speaker of English, either. Feel free to put things through 
Google translate; some native speaker will pick up the text and correct it.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14229] On KeyboardInterrupt, the exit code should mirror the signal number

[Charles-François Natali]

Charles-François Natali  added the comment:

I agree with Martin: we really do handle the signal, and as such, the
only way to convey the relevant information to the parent as to which
signal caused the exit would be to re-raise it, which is really ugly
and probably not a good idea.

Processes that want default behavior upon signal reception (so that
they can use WEXITSTATUS(), WCOREDUMP() and friends) can always use
SIG_DFL:

$ python -c "import subprocess, signal, time; p =
subprocess.Popen(['python', '-c', 'import signal;
signal.signal(signal.SIGINT, signal.SIG_DFL); input()']);
time.sleep(1); p.send_signal(signal.SIGINT); print(p.wait())"
-2

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14229] On KeyboardInterrupt, the exit code should mirror the signal number

[Antoine Pitrou]

Antoine Pitrou  added the comment:

> I agree with Martin: we really do handle the signal, and as such, the
> only way to convey the relevant information to the parent as to which
> signal caused the exit would be to re-raise it, which is really ugly
> and probably not a good idea.

Why would it be ugly? faulthandler does exactly that.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14370] list.extend() called on an iterator of the list itself leads to an infinite loop

[Raymond Hettinger]

Raymond Hettinger  added the comment:

This a feature, not a bug.  Lists are allowed to mutate during iteration and 
there are valid use cases for doing so (adding pending tasks, etc.)  


# Demonstrate list mutation during iteration
# Infinite loop that overflows memory
s = [None]
for x in s:
   s.append(x)

--
nosy: +rhettinger
resolution:  -> invalid
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14373] C implementation of functools.lru_cache

[Raymond Hettinger]

Raymond Hettinger  added the comment:

Thank you for working on this.  I look forward to reviewing it.

--
assignee:  -> rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10576] Add a progress callback to gcmodule

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

Hi!
Michael Foord reminded me of this little gem.  I'm getting this started again, 
hopefully for inclusion in 3.3

--
nosy: +michael.foord

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14374] Compiling Python 2.7.2 on HP11i PA-RISC ends with segmentation fault in Python executable

[donchen]

donchen  added the comment:

Taking away -O options in makefile still generates the crash. I have attached 
the stack below.

Can you inform me what python executable is doing at this time? From the make I 
see it is linking python so why would it be running?

Thanks

$ gdb python core
HP gdb 5.7 for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00
and target hppa1.1-hp-hpux11.00.
Copyright 1986 - 2001 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 5.7 (based on GDB) is covered by the
GNU General Public License. Type "show copying" to see the conditions to
change it and/or distribute copies. Type "show warranty" for warranty/support.
..
Core was generated by `python'.
Program terminated with signal 10, Bus error.

#0  0x12c674 in sre_match (state=0x4010b4f0, pattern=0x0)
at ./Modules/_sre.c:846
846 switch (*ctx->pattern++) {
(gdb) where
#0  0x12c674 in sre_match (state=0x4010b4f0, pattern=0x0)
at ./Modules/_sre.c:846
#1  0x13023c in pattern_match (self=0xaad83cc4, args=0xaad83cc4, kw=0x4013ac25)
at ./Modules/_sre.c:1888
#2  0xa87d0 in PyCFunction_Call (func=0x40105c00, arg=0x4018a2bc,
kw=0x4013acd1) at Objects/methodobject.c:85
#3  0x5274c in call_function (pp_stack=0x4014de90, oparg=1074097960)
at Python/ceval.c:4013
#4  0x4fb9c in PyEval_EvalFrameEx (f=0x4018a128, throwflag=0)
at Python/ceval.c:2666
#5  0x50d30 in PyEval_EvalCodeEx (co=0x401486f0, globals=0x0,
locals=0x40056f28, args=0x401481fc, argcount=2, kws=0x401486bc, kwcount=0,
defs=0x40109d5c, defcount=1, closure=0x0) at Python/ceval.c:3253
#6  0x52974 in fast_function (func=0x0, pp_stack=0x40148398, n=384,
na=1074152536, nk=0) at Python/ceval.c:4109
#7  0x52824 in call_function (pp_stack=0x0, oparg=0) at Python/ceval.c:4034
#8  0x4fb9c in PyEval_EvalFrameEx (f=0x40148560, throwflag=0)
at Python/ceval.c:2666
#9  0x52a94 in fast_function (func=0x0, pp_stack=0x40148390, n=1075032760,
na=1075086160, nk=0) at Python/ceval.c:4099
#10 0x52824 in call_function (pp_stack=0x4010c260, oparg=1074650600)
at Python/ceval.c:4034
#11 0x4fb9c in PyEval_EvalFrameEx (f=0x40148218, throwflag=0)
at Python/ceval.c:2666
#12 0x50d30 in PyEval_EvalCodeEx (co=0x40068530, globals=0x40014258,
locals=0x8, args=0x401424b4, argcount=0, kws=0x401481f0, kwcount=0,
defs=0x0, defcount=0, closure=0x0) at Python/ceval.c:3253
#13 0x52974 in fast_function (func=0x785d4ea0, pp_stack=0x785cc6e0, n=344,
na=1074152536, nk=0) at Python/ceval.c:4109
#14 0x52824 in call_function (pp_stack=0x0, oparg=1075062292)
at Python/ceval.c:4034
#15 0x4fb9c in PyEval_EvalFrameEx (f=0x401480b0, throwflag=0)
at Python/ceval.c:2666
#16 0x52a94 in fast_function (func=0x785d4ea0, pp_stack=0x0, n=344,
na=1074152536, nk=0) at Python/ceval.c:4099
#17 0x52824 in call_function (pp_stack=0x4, oparg=1074364576)
at Python/ceval.c:4034
#18 0x4fb9c in PyEval_EvalFrameEx (f=0x401424d0, throwflag=0)
at Python/ceval.c:2666
#19 0x52a94 in fast_function (func=0x785d4ea0, pp_stack=0x, n=364,
na=1074152536, nk=0) at Python/ceval.c:4099
---Type  to continue, or q  to quit---
#20 0x52824 in call_function (pp_stack=0x0, oparg=1075028952)
at Python/ceval.c:4034
#21 0x4fb9c in PyEval_EvalFrameEx (f=0x40147f30, throwflag=0)
at Python/ceval.c:2666
#22 0x52a94 in fast_function (func=0x785d4ea0, pp_stack=0x4013a3d8, n=356,
na=1074152536, nk=0) at Python/ceval.c:4099
#23 0x52824 in call_function (pp_stack=0x4, oparg=1074364576)
at Python/ceval.c:4034
#24 0x4fb9c in PyEval_EvalFrameEx (f=0x4013a830, throwflag=0)
at Python/ceval.c:2666
#25 0x52a94 in fast_function (func=0x1208e051, pp_stack=0xc941ef15,
n=1074568539, na=1074898960, nk=0) at Python/ceval.c:4099
#26 0x52824 in call_function (pp_stack=0x40137970, oparg=1073899304)
at Python/ceval.c:4034
#27 0x4fb9c in PyEval_EvalFrameEx (f=0x4011a6d8, throwflag=0)
at Python/ceval.c:2666
#28 0x52a94 in fast_function (func=0x0, pp_stack=0x400c2148, n=1074565502,
na=1074536776, nk=0) at Python/ceval.c:4099
#29 0x52824 in call_function (pp_stack=0x4, oparg=1074364896)
at Python/ceval.c:4034
#30 0x4fb9c in PyEval_EvalFrameEx (f=0x400c2010, throwflag=0)
at Python/ceval.c:2666
#31 0x50d30 in PyEval_EvalCodeEx (co=0x14, globals=0x0, locals=0x4867e2c0,
args=0x4000f144, argcount=0, kws=0x0, kwcount=0, defs=0x0, defcount=0,
closure=0x0) at Python/ceval.c:3253
#32 0x4c04c in PyEval_EvalCode (co=0x785c3dfe, globals=0x0, locals=0x785d4d40)
at Python/ceval.c:667
#33 0x636ec in PyImport_ExecCodeModuleEx (name=0x785cb460 "", co=0xeccd053d,
pathname=0x400242a8 "@\bP") at Python/import.c:681
#34 0x63fa0 in load_source_module (
name=0x400101d8 " Do not enter it in sys.modules.\nThe module name must 
include the full package name, if any.", pathname=0x785e0f48 "", fp=0x785e0f44)
at Python/import.c:1021
#35 0x64e80 in load_module (name=0x0, fp=0x0, pathname=0x0, type=0, loader=0x0)
at Python/import.c:1825
#36 0x66388 in import_subm

[issue14369] make __closure__ writable

[Andrew Svetlov]

Changes by Andrew Svetlov :


--
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14369] make __closure__ writable

[Andrew Svetlov]

Changes by Andrew Svetlov :


--
nosy: +benjamin.peterson

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10576] Add a progress callback to gcmodule

[Kristján Valur Jónsson]

Kristján Valur Jónsson  added the comment:

Hm, actually it wasn't Michael, but Martin. No matter!  Here is a proposed 
patch, as promised without all the bells and whistles, in particular, there is 
no feature to cancel the garbage collection.

Can we get this into 3.3?

--
Added file: http://bugs.python.org/file24976/gccallback4.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14369] make __closure__ writable

[Yury Selivanov]

Yury Selivanov  added the comment:

Updated patch per Benjamin's review. See writable_closure_04.patch.

--
Added file: http://bugs.python.org/file24975/writable_closure_04.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14328] Add keyword-only parameter support to PyArg_ParseTupleAndKeywords

[Roundup Robot]

Roundup Robot  added the comment:

New changeset 052779d34945 by Larry Hastings in branch 'default':
Issue #14328: Add keyword-only parameters to PyArg_ParseTupleAndKeywords.
http://hg.python.org/cpython/rev/052779d34945

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14328] Add keyword-only parameter support to PyArg_ParseTupleAndKeywords

[Larry Hastings]

Changes by Larry Hastings :


--
keywords:  -patch
resolution:  -> fixed
stage: patch review -> committed/rejected
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com