[issue11212] Python memory limit on AIX

Change by Mark Lawrence : -- nosy: -BreamoreBoy ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail

[issue11212] Python memory limit on AIX

David Edelsohn added the comment: Setting the environment variable LDR_CNTRL is discouraged. It is much better to set the value in the executable header. Best to set it at link time, but one can use ldedit. The issue with the segments in 32 bit mode is a trade off between heap memory and shm

[issue11212] Python memory limit on AIX

Mark Lawrence added the comment: @David (Edelsohn) what is your take on this? -- nosy: +BreamoreBoy, David.Edelsohn versions: +Python 3.4, Python 3.5 -Python 2.6, Python 3.1, Python 3.2 ___ Python tracker _

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: I updated the documentation in issue 10709 so that it mentions ldedit rather than the linker flags (more convenient to activate support for more memory). Once Python 3.2 is released, we may add LDR_CNTRL or ldedit in the Makefile when running buildbottest.

[issue11212] Python memory limit on AIX

Antoine Pitrou added the comment: > I think people may be more interested in setting permanently the > maximum memory that can be allocated by python rather than using an > environment variable that may be lost and which impacts all the > applications. Agreed, but it's impossible to standardize

[issue11212] Python memory limit on AIX

Changes by R. David Murray : Removed file: http://bugs.python.org/file20776/aix-notes.patch ___ Python tracker ___ ___ Python-bugs-list mailin

[issue11212] Python memory limit on AIX

R. David Murray added the comment: oops. -- ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: The doc would become: """ To allocate more segment registers to Python, you must use the linker option -bmaxdata or ldedit to specify the number of bytes you need in the data segment. For example, if you want to allow 512MB of memory for Python (this is en

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: The AIX documentation says: http://publib.boulder.ibm.com/infocenter/tivihelp/v2r1/index.jsp?topic=/com.ibm.itame3.doc_5.1/am51_perftune113.htm """It is a good idea to unset the LDR_CNTRL environment variable, so that it does not unintentionally affect other p

[issue11212] Python memory limit on AIX

Antoine Pitrou added the comment: David, I think you attached your patch to the wrong issue. Sébastien, according to the IBM docs, the memory limit can be changed using the LDR_CNTRL variable, so running the test suite shouldn't need special linker flags, or? (also, wouldn't it be simpler to

[issue11212] Python memory limit on AIX

R. David Murray added the comment: Here is a proofread diff. I did make one substantive change: I added a comment about the test suite not running with the default maxdata and not raising memory errors with 512MB. Is that correct? -- nosy: +r.david.murray Added file: http://bugs.pyt

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: I don't know distutils well enough, but I am afraid the LDFLAGS flag used to compile python is reused in some way when linking some python extensions or some application that embed python. (I use an application that embed python on AIX, I should check what ha

[issue11212] Python memory limit on AIX

Antoine Pitrou added the comment: > LDFLAGS will apply it to all the shared libraries which is not really > what we want. Is there a downside? -- ___ Python tracker ___ ___

[issue11212] Python memory limit on AIX

Changes by Sébastien Sablé : -- versions: +Python 2.6, Python 2.7, Python 3.1 ___ Python tracker ___ ___ Python-bugs-list mailing list

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: This link flag should only be applied to the python executable. There is already LINKFORSHARED which is great for that. LDFLAGS will apply it to all the shared libraries which is not really what we want. I can compile Python with support for 512MB without any

[issue11212] Python memory limit on AIX

Antoine Pitrou added the comment: > We could change the option to become: > --with-aix-maxdata=value > where value could be between 0 and 8, with a default at 0 (nothing > passed to the compiler). Doesn't LDFLAGS work for that? I don't think we want a lot of platform-specific options like that.

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: Yes, welcome into the strange world of AIX... You can allow up to 8 segments, which represent 2GB: http://publib.boulder.ibm.com/infocenter/tivihelp/v2r1/index.jsp?topic=/com.ibm.itame3.doc_5.1/am51_perftune113.htm We could change the option to become: --with

[issue11212] Python memory limit on AIX

Antoine Pitrou added the comment: I don't see why we would provide an option to replace a magic number with another magic number. I find it strange that AIX doesn't simply enable unbounded virtual address spaces. (by "unbounded" I mean "bounded by CPU limitations only") -- nosy: +pitr

[issue11212] Python memory limit on AIX

Sébastien Sablé added the comment: Here is a patch that would provide an --enable-aix-maxdata option to configure, in order to support 512MB of mermory. I have not tested it yet. -- keywords: +patch Added file: http://bugs.python.org/file20761/patch_maxdata.diff _

[issue11212] Python memory limit on AIX

New submission from Sébastien Sablé : On AIX, executables are compiled by default so that they cannot allocate more than 256MB of memory. This is not enough in some cases; for example this is not enough to get the Python test suite to run completely. As explained in IBM documentation: By def