Memory Problems in Windows 2003 Server

2007-10-12 Thread amdescombes
Hi,

I am using Python 2.5.1
I have an application that reads a file and generates a key in a 
dictionary for each line it reads. I have managed to read a 1GB file and 
generate more than 8 million keys on an Windows XP machine with only 1GB 
of memory and all works as expected. When I use the same program on a 
Windows 2003 Server with 2GB of RAM I start getting MemoryError exceptions!
I have tried setting the IMAGE_FILE_LARGE_ADDRESS_AWARE on both 
Python.exe and Python25.dll and setting the /3GB flag on the boot.ini 
file to no avail. I still get the MemoryError exceptions.

Has anybody encountered this problem before?

Thanks in advance for any ideas/suggestions.

Best Regards,

André M. Descombes
-- 
http://mail.python.org/mailman/listinfo/python-list


Re: Memory Problems in Windows 2003 Server

2007-10-15 Thread amdescombes
Yes, I think that might be the issue, perhaps I could implement the 
solution using several dictionaries instead of just one.
Are there any classes that implement disk based dictionaries?

Thanks,

Andre

> 
> I don't know whether Python dictionaries must live in a contiguous piece of
> memory, but if so, that could be the issue.  The system DLLs in Server 2003
> have been "rebased" in such a way that they chop up the virtual address
> space more than XP.  Even though there is more virtual memory available, it
> is fragmented.
-- 
http://mail.python.org/mailman/listinfo/python-list