David,
      zip format files for 32bit WindowsXP maxes out at 4GB.  You can
create larger zip files on Vista.  I'm wildly  guessing that you are
running into the 4GB limit as well on reading your zip files with .  7zip,
http://www.7-zip.org/,   might be able to handle zip format  files larger
than 4GB.  If that doesn't work, see if you can switch to gzip format.
Gzip works just fine with files larger than 4 GB on 32 bit Windows systems.

Doug

Doug Newcomb
USFWS
Raleigh, NC
919-856-4520 ext. 14 doug_newc...@fws.gov
---------------------------------------------------------------------------------------------------------

The opinions I express are my own and are not representative of the
official policy of the U.S.Fish and Wildlife Service or Dept. of the
Interior.   Life is too short for undocumented, proprietary data formats.


                                                                       
             Roger André                                             
             <ran...@gmail.com                                         
             >                                                          To
             Sent by:                  David Shi <davidg...@yahoo.co.uk>
             gdal-dev-bounces@                                          cc
             lists.osgeo.org           gdal-dev@lists.osgeo.org        
                                                                   Subject
                                       Re: [gdal-dev] Shortening execution
             09/19/2009 01:16          time of Python script           
             AM                                                        
                                                                       
                                                                       
                                                                       
                                                                       
                                                                       




So the problem is that ArcGIS Server is expecting the data to be ready
(unzipped), but due to the large size of the data set, the unzip has not
finished?

Roger
--

On Wed, Sep 9, 2009 at 3:54 AM, David Shi <davidg...@yahoo.co.uk> wrote:
                                                                       
 I have a Python script that automatically downloads zip files containing
 large datasets from another server and then unzips the files to further
 process the data.                                                     
                                                                       
 It has been used as a geoprocessor of ArcGIS Server.                  
                                                                       
 The script works fine when two datasets each has several kilobytes size,
 but the script stops half way when datasets were about 11,000KBytes.  
                                                                       
 I think that the execution time is too long and ArcGIS Server just simply
 killed the process.                                                   
                                                                       
 What actions can I try to reduce the execution time?                  
                                                                       
 ArcGIS Server only works on the basis of 32 bits and I was told that the
 maximum memory it can utilise is 4 MBytes.                            
                                                                       
 I should be grateful if someone can make suggestions/recommendations. 
                                                                       
 Sincerely,                                                            
                                                                       
 David                                                                 
                                                                       



  _______________________________________________
  gdal-dev mailing list
  gdal-dev@lists.osgeo.org
  http://lists.osgeo.org/mailman/listinfo/gdal-dev
_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/gdal-dev

<<inline: graycol.gif>>

<<inline: pic28703.gif>>

<<inline: ecblank.gif>>

_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/gdal-dev

Reply via email to