Re: [gdal-dev] GDAL + Docker with NFS

2018-03-18 Thread Even Rouault
On dimanche 18 mars 2018 08:32:49 CET Andrew C Aitchison wrote: > On Sun, 18 Mar 2018, Ouwen Huang wrote: > > I feel quite silly, but it seems that the `gdal.Open` was actually opening > > the file from the docker mounted NFS, just very slowly. I left it to run > > for 2 minutes or so and it return

Re: [gdal-dev] GDAL + Docker with NFS

2018-03-18 Thread Andrew C Aitchison
On Sun, 18 Mar 2018, Ouwen Huang wrote: I feel quite silly, but it seems that the `gdal.Open` was actually opening the file from the docker mounted NFS, just very slowly. I left it to run for 2 minutes or so and it returned. But this is weird behavior because on the host a `*Dataset` was return

Re: [gdal-dev] GDAL + Docker with NFS

2018-03-18 Thread Michael Smith
We haven’t had that behavior, we use gdal.Open on many large files inside docker and this isn’t an issue we’ve had. We haven’t specifically used EFS, we use NFS and an S3 fuse layer with docker and have had very good performance with the python bindings. Note that we haven’t used privileged mo

Re: [gdal-dev] GDAL + Docker with NFS

2018-03-18 Thread Ouwen Huang
I feel quite silly, but it seems that the `gdal.Open` was actually opening the file from the docker mounted NFS, just very slowly. I left it to run for 2 minutes or so and it returned. But this is weird behavior because on the host a `*Dataset` was returned instantly, and within the docker contain

Re: [gdal-dev] GDAL + Docker with NFS

2018-03-17 Thread Ouwen Huang
Hey Michael, Thanks for the quick response, I've been bashing my head against this for a while. Unfortunately restarting the docker daemon did not work for me. I can access the EFS from within docker using regular unix commands like `cp`, and `cat`, even with GDAL `VSIFOpenL` and `VSIFReadL`. Howe

Re: [gdal-dev] GDAL + Docker with NFS

2018-03-17 Thread Michael Smith
Have you restarted the docker daemon after mounting the EFS drive to the local OS? If not, do that and then map the volume with -v. That worked for me. Michael Smith Remote Sensing/GIS Center US Army Corps of Engineers > On Mar 18, 2018, at 7:15 AM, Ouwen Huang wrote: > > Hello, > > I am hav

[gdal-dev] GDAL + Docker with NFS

2018-03-17 Thread Ouwen Huang
Hello, I am having some trouble loading a GeoTiff into GDAL from a docker container that is mounting a NFS (specifically amazon EFS). When mounting a volume with the `docker -v` command or mounting the NFS directly into docker under `--privileged` mode. The `gdal.Open` command hangs. I am able to