Well, 16k hits per month is like 20 per hour. Doesn’t seem like much load. I guess the biggest issue is how much of 200TB do you need on fastest storage. Blob storage charges for 200TB is like $200/month plus transfer charges. If you have to have it all live on fast storage then cloud probably is not possible.
Gregory Turner Chief Architect ________________________________________ i4 Insight, Inc. cell: +1.720.335.1744 [email protected]<mailto:[email protected]> A member of the Lloyd’s Register Group From: Vera Green <[email protected]> Sent: Thursday, May 7, 2020 4:45 PM To: Greg Turner <[email protected]> Cc: Samy Otero <[email protected]>; GeoServer Mailing List List <[email protected]> Subject: Re: [Geoserver-users] Server for GeoServer Thanks for those details. Much appreciated. Yeah we are getting to the conclusion that cloud hosting will be cost prohibitive. Vera On Thu, May 7, 2020 at 4:21 PM Greg Turner <[email protected]<mailto:[email protected]>> wrote: I am using specific VM size on azure as follows: [cid:[email protected]] As you can see it can scale up or down and then you can use Availability sets to scale out with multiple VMs. The huge benefit of this type of VM is dedicated storage and large RAM. The dedicated NVME storage gives fastest disk access just like it was on desktop and goes up in TBs size. It is quite fast and with Geoserver experts with right caching enabled make it very fast for Geoserver. I am currently serving about 2TB of data and adding 500GB per month. You can set up tiers of storage so that older/less used data runs on slower storage units like disk drives or even from a Data Lake or blob storage so then amount of data does not matter. Gregory Turner Chief Architect ________________________________________ i4 Insight, Inc. cell: +1.720.335.1744 [email protected]<mailto:[email protected]> A member of the Lloyd’s Register Group From: Samy Otero <[email protected]<mailto:[email protected]>> Sent: Thursday, May 7, 2020 1:16 PM To: Vera Green <[email protected]<mailto:[email protected]>> Cc: GeoServer Mailing List List <[email protected]<mailto:[email protected]>> Subject: Re: [Geoserver-users] Server for GeoServer Hi Vera, You can dockerize the geoserver and add a load balancer, so basically it will spin up and shut down containers based on traffic. Kubernetes it is something to look at. Cheers On Thu, May 7, 2020, 3:05 PM Vera Green <[email protected]<mailto:[email protected]>> wrote: Hello, We are putting together a project plan for hosting a large amount of raster data and serving it out as a WMS service through GeoServer. We have been working with GeoServer for several years primarily with vector data so we are generally familiar and have a proof of concept but now we need to scale our system which is 150 GB in the cloud to 200 TB on a physical server. We have metrics from one of our clients which are, for 10TB of data, an average of 16,000 hits a month and average of 40 GB of bandwidth, which would also need to be scaled up. Our expected top bracket for raw imagery is 200 TB. We also have some metrics from our existing server which tell us that if we don't do this correctly it will fail horribly :-). So, if anyone has ideas/information to share about how to build a server for this that would be greatly appreciated. I am looking for specific details regarding information to provide to the server administrator whom will be an individual experienced with setting up servers such as a managed service at a data center, but will not have GeoServer specific knowledge. I am also wondering if this is something Geo Solutions supports through their subscriptions. Kind Regards, Vera _______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/ - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer [email protected]<mailto:[email protected]> https://lists.sourceforge.net/lists/listinfo/geoserver-users
_______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/ - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer [email protected] https://lists.sourceforge.net/lists/listinfo/geoserver-users
