Re: Using Solr Spatial in conjunction with HBASE/Hadoop

2013-01-22 Thread oakstream
Hi Otis, Yes, My data is in HBASE and I just need a fast Spatial Index where I can do lookups and then take the ID's back to HBASE to retrieve the results. HBASE doesn't support polygon searches that I'm aware of. You can do bounding box queries but that doesn't meet my requirements. I thought a

Re: Using Solr Spatial in conjunction with HBASE/Hadoop

2013-01-21 Thread oakstream
David, I appreciate your time. I'm going to take a crack at the Lucene sharded index approach and will let you know how I fare. Thanks again -- View this message in context: http://lucene.472066.n3.nabble.com/Using-Solr-Spatial-in-conjunction-with-HBASE-Hadoop-tp4034307p4035211.html Sent from

Re: Using Solr Spatial in conjunction with HBASE/Hadoop

2013-01-18 Thread oakstream
Thanks guys! David, In general and in your opinion would Lucene Spatial be the way to go to index hundreds of terabytes of spatial data that continually grows. Mostly point data, mostly structured, however, could be polygons. The searches would be within or contains in a polygon. Do you have a

Re: Using Solr Spatial in conjunction with HBASE/Hadoop

2013-01-17 Thread oakstream
Thanks for your response! I appreciate it. There will be cases where I want to "AND or OR" the query between HBASE and Lucene. Would it make sense to custom code querying both repositories at the same time or sequentiallyOr are there any tools out there to do this? Basically I'm thinking

Using Solr Spatial in conjunction with HBASE/Hadoop

2013-01-17 Thread oakstream
Hello, I have point data (lat/lon) stored in hbase/hadoop and would like to query the data spatially with polygons. (If I pass in a few polygons find me all the records that exist within these polygons. I need it to support polygons not just box queries). Hadoop doesn't really have much support