Re: solr as nosql - pulling all docs vs deep paging limitations

On Wed, Dec 18, 2013 at 8:03 PM, Chris Hostetter wrote: > : > : What about SELECT * FROM WHERE ... like misusing Solr? I'm sure you've > been > : asked many times for that. > : What if client don't need to rank results somehow, but just requesting > : unordered filtering result like they are used

Re: solr as nosql - pulling all docs vs deep paging limitations

: One question that I was never sure about when trying to do things like this -- : is this going to end up blowing the query and/or document caches if used on a : live Solr? By filling up those caches with the results of the 'bulk' export? : If so, is there any way to avoid that? Or does it proba

Re: solr as nosql - pulling all docs vs deep paging limitations

On 12/17/13 1:16 PM, Chris Hostetter wrote: As i mentioned in the blog above, as long as you have a uniqueKey field that supports range queries, bulk exporting of all documents is fairly trivial by sorting on your uniqueKey field and using an fq that also filters on your uniqueKey field modify th

Re: solr as nosql - pulling all docs vs deep paging limitations

Us too. That's going to be huge for us! Michael Della Bitta Applications Developer o: +1 646 532 3062 | c: +1 917 477 7906 appinions inc. "The Science of Influence Marketing" 18 East 41st Street New York, NY 10017 t: @appinions | g+: plus.google.com/appinion

Re: solr as nosql - pulling all docs vs deep paging limitations

: You can do range queries without an upper bound and just limit the number of : results. Then you look at the last result to obtain the new lower bound. exactly. instead of this: First: q=foo&start=0&rows=$ROWS After: q=foo&start=$X&rows=$ROWS ...where $ROWS is how big a batch of docsy

Re: solr as nosql - pulling all docs vs deep paging limitations

: : What about SELECT * FROM WHERE ... like misusing Solr? I'm sure you've been : asked many times for that. : What if client don't need to rank results somehow, but just requesting : unordered filtering result like they are used to in RDBMS? : Do you feel it will never considered as a resonable u

Re: solr as nosql - pulling all docs vs deep paging limitations

Aha! SOLR-5244 is a particular case which I'm asking about. I wonder who else consider it useful? (I.m sorry if I hijacked the thread) 18.12.2013 5:41 пользователь "Joel Bernstein" написал: > They are for different use cases. Hoss's approach, I believe, focuses on > deep paging of ranked search r

Re: solr as nosql - pulling all docs vs deep paging limitations

er of products (which may or may not be acceptable and I might be able to kind of hide that with some code). -Original Message- From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] Sent: Tuesday, December 17, 2013 10:41 AM To: solr-user Subject: Re: solr as nosql - pulling all do

Re: solr as nosql - pulling all docs vs deep paging limitations

They are for different use cases. Hoss's approach, I believe, focuses on deep paging of ranked search results. SOLR-5244 focuses on the batch export of an entire unranked search result in binary format. It's basically a very efficient bulk extract for Solr. On Tue, Dec 17, 2013 at 6:51 PM, Otis G

Re: solr as nosql - pulling all docs vs deep paging limitations

Joel - can you please elaborate a bit on how this compares with Hoss' approach? Complementary? Thanks, Otis -- Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ On Tue, Dec 17, 2013 at 6:45 PM, Joel Bernstein wrote: > SOLR-5244 is al

Re: solr as nosql - pulling all docs vs deep paging limitations

SOLR-5244 is also working in this direction. This focuses on efficient binary extract of entire search results. On Tue, Dec 17, 2013 at 2:33 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > Hoss is working on it. Search for deep paging or cursor in JIRA. > > Otis > Solr & ElasticSearc

Re: solr as nosql - pulling all docs vs deep paging limitations

Hoss, What about SELECT * FROM WHERE ... like misusing Solr? I'm sure you've been asked many times for that. What if client don't need to rank results somehow, but just requesting unordered filtering result like they are used to in RDBMS? Do you feel it will never considered as a resonable usecase

RE: solr as nosql - pulling all docs vs deep paging limitations

esday, December 17, 2013 10:41 AM To: solr-user Subject: Re: solr as nosql - pulling all docs vs deep paging limitations Hoss, What about SELECT * FROM WHERE ... like misusing Solr? I'm sure you've been asked many times for that. What if client don't need to rank results somehow,

Re: solr as nosql - pulling all docs vs deep paging limitations

Hoss is working on it. Search for deep paging or cursor in JIRA. Otis Solr & ElasticSearch Support http://sematext.com/ On Dec 17, 2013 12:30 PM, "Petersen, Robert" < robert.peter...@mail.rakuten.com> wrote: > Hi solr users, > > We have a new use case where need to make a pile of data available a

Re: solr as nosql - pulling all docs vs deep paging limitations

: Then I remembered we currently don't allow deep paging in our current : search indexes as performance declines the deeper you go. Is this still : the case? Coincidently, i'm working on a new cursor based API to make this much more feasible as we speak.. https://issues.apache.org/jira/brows

solr as nosql - pulling all docs vs deep paging limitations

Hi solr users, We have a new use case where need to make a pile of data available as XML to a client and I was thinking we could easily put all this data into a solr collection and the client could just do a star search and page through all the results to obtain the data we need to give them.