Re: querying using filter query and lots of possible values

2012-07-28 Thread Daniel Brügge
Hi, thanks for this hint. Will check this out. Sounds promising. Daniel On Sat, Jul 28, 2012 at 3:18 AM, Chris Hostetter wrote: > > : the list of IDs is constant for a longer time. I will take a look at > : these join thematic. > : Maybe another solution would be to really create a whole new >

Re: querying using filter query and lots of possible values

2012-07-27 Thread Chris Hostetter
: the list of IDs is constant for a longer time. I will take a look at : these join thematic. : Maybe another solution would be to really create a whole new : collection or set of documents containing the aggregated documents (from the : ids) from scratch and to execute queries on this collection.

Re: querying using filter query and lots of possible values

2012-07-26 Thread Daniel Brügge
Exactly. Creating a new index from the aggregated documents is the plan I described above. I don't really now, how long this will take for each new index. Hopefully under 1 hour or so. That would be tolerable. Thanks. Daniel On Thu, Jul 26, 2012 at 8:47 PM, Chantal Ackermann < c.ackerm...@it-agen

Re: querying using filter query and lots of possible values

2012-07-26 Thread Chantal Ackermann
Hi Daniel, depending on how you decide on the list of ids, in the first place, you could also create a new index (core) and populate it with DIH which would select only documents from your main index (core) in this range of ids. When updating you could try a delta import. Of course, this is on

Re: querying using filter query and lots of possible values

2012-07-26 Thread Daniel Brügge
Thanks Alexandre, the list of IDs is constant for a longer time. I will take a look at these join thematic. Maybe another solution would be to really create a whole new collection or set of documents containing the aggregated documents (from the ids) from scratch and to execute queries on this col

Re: querying using filter query and lots of possible values

2012-07-26 Thread Alexandre Rafalovitch
You can't update the original documents except by reindexing them, so no easy group assigment option. If you create this 'collection' once but query it multiple times, you may be able to use SOLR4 join with IDs being stored separately and joined on. Still not great because the performance is an is

Re: querying using filter query and lots of possible values

2012-07-26 Thread Daniel Brügge
Hey Chantal, thanks for your answer. The range queries would not work, because they are not values in a row. They can be randomly ordered with gaps. Above was just an example. Excluding is also not a solution, because the list of excluded id would be even longer. To specify it even more. The ID

Re: querying using filter query and lots of possible values

2012-07-26 Thread Chantal Ackermann
Hi Daniel, index the id into a field of type tint or tlong and use a range query (http://wiki.apache.org/solr/SolrQuerySyntax?highlight=%28rangequery%29): fq=id:[200 TO 2000] If you want to exclude certain ids it might be wiser to simply add an exclusion query in addition to the range query in

querying using filter query and lots of possible values

2012-07-26 Thread Daniel Brügge
Hi, i am facing the following issue: I have couple of million documents, which have a field called "source_id". My problem is, that I want to retrieve all the documents which have a source_id in a specific range of values. This range can be pretty big, so for example a list of 200 to 2000 source