Solr Grouping and Unique values

2020-07-01 Thread Reinhardt, Nate
"start": 0, "docs": [{ "myID": 123456, "valueIwant": "Hello World" }, { "myID": 123456, "valueIwant": "Hello Planet" } { "myID": 123456, "valueIwant": "Hello World123456" }]] } } ] } } Is there a way to do this? I was looking at functions but couldnt find anything I needed. Copy of this question can be found https://stackoverflow.com/questions/62679939/solr-grouping-and-unique-values Thanks Nate

Re: Solr grouping with offset

2020-02-14 Thread Saurabh Sharma
-- > > From: Saurabh Sharma [mailto:saurabh.infoe...@gmail.com] > > Sent: Friday, February 14, 2020 4:36 PM > > To: solr-user@lucene.apache.org > > Subject: Re: Solr grouping with offset > > > > Hi, > > > > If you want to sort on your field and want

RE: Solr grouping with offset

2020-02-14 Thread Vadim Ivanov
gt; > > > That way seems to me too complicated for the task. > -Original Message- > From: Saurabh Sharma [mailto:saurabh.infoe...@gmail.com] > Sent: Friday, February 14, 2020 4:36 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr grouping with offset > &g

Re: Solr grouping with offset

2020-02-14 Thread Saurabh Sharma
t; }}, > { > "groupValue":"163943:20200708:22:251", > "doclist":{"numFound":1,"start":2,"docs":[] > }}, > { > "groupValue":"164355:20200708

RE: Solr grouping with offset

2020-02-14 Thread Vadim Ivanov
start":2,"docs":[] }}, { "groupValue":"163942:20200708:22:251", "doclist":{"numFound":1,"start":2,"docs":[] }}, { "groupValue":"163943:20200708:22:251",

Re: Solr grouping with offset

2020-02-14 Thread Paras Lehana
It would be better if you give us an example. On Fri, 14 Feb 2020 at 17:20, Vadim Ivanov wrote: > Hello guys! > I need an advise. My task is to delete some documents in collection. > Del algorithm is following: > Group docs by field1 with sort by field2 and delete every 3 and following > occurr

Solr grouping with offset

2020-02-14 Thread Vadim Ivanov
Hello guys! I need an advise. My task is to delete some documents in collection. Del algorithm is following: Group docs by field1 with sort by field2 and delete every 3 and following occurrences in every group. Unfortunately I didn't find easy way to do so. Closest approach was to use group.offse

solr grouping

2018-12-19 Thread swap
I have document in solr as mentioned below { "event_name":"product viewed", "event_property":["category","product_name","product_code","price","brand","color","discount","is_new_visitor"], "event_value":["category-sunglasses","product_name-david blake grey sunglasses","product_cod

Re: Caching Solr Grouping Results

2018-05-21 Thread Yasufumi Mizoguchi
Hi, Have you already tried "group.cache.percent" parameter? It might improve grouping performance. Or if you try CollapsingQParser, you can use expand component to acquire all values in groups, I think. ( https://lucene.apache.org/solr/guide/6_6/collapse-and-expand-results.html#collapse-and-expand

Re: Caching Solr Grouping Results

2018-05-20 Thread rubi.hali
Hi Yasufumi Thanks for the reply. Yes, you are correct. I also checked the code and it seems the same. We are facing performance issues due to grouping so wanted to be sure that we are not leaving out any possibility of caching the same in Query Result Cache. was just exploring field collapsing

Re: Caching Solr Grouping Results

2018-05-20 Thread Yasufumi Mizoguchi
ava#L120 ) But in caching grouping result, query result cache should have {query and conditions} -> {grouped value, condition, etc...} -> {DocList} structure cache, I think. Thanks, Yasufumi 2018年5月18日(金) 23:41 rubi.hali : > Hi All > > Can somebody please explain if we can c

Caching Solr Grouping Results

2018-05-18 Thread rubi.hali
Hi All Can somebody please explain if we can cache solr grouping results in query result cache as i dont see any inserts in query result cache once we enabled grouping? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr Grouping, Aggregations and Custom Functions

2016-09-08 Thread Roshni
compound functions are on the roadmap. Joel Bernstein http://joelsolr.blogspot.com/ -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Grouping-Aggregations-and-Custom-Functions-tp4295093p4295181.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Grouping, Aggregations and Custom Functions

2016-09-08 Thread Praveen Babu
Hi Joel Bernstein, Thanks for the update .If you guys get chance to provide that feature soon, it will be more benefit to the solr users. Regards, S.Praveen Technical Architech LinkedIn: https://www.linkedin.com/in/praveen-babu-73232889?trk=nav_responsive_tab_profile On Thu, Sep 8, 2016 at 5

Re: Solr Grouping, Aggregations and Custom Functions

2016-09-08 Thread Joel Bernstein
Parallel SQL only supports the following functions currently: (SUM, AVG, MIN, MAX, COUNT). More functions and compound functions are on the roadmap. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 8, 2016 at 12:11 AM, Praveen Babu wrote: > Hi All, > > I am also new to Solr and I have

Re: Solr Grouping, Aggregations and Custom Functions

2016-09-07 Thread Praveen Babu
Hi All, I am also new to Solr and I have gone through Solr document and tested agg using Solr- Prasto ( Parallel sql), Stream. I am getting very good response using these 2 technologies. But my worries are, unable to Group By Multivalue field which Solr standard api does but not latest version of

Solr Grouping, Aggregations and Custom Functions

2016-09-07 Thread Roshni Rajagopal
Hi Solr Gurus, I have these requirements 1. Need to group data in solr on multiple fields and compute agregations like SUM (field) 2. Need to compute some custom calculations - sum(field1)/sum(field2) on the grouped data. Options Ive tried 1. Group- this does not allow to group by more

Solr Grouping

2016-05-09 Thread Srinivas Mudam
Hi How can i customize the group limit, I have 5 groups, i want different limit for each group like 3,3,3,2,1. Could please provide solution for this. Thanks, Srinivas Mudam.

Re: Solr Grouping - sorting groups based on the sum of the scores of the documents within each group

2015-07-10 Thread Alessandro Benedetti
Hi Emilio, looking into the Stackoverflow there were a couple of solutions using faceting. So my first question : Is it faceting good for you ? ( faceting is different from grouping as you will only see the countings) . Do you need only to sort by that value, or to return it in each group ? Cheers

Solr Grouping - sorting groups based on the sum of the scores of the documents within each group

2015-07-09 Thread Emilio Borraz
Hi, I'm having a similar use case, still looking for a solution, I have posted a question about it in Stack Overflow ( http://stackoverflow.com/questions/31281640/sum-field-and-sort-on-solr ) Did you solve it ? Regards. -- Emilio Borraz *Back-end Developer* emilio.bor...@sonatasmx.com

Re: Solr grouping problem - need help

2015-01-14 Thread Naresh Yadav
rowser to be sure the problem is not in your code. >>> >>> http://192.168.0.1:8983/solr/collection1/select?q=*:*&group=true&group.field=tenant_pool >>> >>> >>> >>> -- >>> View this message in context: >>> http://lucene.472066.n3.nabble.com/Solr-grouping-problem-need-help-tp4179149p4179464.html >>> Sent from the Solr - User mailing list archive at Nabble.com. >>> >> >> >> >> > > > >

Re: Solr grouping problem - need help

2015-01-14 Thread Naresh Yadav
Try direct query in browser to be sure the problem is not in your code. >> >> http://192.168.0.1:8983/solr/collection1/select?q=*:*&group=true&group.field=tenant_pool >> >> >> >> -- >> View this message in context: >> http://lucene.472066.n3.

Re: Solr grouping problem - need help

2015-01-14 Thread Naresh Yadav
u expect it to work. > > Try direct query in browser to be sure the problem is not in your code. > > http://192.168.0.1:8983/solr/collection1/select?q=*:*&group=true&group.field=tenant_pool > > > > -- > View this message in context: > http://lucene.47206

Re: Solr grouping problem - need help

2015-01-14 Thread Norgorn
t: http://lucene.472066.n3.nabble.com/Solr-grouping-problem-need-help-tp4179149p4179464.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr grouping problem - need help

2015-01-14 Thread Naresh Yadav
Thanks much, now i got better idea on stored & indexed works internally in solr. >From this i tried and modified few things to understand grouping logic. *Schema :* *Code :* SolrQuery q = new SolrQuery().setQuery("type:t1"); q.set(GroupParams.GROUP, true); q.set(GroupParams.GROUP_FIELD, "tenant

Re: Solr grouping problem - need help

2015-01-13 Thread Erick Erickson
bq: My question is for indexed=false, stored=true field..what is optimized way to get unique values in such field. There isn't any. To do this you'll have to read the doc from disk, it'll be decompressed along the way and then the field is read. Note that this happens automatically when you call d

Re: Solr grouping problem - need help

2015-01-13 Thread Naresh Yadav
Erick, my schema is same no change in that.. *Schema :* my guess is i had not mentioned indexed true or falsemay be default indexed is true My question is for indexed=false, stored=true field..what is optimized way to get unique values in such field.. On Tue, Jan 13, 2015 at 10:07 PM

Re: Solr grouping problem - need help

2015-01-13 Thread Erick Erickson
Something is very wrong here. Have you perhaps been changing your schema without re-indexing? And I recommend you completely remove your data directory (the one with "index" and "tlog" subdirectories) after you change your schema.xml file. Because you're trying to group on a field that is _not_ in

Re: Solr grouping problem - need help

2015-01-13 Thread Naresh Yadav
Hi jack, Thanks for replying, i am new to solr please guide me on this. I have many such columns in my schema so copy field will create lot of duplicate fields beside i do not need any search on original field. My usecase is i do not want any search on tenant_pool field thats why i declared it as

Re: Solr grouping problem - need help

2015-01-13 Thread Jack Krupansky
That's your job. The easiest way is to do a copyField to a "string" field. -- Jack Krupansky On Tue, Jan 13, 2015 at 7:33 AM, Naresh Yadav wrote: > *Schema :* > > > *Code :* > SolrQuery q = new SolrQuery().setQuery("*:*"); > q.set(GroupParams.GROUP, true); > q.set(GroupParams.GROUP_FIELD, "ten

Solr grouping problem - need help

2015-01-13 Thread Naresh Yadav
*Schema :* *Code :* SolrQuery q = new SolrQuery().setQuery("*:*"); q.set(GroupParams.GROUP, true); q.set(GroupParams.GROUP_FIELD, "tenant_pool"); *Data :* "tenant_pool" : "Baroda Farms" "tenant_pool" : "Ketty Farms" *Output coming :* groupValue=Farms, docs=2 *Expected Output :* groupValue=Baro

Question About Solr Grouping

2014-03-26 Thread Furkan KAMACI
Hi; When I try this: ... Set urlSet = new HashSet<>(); Map urlMap = new HashMap<>(); ... solrParams = new ModifiableSolrParams(); solrParams.add("q", "*"); solrParams.add("fq", "-title:[* TO *]"); solrParams.add("start", start.toString()); solrParams.add("rows", step.toString()); solrParams.add(

Re: Solr Grouping

2013-11-15 Thread tamanjit.bin...@yahoo.co.in
My question is fro group.format=simple. In normal grouping i know group.offset would work -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Grouping-tp4101313p4101316.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr grouping performance porblem

2013-11-15 Thread shamik
Thanks for the update Shawn, will look forward to the release. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-grouping-performance-porblem-tp4098565p4101314.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr Grouping

2013-11-15 Thread tamanjit.bin...@yahoo.co.in
: G1D3 G2D2 G3D3 Page4: G3D4 -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Grouping-tp4101313.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr grouping performance porblem

2013-11-11 Thread Shawn Heisey
On 11/11/2013 2:12 PM, shamik wrote: Thanks Joel, appreciate your help. Is Solr 4.6 due this year ? The job of release manager for 4.6 has already been claimed. There should be a release candidate posted on the dev list sometime on November 12th (tomorrow) in the USA timezones, unless a seri

Re: Solr grouping performance porblem

2013-11-11 Thread Erick Erickson
In fact, there's some movement towards starting the release process this week, stay tuned! Erick On Mon, Nov 11, 2013 at 4:12 PM, shamik wrote: > Thanks Joel, appreciate your help. Is Solr 4.6 due this year ? > > > > -- > View this message in context: > http://lucene

Re: Solr grouping performance porblem

2013-11-11 Thread shamik
Thanks Joel, appreciate your help. Is Solr 4.6 due this year ? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-grouping-performance-porblem-tp4098565p4100358.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr grouping performance porblem

2013-11-09 Thread Joel Bernstein
Shamik, The CollapsingQParserPlugin will be available in Solr 4.6 and it should perform much better when collapsing on a high cardinality field. The 4.6 code doesn't directly port back to Solr 4.4 though due to some changes in the build for 4.6. The jira ticket has a conversation about this though

Solr grouping performance porblem

2013-10-30 Thread Shamik Bandopadhyay
Hi, I've recently upgraded to SolrCloud (4.4) from Master-Slave mode. One of the changes I did the in queries is to add group functionality to remove duplicate results. The grouping is done on a specific field. But the change seemed to have a huge effect on the query performance. The "group" op

AW: AW: Solr grouping performace

2013-10-03 Thread Sandro Zbinden
... I think like this you can avoid the solr out of memory exception. PS: But be carefull if you store all the rows on client side you need memory too :-) Bests Sandro -Ursprüngliche Nachricht- Von: Alok Bhandari [mailto:alokomprakashbhand...@gmail.com] Gesendet: Donnerstag, 3. Oktober

Re: AW: Solr grouping performace

2013-10-03 Thread Alok Bhandari
: http://lucene.472066.n3.nabble.com/Solr-grouping-performace-tp4093300p4093311.html Sent from the Solr - User mailing list archive at Nabble.com.

AW: Solr grouping performace

2013-10-03 Thread Sandro Zbinden
param. Bests Sandro Zbinden -Ursprüngliche Nachricht- Von: Alok Bhandari [mailto:alokomprakashbhand...@gmail.com] Gesendet: Donnerstag, 3. Oktober 2013 12:31 An: solr-user@lucene.apache.org Betreff: Solr grouping performace Hello , I am using solr 4.0 , I want to group entries on one of th

Solr grouping performace

2013-10-03 Thread Alok Bhandari
document and I do grouping on these 1 million docs. The side of data on disk is approx 2GB and I am having Xmx 2GB. Please can anyone help me out in this. performance is very slow it takes 10-12 seconds. Thanks , Alok -- View this message in context: http://lucene.472066.n3.nabble.com/Solr

Re: Solr grouping performace

2013-08-05 Thread Paul Masurel
expect results to return in 2-3 seconds? the > grouping > field is an "int" , also I want only one filed for a document. I can afford > t use upto 4GB RAM. > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-grouping-performac

Solr grouping performace

2013-08-05 Thread Alok Bhandari
for group.value then can I expect results to return in 2-3 seconds? the grouping field is an "int" , also I want only one filed for a document. I can afford t use upto 4GB RAM. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-grouping-performace-tp4082480.html

Re: Solr Grouping and empty fields

2013-02-25 Thread Oussama Jilal
in our indexing pipeline we will set that field to some unique value (same as the document key if necessary) if it isn't set already to ensure that every document has that field set appropriately. -Original Message- From: Oussama Jilal Sent: Friday, February 22, 2013 5:25 PM To: sol

Re: Solr Grouping and empty fields

2013-02-24 Thread Teun Duynstee
ey if necessary) if it isn't set already to ensure that every document > > has > > > that field set appropriately. > > > > > > -Original Message- From: Oussama Jilal > > > Sent: Friday, February 22, 2013 5:25 PM > > > To: solr-user@luce

Re: Solr Grouping and empty fields

2013-02-24 Thread Jilal Oussama
and in our indexing > > pipeline we will set that field to some unique value (same as the > document > > key if necessary) if it isn't set already to ensure that every document > has > > that field set appropriately. > > > > -Original Message- From: Ous

Re: Solr Grouping and empty fields

2013-02-24 Thread Teun Duynstee
ue (same as the document > key if necessary) if it isn't set already to ensure that every document has > that field set appropriately. > > -Original Message- From: Oussama Jilal > Sent: Friday, February 22, 2013 5:25 PM > To: solr-user@lucene.apache.org > Subject: R

Re: Solr Grouping and empty fields

2013-02-23 Thread Jilal Oussama
riately. > > -Original Message- From: Oussama Jilal > Sent: Friday, February 22, 2013 5:25 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr Grouping and empty fields > > OK I'm sorry if I did not explained well my need. I'll try to give a > better expl

Re: Solr Grouping and empty fields

2013-02-22 Thread Daniel Collins
t every document has that field set appropriately. -Original Message- From: Oussama Jilal Sent: Friday, February 22, 2013 5:25 PM To: solr-user@lucene.apache.org Subject: Re: Solr Grouping and empty fields OK I'm sorry if I did not explained well my need. I'll try to give a be

Re: Solr Grouping and empty fields

2013-02-22 Thread Oussama Jilal
tly do you want these "not to be grouped together" documents to be grouped? In any case, please clarify what your expectations really are. -- Jack Krupansky -Original Message- From: Oussama Jilal Sent: Friday, February 22, 2013 7:17 AM To: solr-user@lucene.apache.org Subje

Re: Solr Grouping and empty fields

2013-02-22 Thread Jack Krupansky
arify what your expectations really are. -- Jack Krupansky -Original Message- From: Oussama Jilal Sent: Friday, February 22, 2013 7:17 AM To: solr-user@lucene.apache.org Subject: Re: Solr Grouping and empty fields Thank you Johannes, but I want the documents having the field empty to b

Re: Solr Grouping and empty fields

2013-02-22 Thread Oussama Jilal
ield:[1 TO *] -- Johannes Rodenwald - Ursprüngliche Mail - Von: "Oussama Jilal" An: solr-user@lucene.apache.org Gesendet: Freitag, 22. Februar 2013 12:32:13 Betreff: Solr Grouping and empty fields Hi, I need to group some results in solr based on a field, but I don't w

Re: Solr Grouping and empty fields

2013-02-22 Thread Johannes Rodenwald
liche Mail - Von: "Oussama Jilal" An: solr-user@lucene.apache.org Gesendet: Freitag, 22. Februar 2013 12:32:13 Betreff: Solr Grouping and empty fields Hi, I need to group some results in solr based on a field, but I don't want documents having that field empty to be grouped to

Solr Grouping and empty fields

2013-02-22 Thread Oussama Jilal
Hi, I need to group some results in solr based on a field, but I don't want documents having that field empty to be grouped together, does anyone know how to achieve that ? -- Oussama Jilal

RE: Solr grouping / facet query

2012-07-21 Thread s215903406
http://lucene.472066.n3.nabble.com/Solr-grouping-facet-query-tp3995787p3996481.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Solr grouping / facet query

2012-07-20 Thread Petersen, Robert
them which says 'No Titles Available' perhaps. Just a thought Robi -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, July 20, 2012 5:07 AM To: solr-user@lucene.apache.org Subject: Re: Solr grouping / facet query You might try two queries.

Re: Solr grouping / facet query

2012-07-20 Thread Erick Erickson
; will affect the relevancy of the results or speed/performance of solr? > > Thank you. > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-grouping-facet-query-tp3995787p3995974.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr grouping / facet query

2012-07-19 Thread s215903406
uot; check to see if the title is blank, then display "no titles found". This could work, though I'm concerned if having all that duplicate bio data will affect the relevancy of the results or speed/performance of solr? Thank you. -- View this message in context: http://lucene.4720

Re: Solr grouping / facet query

2012-07-19 Thread Erick Erickson
e6, title8, title3 > > Author G > no titles found > > Author E > title4, title9, title2 > > Any suggestions would be appreciated! > > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Solr-grouping-facet-query-tp3995787.html > Sent from the Solr - User mailing list archive at Nabble.com.

Solr grouping / facet query

2012-07-18 Thread s215903406
earch results would look like this; Author A title0, title6, title8, title3 Author G no titles found Author E title4, title9, title2 Any suggestions would be appreciated! -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-grouping-facet-query-tp3995787.html Sent from the

Alternate score-based sorting for Solr Grouping

2011-12-06 Thread George Stathis
My previous subject line was not very scannable. Apologies for the re-post, I'm just hoping to get more eye-balls and hopefully some insights. Thank you in advance for your time. See below. -GS On Mon, Dec 5, 2011 at 1:37 PM, George Stathis wrote: > Currently, solr groupi

Solr Grouping - sorting groups based on the sum of the scores of the documents within each group

2011-12-05 Thread George Stathis
Currently, solr grouping (http://wiki.apache.org/solr/FieldCollapsing) sorts groups "by the score of the top document within each group". E.g. [...] "groups":[{ "groupValue":"81cb63020d0339adb019a924b2a9e0c2", "doclist"