Re: Solr join

Hi Iniyan, Will you be able to provide the query that you use, as well as the error message that you received? Regards, Edwin On Mon, 12 Aug 2019 at 01:57, Iniyan wrote: > Hi, > > I was trying to do join between 2 collections. For that I have followed the > tutorial how to create colocating co

RE: Solr join query

ilto:erickerick...@gmail.com] > Sent: Monday, July 29, 2019 3:19 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr join query > > Vadim: > > Are you using streaming or the special “cross collection” join that requires > colocated collection? > > > On Jul

Re: Solr join query

Vadim: Are you using streaming or the special “cross collection” join that requires colocated collection? > On Jul 29, 2019, at 4:23 AM, Vadim Ivanov > wrote: > > I'm using join of multivalued field to the id field of dictionary (another > collection). > It's working pretty well > > -- > V

RE: Solr join query

I'm using join of multivalued field to the id field of dictionary (another collection). It's working pretty well -- Vadim > -Original Message- > From: Rajdeep Sahoo [mailto:rajdeepsahoo2...@gmail.com] > Sent: Monday, July 22, 2019 9:19 PM > To: solr-user@lucene.apache.org > Subject: Sol

Re: SOLR JOIN

They are logically different that is why kept in different collections. Collection1: The purpose is to do Global Text Search for all objects through multiple document types Collection3: The purpose is to have search for some other type of objects whose documents are in Millions and takes GBs size.

Re: SOLR JOIN

Put them in one collection > Am 14.06.2019 um 07:17 schrieb Paresh : > > I am actually able to make this work by doing multiple JOINs - > 1. Do query on Collection1 > 2. JOIN with Collection3 (document type1 field) > 3. JOIN with Collection3 (document type2 field) > 4. Do not fetch any data exce

Re: SOLR JOIN

I am actually able to make this work by doing multiple JOINs - 1. Do query on Collection1 2. JOIN with Collection3 (document type1 field) 3. JOIN with Collection3 (document type2 field) 4. Do not fetch any data except faceting information But the other problem is, it is very slow. Are there any o

Re: SOLR JOIN

Hi Erick, I am able to achieve querying on Collection3 with INNER JOIN between two document types and JOIN across collection1 using below mechanism. I am also getting facetting information from collection3 along with data. http://localhost:8983/solr/collection3/tcfts?wt=json&indent=on&start=0&row

Re: SOLR JOIN

Hi Erick, I am able to achieve querying on Collection3 with INNER JOIN between two document types and JOIN across collection1 using below mechanism. I am also getting facetting information from collection3 along with data. http://localhost:8983/solr/collection3/tcfts?wt=json&indent=on&start=0&row

Re: SOLR JOIN

How are you trying to do this? Streaming Expressions? ParallelSQL? What _Solr_ constructs are you planning on using? Best, Erick > On Jun 12, 2019, at 7:33 AM, Paresh wrote: > > Hi, > > I have two collections both having different schema. > Collection1: ID, Field1, Field2 > Collection3: ID, O

Re: Solr join With must clause in fq

it might make sense to test on the recent versions of Solr. On Sun, Apr 8, 2018 at 8:21 PM, manuj singh wrote: > Hi all, > I am trying to debug a problem which i am facing and need some help. > > I have a solr query which does join on 2 different cores. so lets say my > first core has following

Re: Solr join query takes too long

Hello. There is no way to make it work fast. It executes expensive join operation for all docs/terms and then post filters with resulting docset. On Mon, Feb 5, 2018 at 9:53 AM, Aashish Agarwal wrote: > Hi > > I am using join query that joins 2 cores to get result. Since, number of > docs in bot

Re: solr join query

You may want to look at fetch function of Streaming expressions http://lucene.apache.org/solr/guide/6_6/stream-decorators.html Thanks, Susheel On Tue, Sep 12, 2017 at 11:11 AM, Brian Yee wrote: > I have one solr collection used for auto-suggestions. If I submit a query > with q="coffe", I will

Re: Solr Join Failures

I am using following one: http://lucene.apache.org/solr/5_4_1/solr-core/org/apache/solr/search/join/ScoreJoinQParserPlugin.html q={!join from=id to=id fromIndex=B}id:* 2017-06-12 20:05 GMT-07:00 Zheng Lin Edwin Yeo : > What is the query that you used to do the Join? > > There is the Streaming exp

Re: Solr Join Failures

What is the query that you used to do the Join? There is the Streaming expression which has the various Join function, but it requires Solr version 6 onward. https://cwiki.apache.org/confluence/display/solr/Streaming+Expressions Regards, Edwin On 13 June 2017 at 05:25, Ray Niu wrote: > Hi: >

Re: SOLR JOIN

If you're using Solr 6, you can use streaming expressions: https://cwiki.apache.org/confluence/display/solr/Streaming+Expressions Regards, Edwin On 1 March 2017 at 18:27, vrindavda wrote: > Hi Nitin, > > You can use Streaming Expressions >

Re: SOLR JOIN

Hi Nitin, You can use Streaming Expressions for Joins in SolrCloud only (For Collections Not Core). Again this can affect you performance, I would suggest to copy fields from one collection to another any seamlessly use

Re: SOLR JOIN

That seems difficult if not impossible. The joins are just complex queries, with the same data set. > On Feb 28, 2017, at 11:37 PM, Nitin Kumar wrote: > > Hi, > > Can we use join query for more than 2 cores in solr. If yes, please provide > reference or example. > > Thanks, > Nitin

Re: Solr join between documents

Ok, thanks for your answer! That's what I thought but just wanted to be sure. Best regards, Elisabeth 2016-05-21 2:02 GMT+02:00 Erick Erickson : > Gosh, I'm not even sure how to start to form such a query. > > Let's see, you have StreetB in some city identified by postal code P. > > Is what you'

Re: Solr join between documents

Gosh, I'm not even sure how to start to form such a query. Let's see, you have StreetB in some city identified by postal code P. Is what you're wanting "return me all pairs of documents within that postal code that have all the terms matching and the polygons enclosing those streets plus some dis

RE: Solr Join between two indexes taking too long.

better using longs I’ll > stick with the strings. > > > Thanks for your help Mikhail and Upayavira now I just need to get the > firm to move to 5.3 ☺ > > Russ. > > > -Original Message- > From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] > Sent

Re: Solr Join between two indexes taking too long.

> > Thanks for your help Mikhail and Upayavira now I just need to get the firm > to move to 5.3 ☺ > > Russ. > > > -Original Message- > From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] > Sent: 14 September 2015 15:54 > To: solr-user > Subject: Re: Solr

RE: Solr Join between two indexes taking too long.

-- From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] Sent: 14 September 2015 15:54 To: solr-user Subject: Re: Solr Join between two indexes taking too long. Why? It's enough to just open index by Solr 5.3 instance. No need to reindex. On Mon, Sep 14, 2015 at 4:57 PM, Russell

Re: Solr Join between two indexes taking too long.

Russ. > > -Original Message- > From: Russell Taylor > Sent: 11 September 2015 14:00 > To: solr-user@lucene.apache.org > Subject: RE: Solr Join between two indexes taking too long. > > It will take a little while to set-up a 5.3 vers

RE: Solr Join between two indexes taking too long.

Looks like I won't be able to test this out on 5.3. Thanks for all your help. Russ. -Original Message- From: Russell Taylor Sent: 11 September 2015 14:00 To: solr-user@lucene.apache.org Subject: RE: Solr Join between two indexes taking too long. It will take a little while to set

RE: Solr Join between two indexes taking too long.

It will take a little while to set-up a 5.3 version, hopefully I'll have some results later next week. From: Mikhail Khludnev [mkhlud...@griddynamics.com] Sent: 11 September 2015 12:59 To: Russell Taylor Subject: Re: Solr Join between two indexes taking too

RE: Solr Join between two indexes taking too long.

I'll try that Thanks Upayavira. From: Upayavira [u...@odoko.co.uk] Sent: 09 September 2015 19:30 To: solr-user@lucene.apache.org Subject: Re: Solr Join between two indexes taking too long. I've never reviewed that join query debug info - very i

Re: Solr Join between two indexes taking too long.

from=longValue to=longValue > > fromIndex=indexB}universe:LARGE", > > "parsedquery": "JoinQuery({!join from=longValue to=longValue > > fromIndex=indexB}universe:LARGE)", > > "parsedquery_toString": "{!join from=longValue to=longValue > > fromIndex=indexB}universe:LAR

Re: Solr Join between two indexes taking too long.

;200076769985": "\n1.0 = (MATCH) > org.apache.solr.search.JoinQuery$JoinQueryWeight@7a5d18ac , product > of:\n 1.0 = boost\n 1.0 = queryNorm\n", > "200076769986": "\n1.0 = (MATCH) > org.apache.solr.search.JoinQuery$JoinQueryWeight@6d601adc , pr

Re: Solr Join between two indexes taking too long.

che.solr.search.JoinQuery$JoinQueryWeight@118f9aef , product > of:\n 1.0 = boost\n 1.0 = queryNorm\n", > "200076769985": "\n1.0 = (MATCH) > org.apache.solr.search.JoinQuery$JoinQueryWeight@7a5d18ac , product > of:\n 1.0 = boost\n 1.0

RE: Solr Join between two indexes taking too long.

rg.apache.solr.search.JoinQuery$JoinQueryWeight@6d601adc , product of:\n 1.0 = boost\n 1.0 = queryNorm\n", "200076769987": "\n1.0 = (MATCH) org.apache.solr.search.JoinQuery$JoinQueryWeight@2e262f31 , product of:\n 1.0 = boost\n 1.0 = queryNorm\n", "2

Re: Solr Join between two indexes taking too long.

To explain what a join does: It goes over to the joined index, and executes a query. This results in a list of "ids" that will be used to do a search on the main index. The more of these ids there are, the worse performance will be. Thus, if you have 100k documents that match in the join core, you

RE: Solr Join between two indexes taking too long.

uent changes to the start parameter are fast? Thanks Russ. -Original Message- From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com] Sent: 08 September 2015 23:08 To: solr-user Subject: Re: Solr Join between two indexes taking too long. Hello Russ, It's an inter

Re: Solr Join between two indexes taking too long.

Hello Russ, It's an interesting case! Can you get a brief context? - is it possible to keep both type of data at the same core? Why not? - can you manually shard both indices by those longValues? - It seems like you query a plenty of data, don't you have another query/filter to intersect that join

Re: Solr Join support in Multiple Shard

It's been discussed, but it's likely to have performance problems I'd guess. That said, there's some very interesting stuff being done with Streaming Aggregation and, built on top of that Parallel SQL. But how that applies to your use-case I don't know. Best, Erick On Wed, Sep 2, 2015 at 9:05 AM

Re: Solr join + Boost in single query

if I get you right, "union" query can be achieved by SHOULD clauses: q=foo {!scorejoin fromIndex=2nd}bar On Wed, Mar 4, 2015 at 4:16 PM, sraav wrote: > Yes Mikhail. Similar to the one you mentioned. The only difference is that, > in my case a uinon between two cores would work too.. > > > > --

Re: Solr join + Boost in single query

Yes Mikhail. Similar to the one you mentioned. The only difference is that, in my case a uinon between two cores would work too.. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-join-Boost-in-single-query-tp4190825p4190911.html Sent from the Solr - User mailing list arc

Re: Solr join + Boost in single query

sounds like https://issues.apache.org/jira/browse/SOLR-6234 ? doesn't it? On Wed, Mar 4, 2015 at 3:40 AM, sraav wrote: > David, > > Is it possible to write a query to join two cores and either bring back > data > from the two cores or to boost on the data coming back from either of the > cores?

Re: Solr join + Boost in single query

Eric, I am trying to boost the fields that match both the cores to the top of the list. Or atleast get a union of the two cores. Thanks, Raavi -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-join-Boost-in-single-query-tp4190825p4190861.html Sent from the Solr - User

Re: Solr join + Boost in single query

Or do you think there is a way to do a union between the two cores? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-join-Boost-in-single-query-tp4190825p4190860.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr join + Boost in single query

This seems very much like it may be an "XY" problem. >From Hossman's apache page: Your question appears to be an "XY Problem" ... that is: you are dealing with "X", you are assuming "Y" will help you, and you are asking about "Y" without giving more details about the "X" so that we can understand

Re: Solr join + Boost in single query

David, Thank you for the reply. How about boosting on the records that match the both the cores or may be boosting on join may be? Is there a way we can do that? Raav -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-join-Boost-in-single-query-tp4190825p4190852.html S

Re: Solr join + Boost in single query

No, not without writing something custom anyway. It'd be difficult to make it fast if there's a lot of documents to join on. sraav wrote > David, > > Is it possible to write a query to join two cores and either bring back > data from the two cores or to boost on the data coming back from either

Re: Solr join not working in slorCloud env

Joins do are not supported when the various cores are not on the same node, see: https://wiki.apache.org/solr/DistributedSearch, the line: Doesn't support Join -- (see https://issues.apache.org/jira/browse/LUCENE-3759) Best, Erick On Mon, Dec 15, 2014 at 7:19 PM, ArnabK wrote: > For Eg: I have

Re: Solr join not working for multiple collection in slorCloud env

Hi, It's just FYI, Join query is (currently) not supported at distributed environment. It would be same at SolrCloud mode (I have not tried.) Please see "Limitations" notation this page, if you have not. https://wiki.apache.org/solr/Join Thanks, Tomoko 2014-12-16 9:04 GMT+09:00 ArnabK : > > I ha

Re: SOLR Join Query, Use highest weight.

We simply index parent and child documents with the same field value, and group on that, querying both parent and child documents. If you boost the parent it will show up as the first result in the group. Then you get all related documents together. in the same group. -Mike On 12/02/2014 02:

Re: SOLR Join Query, Use highest weight.

Hi, Thanks for the response, I have considered grouping often, but grouping does not return the parent document, just the group id. I would still have to add something to take the group id’s and get the parent documents. Thanks Darin > On Dec 2, 2014, at 2:11 PM, Michael Sokolov > wrote: >

Re: SOLR Join Query, Use highest weight.

Have you considered using grouping? If I understand your requirements, I think it does what you want. https://cwiki.apache.org/confluence/display/solr/Result+Grouping On 12/02/2014 12:59 PM, Darin Amos wrote: Thanks! I will take a look at this. I do have an additional question, since after a

Re: SOLR Join Query, Use highest weight.

Thanks! I will take a look at this. I do have an additional question, since after a bunch of digging I believe I am going to run into another dead end. I want to execute the join (or rollup) query, but I want the facets to represent the facets of all the child documents, not the resulting produ

Re: SOLR Join Query, Use highest weight.

Hello, AFAIK {!join} doesn't supply any meaningful scores. I can suggest https://issues.apache.org/jira/browse/SOLR-6234 On Tue, Dec 2, 2014 at 4:35 AM, Darin Amos wrote: > Hello, > > I had sent an email a few days ago talking about implementing a custom > rollup query component. I have changed

Re: Solr JOIN: keeping permission data out of primary documents

On Wed, Nov 19, 2014 at 11:56 AM, Yonik Seeley wrote: > On Wed, Nov 19, 2014 at 9:22 AM, Philip Durbin > wrote: >> On Wed, Nov 19, 2014 at 5:45 AM, Yonik Seeley wrote: >>> On Tue, Nov 18, 2014 at 3:47 PM, Philip Durbin >>> wrote: Solr JOINs are a way to enforce simple document security, as

Re: Solr JOIN: keeping permission data out of primary documents

On Wed, Nov 19, 2014 at 9:22 AM, Philip Durbin wrote: > On Wed, Nov 19, 2014 at 5:45 AM, Yonik Seeley wrote: >> On Tue, Nov 18, 2014 at 3:47 PM, Philip Durbin >> wrote: >>> Solr JOINs are a way to enforce simple document security, as explained >>> by Yonik Seeley at >>> http://lucene.472066.n3.n

Re: Solr JOIN: keeping permission data out of primary documents

On Wed, Nov 19, 2014 at 5:45 AM, Yonik Seeley wrote: > On Tue, Nov 18, 2014 at 3:47 PM, Philip Durbin > wrote: >> Solr JOINs are a way to enforce simple document security, as explained >> by Yonik Seeley at >> http://lucene.472066.n3.nabble.com/document-level-security-filter-solution-for-Solr-tp4

Re: Solr JOIN: keeping permission data out of primary documents

On Tue, Nov 18, 2014 at 3:47 PM, Philip Durbin wrote: > Solr JOINs are a way to enforce simple document security, as explained > by Yonik Seeley at > http://lucene.472066.n3.nabble.com/document-level-security-filter-solution-for-Solr-tp4126992p4126994.html > > I'm trying to tweak this pattern so t

Re: Solr join and lucene scoring

Thank you for the clarification. We really need scoring with solr joins, but as you can see I'm not a specialist in solr development. We would like to hire somebody with more experience to write a qparser plugin for scoring in joins and donate the source code to the community. Any suggestion

Re: Solr join and lucene scoring

Right, The examples posted before had a trick (both weren't pure join queries thats why the results had score). Having a pure join query (q={!join from=id to=id}printer) gives all the scores as 1 as Moritz said). Regards. On Wed, Apr 9, 2014 at 3:13 PM, Mikhail Khludnev wrote: > On Wed

Re: Solr join and lucene scoring

On Wed, Apr 9, 2014 at 1:33 PM, wrote: > Hello Mikhail, > > thx for the clarification. I'm a little bit confused by the answer of > Alvaro, but my own tests didn't result in a proper score, so I think you're > right and it's still not implemented. > > What do you mean with the "impedance between

Re: Solr join and lucene scoring

Hello Mikhail, thx for the clarification. I'm a little bit confused by the answer of Alvaro, but my own tests didn't result in a proper score, so I think you're right and it's still not implemented. What do you mean with the "impedance between Lucene and Solr"? Why isn't the possibility of

Re: Solr join and lucene scoring

On Thu, Apr 3, 2014 at 1:42 PM, wrote: > Hello, > > referencing to this issue: > https://issues.apache.org/jira/browse/SOLR-4307 > > Is it still not possible with the solr query time join to use scoring? > It's not implemented still. https://github.com/apache/lucene-solr/blob/trunk/solr/core/src/

Re: Solr join and lucene scoring

Hi, The defect you are referencing is closed with a resolution of *Invalid*, so it seems the scoring is working fine with the join. I've made the next two tests on my own data and seems it is working: *TestA* - fl=id,score - q=notebook - fq={!join from=product_list to=id fromIndex=prod

Re: solr join use case (not in instead of in)

Generally, you need to flatten and denormalize your data before you place it in Solr. But, Solr does have a limited join capability that does handle some cases reasonably well: http://wiki.apache.org/solr/Join For example... "This Solr request... /solr/collection1/select ? fl=xxx,yyy & q=

Re: solr join

i already have multvalued relatedVideoId field which i m trying to join with id -- View this message in context: http://lucene.472066.n3.nabble.com/solr-join-tp3881832p3882034.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr join

Try adding a multivalued relatedVideo field to each document, then you won't need the join. Almost always, you want to do the joins before you load documents into Solr, and use a denormalized schema in Solr. That will be faster and simpler at query time. wunder Search Guy, Chegg On Apr 3, 201

Re: Solr Join query with fq not correctly filtering results?

Thanks Yonik!! The join functionality is proving extremely useful for us in a specific use case - we're really looking forward to join and other cool features coming in Solr4!! Mike On Wed, Feb 1, 2012 at 3:30 PM, Yonik Seeley wrote: > Thanks for your persistence in tracking this down Mike! > I

Re: Solr Join query with fq not correctly filtering results?

Thanks for your persistence in tracking this down Mike! I'm going to start looking into this now... -Yonik lucidimagination.com On Thu, Jan 26, 2012 at 11:06 PM, Mike Hugo wrote: > I created issue https://issues.apache.org/jira/browse/SOLR-3062 for this > problem.  I was able to track it down

Re: Solr Join query with fq not correctly filtering results?

I've been looking into this a bit further and am trying to figure out why the FQ isn't getting applied. Can anyone point me to a good spot in the code to start looking at how FQ parameters are applied to query results in Solr4? Thanks, Mike On Thu, Jan 26, 2012 at 10:06 PM, Mike Hugo wrote: >

Re: Solr Join query with fq not correctly filtering results?

I created issue https://issues.apache.org/jira/browse/SOLR-3062 for this problem. I was able to track it down to something in this commit - http://svn.apache.org/viewvc?view=revision&revision=1188624 (LUCENE-1536: Filters can now be applied down-low, if their DocIdSet implements a new bits() metho

Re: Solr Join with Dismax

Thanks Hoss! Here it is: https://issues.apache.org/jira/browse/SOLR-2972 On Wed, Dec 14, 2011 at 4:47 PM, Chris Hostetter wrote: > > : I have been doing more tracing in the code. And I think that I > understand a > : bit more. The problem does not seem to be dismax+join, but > : dismax+join+from

Re: Solr Join with Dismax

: I have been doing more tracing in the code. And I think that I understand a : bit more. The problem does not seem to be dismax+join, but : dismax+join+fromIndex. Correct. join+dismax works fine as i already demonstrated... : >> Note: even with that hardcoded "lucene" bug, you can still overr

Re: Solr Join with Dismax

Hi, I have been doing more tracing in the code. And I think that I understand a bit more. The problem does not seem to be dismax+join, but dismax+join+fromIndex. When doing this joined dismax query on the same index: http://localhost:8080/solr/gutenberg/select?q={!join+from=id+to=id+v=$qq}&qq={!d

Re: Solr Join with Dismax

Thanks Hoss! But unfortunately, the dismax parameters (like qf) are not passed over to the fromIndex. In fact, even if using var dereferencing makes Dismax to be selected as the "fromQueryParser", the query that is passed to the JoinQuery object contains nothing to indicate that it should use dism

Re: Solr Join with Dismax

: Is there a specific reason why it is hard-coded to use the "lucene" : QParser? I was looking at JoinQParserPlugin.java and here it is in : createParser: : : QParser fromQueryParser = subQuery(v, "lucene"); : : I could pass another param named "fromQueryParser" and use it instead of : "lucene"

Re: Solr Join with Dismax

Hi, Is there a specific reason why it is hard-coded to use the "lucene" QParser? I was looking at JoinQParserPlugin.java and here it is in createParser: QParser fromQueryParser = subQuery(v, "lucene"); I could pass another param named "fromQueryParser" and use it instead of "lucene". But again,

Re: Solr Join with Dismax

Hi, Thanks for this! But your "partner-tmo" request handler is probably configured with your ing-content index, no? In my case, I'd like to execute a dismax query on the fromIndex. On Tue, Dec 6, 2011 at 2:57 PM, Jeff Schmidt wrote: > Hi Pascal: > > I have an issue similar to yours, but also ne

Re: Solr Join with Dismax

Hi Pascal: I have an issue similar to yours, but also need to facet the joined documents... I've been playing with various things. There's not much documentation I can find. Looking at http://wiki.apache.org/solr/Join, in the fourth example you can see the join being relegated to a filter quer

Re: Solr Join with multiple query parameters

: http://localhost:8983/solr/core0/select?q={!join%20from=matchset_id_ss%20to=id}*:*&fq=status_s:completed : : I get filtered results of documents that are completed. The issue I am now : trying to face is how do I filter the initial search of documents based on : multiple conditions and then ge

Re: Solr Join in 3.3.x

Unfortunately Solr's join impl hasn't been backported to 3.x, as far as I know. You might want to look at ElasticSearch; it has a join implementation already or use Solr 4.0. Mike McCandless http://blog.mikemccandless.com On Wed, Aug 17, 2011 at 7:40 PM, Cameron Hurst wrote: > Hello all, >