Re: Solr 6 Distributed Join

2015-12-17 Thread Joel Bernstein
(...), on...) If the third stream is joined on a different key you can nest inside a hashJoin which doesn't require streams to be sorted on the join key. For example: hashJoin(innerJoin(...), hashed=search(...), on..) Joel Bernstein http://joelsolr.blogspo

Re: Solr 6 Distributed Join

2015-12-17 Thread Joel Bernstein
), workers="20", zkHost="zk1:2345", sort="userId asc" ), hashed=search(restaurants, q="city:nyc", fl=&

Re: Solr 6 Distributed Join

2015-12-17 Thread Joel Bernstein
One thing to note about the hashJoin is that it requires the search results from the hashed query to fit entirely in memory. The innerJoin does not have this requirement as it performs a streaming merge join. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Dec 17, 2015 at 10:33 AM, Joel

Re: Solr 6 Distributed Join

2015-12-22 Thread Joel Bernstein
doesn't work properly it makes sense to file a bug report. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Dec 22, 2015 at 5:55 AM, Akiel Ahmed wrote: > Hi, > > I tried a straight forward join against something that is connected to > many things but didn't get the results

Re: Streaming Expressions (/stream) NPE

2015-12-22 Thread Joel Bernstein
The http parameter "stream" was recently changed to "expr" in SOLR-8443. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Dec 22, 2015 at 8:45 PM, Jason Gerlowski wrote: > I'll preface this email by saying that I wasn't sure which mailing list it > b

Re: Streaming Expressions (/stream) NPE

2015-12-23 Thread Joel Bernstein
Thanks for the feedback. Yes, please create the ticket. I believe all that needs to be done is to check for null and then throw a better exception. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Dec 23, 2015 at 9:15 AM, Jason Gerlowski wrote: > Thanks for the heads up Joel. Glad t

Re: Solr 6 Distributed Join

2015-12-24 Thread Joel Bernstein
I haven't had a chance to review. If you have a reproducible failure on a one-to-many join go ahead and create a jira ticket. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Dec 24, 2015 at 3:25 AM, Akiel Ahmed wrote: > Hi > > Did you get a chance to check whether one-to-m

Re: Solr 6 - Relational Index querying

2015-12-28 Thread Joel Bernstein
involve scoring. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Dec 28, 2015 at 8:49 AM, Dennis Gove wrote: > There have been a lot of new features added to the Streaming API and the > documentation hasn't kept pace, but it is something I'd like to have filled > in by t

Re: Solr 6 - Relational Index querying

2015-12-28 Thread Joel Bernstein
Yes that would work. Each search(...) has it's own specific params and can point to any handler that conforms to the output format in the /select handler. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Dec 28, 2015 at 11:12 AM, Dennis Gove wrote: > Correct me if I'm wrong

Re: can we use Streaming Expressions for different collection

2016-01-04 Thread Joel Bernstein
), which are available in Solr 5. Trunk has a much large set of expressions, but they have not yet been documented. They will be documented before the 6.0 release. If you can describe your use case in detail I can let you know if there is an expression in Solr 5 or trunk (Solr 6) that would fit. Joel

Re: can we use Streaming Expressions for different collection

2016-01-05 Thread Joel Bernstein
There are a number of map/reduce join implementations available in Trunk. These are map/reduce joins where the entire result sets are shuffled to worker nodes. All of this code is in the org.apache.solr.client.solrj.io.stream package if you'd like to review. Joel Bernstein

Re: Solr /export handler is exporting only unique values from multivalued field?

2016-01-11 Thread Joel Bernstein
The /export handler is using DocValues for export, which stores the multi-value fields as a sorted set. So the sorting is the expected behavior. If you have duplicates in the multi-value field this could account for the list being of different sizes. Joel Bernstein http://joelsolr.blogspot.com

Re: Solr /export handler is exporting only unique values from multivalued field?

2016-01-11 Thread Joel Bernstein
Perhaps you can achieve what you're trying to do with a prefix on the data so the sort is maintained and duplicates are not eliminated. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jan 11, 2016 at 1:42 PM, Joel Bernstein wrote: > The /export handler is using DocValues for expor

Re: collapse filter query

2016-01-11 Thread Joel Bernstein
Which version of Solr are you using? Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jan 11, 2016 at 6:39 AM, sara hajili wrote: > hi all > i have a MLT query and i wanna to use collapse filter query. > and i wanna to use collapse expand nullPolicy. > in this way wh

Re: collapse filter query

2016-01-11 Thread Joel Bernstein
I believe this is a bug. I think the reason this is occurring is that you have an index segment with no values at all in the collapse field. If you could create a jira ticket for this I will look at resolving the issue. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jan 11, 2016 at 2:03 PM

Re: collapse filter query

2016-01-11 Thread Joel Bernstein
I'll create it later today and update this thread with the Jira number. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jan 11, 2016 at 2:15 PM, sara hajili wrote: > Tnx.How I can create a jira ticket? > On Jan 11, 2016 10:42 PM, "Joel Bernstein" wrote: > > &

Re: collapse filter query

2016-01-11 Thread Joel Bernstein
I went to go work on the issue and found it was already fixed 7 weeks ago. The bug fix is available in Solr 5.4. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Jan 11, 2016 at 3:12 PM, Susheel Kumar wrote: > You can go to https://issues.apache.org/jira/browse/SOLR/ and create J

Re: collapse filter query

2016-01-15 Thread Joel Bernstein
> collapse filter. > If I wont to immigrate to solr 5.4. > Is any other approach to get distinct value that I can use in solr 5.3.1? > On Jan 12, 2016 1:39 AM, "Joel Bernstein" wrote: > > > I went to go work on the issue and found it was already fixed 7 weeks

Re: Solr UninvertingReader getNumericDocValues doesn't seem to work for fields that are not stored or indexed

2016-01-19 Thread Joel Bernstein
Try converting the long to a float using: Float.intBitsToFloat((int)val). It should come back with the correct float. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Jan 19, 2016 at 5:35 PM, plbarrios wrote: > I have a defined field in my schema.xml that is a simple float that is

Re: Returning all documents in a collection

2016-01-20 Thread Joel Bernstein
DocValues caches. So you may need to re-index your data to use this feature. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Jan 20, 2016 at 9:29 AM, Salman Ansari wrote: > Thanks Emir, Susheel and Jack for your responses. Just to update, I am > using Solr Cloud plus I want to get the

Re: Returning all documents in a collection

2016-01-20 Thread Joel Bernstein
t, streaming expressions, and how to select the best > one for a given use case.) > > (And Joel is going to promise to update the doc for this stored field > restriction, right?!) > > -- Jack Krupansky > > On Wed, Jan 20, 2016 at 9:38 AM, Joel Bernstein > wrote: &

Re: Highlights on Expanded results

2016-01-29 Thread Joel Bernstein
I'm wondering how difficult it would be to get the highlighter working on expanded results. I think it's worth creating a jira request for this. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Jan 29, 2016 at 5:43 AM, Anil wrote: > Hi, > > Solr expanded results are

Re: Exporting Score value from export handler

2016-01-29 Thread Joel Bernstein
es to export would support queries like: select id, title, score from tableX where a = '(a query)' Where currently you can only do this: select id, title, score from tableX where a = '(a query)' limit 1000 Can you create a jira for this and link it to SOLR-8125

Re: Highlights on Expanded results

2016-01-29 Thread Joel Bernstein
Yeah, a DocTransformer would seem to be a good route to go. Not sure how difficult it would be to do highlighting through the doc transformer. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Jan 29, 2016 at 8:32 AM, Erik Hatcher wrote: > Maybe as a DocTransformer? > > > On

Re: Executing Collector's Collect method on more than one thread

2016-01-31 Thread Joel Bernstein
large overhead involved with top level String docValues. Then I would change your scorer to work directly with BytesRef rather then converting to the utf8 String. Joel Bernstein http://joelsolr.blogspot.com/ On Sun, Jan 31, 2016 at 9:13 AM, adfel70 wrote: > I am using RankQuery to implement

Re: SOLR-6690

2016-02-01 Thread Joel Bernstein
This issue has not been fixed yet. It does not appear that it's being worked on at the moment. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Feb 1, 2016 at 3:43 AM, Anil wrote: > HI, > > was there any fix for https://issues.apache.org/jira/browse/SOLR-6690 ? or > any

Re: Export request handler via SolrJ

2016-02-02 Thread Joel Bernstein
Take a look at SolrStream and CloudSolrStream. These are available since Solr 5.1 but the 6.0 release will greatly improved on the streaming capabilities. http://joelsolr.blogspot.com/2015/04/the-streaming-api-solrjio-basics.html Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Feb 2, 2016

Re: Select distinct records

2016-02-11 Thread Joel Bernstein
. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Feb 11, 2016 at 10:30 AM, Brian Narsi wrote: > I am using > > Solr 5.1.0 > > On Thu, Feb 11, 2016 at 9:19 AM, Binoy Dalal > wrote: > > > What version of Solr are you using? > > Have you taken a look at the Coll

Re: Select distinct records

2016-02-11 Thread Joel Bernstein
The CollapsingQParserPlugin shouldn't have duplicates in the result set. Can you provide the details? Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Feb 11, 2016 at 12:02 PM, Brian Narsi wrote: > I have tried to use the Collapsing feature but it appears that it leaves >

Re: Select distinct records

2016-02-11 Thread Joel Bernstein
Yeah that would be the reason. If you want distributed unique capabilities, then you might want to start testing out 6.0. Aside from SELECT DISTINCT queries, you also have a much more mature Streaming Expression library which supports the unique operation. Joel Bernstein http

Re: Retrieving 1000 records at a time

2016-02-17 Thread Joel Bernstein
A few questions for you: What types of fields and how many fields will you be retrieving? What version of Solr are you using? Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Feb 17, 2016 at 1:37 PM, Mark Robinson wrote: > Hi, > > I have a requirement where I need to retrieve

Re: Retrieving 1000 records at a time

2016-02-17 Thread Joel Bernstein
Also are you ranking documents by score Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Feb 17, 2016 at 1:59 PM, Joel Bernstein wrote: > A few questions for you: What types of fields and how many fields will you > be retrieving? What version of Solr are you using? > > Jo

Re: Facet count with expand and collapse

2016-02-19 Thread Joel Bernstein
With collapse and expand the facet counts will be calculated for the collapsed data set. You can also use the tag/exclude feature to exclude the collapse filter query and generate facets on the uncollapsed set. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Feb 17, 2016 at 10:44 AM, Anil

Re: Do all SolrCloud nodes communicate with the database when indexing a collection?

2016-02-20 Thread Joel Bernstein
the /stream handler it will execute the expression for you. The UpdateStream uses CloudSolrClient to send the documents to Solr. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Feb 18, 2016 at 9:32 PM, Anshum Gupta wrote: > I'd suggest using CloudSolrClient. It uses ConcurrentU

Re: using solr AnalyticsQuery API vs facet API

2016-03-19 Thread Joel Bernstein
https://issues.apache.org/jira/browse/SOLR-8492 shows an example of the AnalyticsQuery where the merge is being handled by the Streaming API. I actually think this is nicer then then using MergeStrategy. The Streaming API gives you full control over the merge from the shards. Joel Bernstein http

Re: Grafana Solr Support

2016-03-20 Thread Joel Bernstein
This ticket might support Solr's JDBC driver in Solr 6. https://github.com/grafana/grafana/issues/1542 Joel Bernstein http://joelsolr.blogspot.com/ On Sun, Mar 20, 2016 at 10:22 PM, Jon Drews wrote: > It would be really neat if Grafana supported Solr. They recently added > El

Re: Contrib module for Document Clustering

2016-04-06 Thread Joel Bernstein
I don't know of any contrib or module that does this. Can you describe why you'd want to route documents to shards based on similarity? What advantages would you get by using this approach? Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 6, 2016 at 1:36 PM, davidphil

Re: Contrib module for Document Clustering

2016-04-07 Thread Joel Bernstein
x if you're not getting good results. I would check the search performance you're getting on each shard. It may very be that you just need to speed up the searches on the shards themselves, rather then trying to limit the search to a subset of shards. Joel Bernstein http://joelsolr.blo

Re: Solr best practices for many to many relations...

2016-04-15 Thread Joel Bernstein
cific use case. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 15, 2016 at 9:17 AM, Dennis Gove wrote: > The Streaming API with Streaming Expressions (or Parallel SQL if you want > to use SQL) can give you the functionality you're looking for. See > https://cwiki.apache.org

Re: Solr best practices for many to many relations...

2016-04-15 Thread Joel Bernstein
You may also want to keep an eye on SOLR-8925 which supports distributed, cross collection graph traversals. This may be useful in traversing the relationships. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 15, 2016 at 9:56 AM, Joel Bernstein wrote: > Solr now has full distribu

Re: Solr best practices for many to many relations...

2016-04-15 Thread Joel Bernstein
. But the specific use cases need to be tested. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 15, 2016 at 10:24 AM, Jack Krupansky wrote: > It will be interesting to see which use cases work best with the new > streaming JOIN vs. which will remain best with full denormalizati

Re: Solr best practices for many to many relations...

2016-04-15 Thread Joel Bernstein
I think people are going to be surprised though by the speed of the joins. The joins also get faster as the number of shards, replicas and worker nodes grow in the cluster. So we may see people building out large clusters and and using the joins in OLTP scenarios. Joel Bernstein http

Re: Question on Solr JDBC driver with SQL client like DB Visualizer

2016-04-15 Thread Joel Bernstein
:20:28 EDT 2016 org/apache/solr/client/solrj/io/sql/package-info.class Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 15, 2016 at 10:15 AM, Reth RM wrote: > Note: I followed the steps mentioned in the pdf attached on this Jira > https://issues.apache.org/jira/browse/SOLR-8521 &g

Re: Question on Solr JDBC driver with SQL client like DB Visualizer

2016-04-15 Thread Joel Bernstein
What version of DbVisualizer are you using? When I tested I was using the latest version. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 15, 2016 at 12:47 PM, Reth RM wrote: > output of command : > > org/apache/solr/client/solrj/io/sql/ >META-INF/services/java.sql.Dr

Re: Question on Solr JDBC driver with SQL client like DB Visualizer

2016-04-15 Thread Joel Bernstein
Ok, I think I know the problem you're running into. You'll need to load the solr-solrj jar after loading the jars in the solrj-lib. Otherwise DbVis seems to get confused and lose the driver class. We'll work on putting out a single jar for the JDBC driver. Joel

Re: The Streaming API (Solrj.io) : id must have DocValues?

2016-04-25 Thread Joel Bernstein
trade off memory for performance. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Apr 25, 2016 at 3:30 AM, Reth RM wrote: > Hi, > > So, is the concern related to same field value being stored twice: with > stored=true and docValues=true? If that is the case, there is a jira >

Re: The Streaming API (Solrj.io) : id must have DocValues?

2016-04-26 Thread Joel Bernstein
Solr 6.0, feel free to post the Expression you're using and I or other people can help debug the issue. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Apr 26, 2016 at 2:29 PM, sudsport s wrote: > I see that some work was done to remove stream handler form config. so > enabli

Re: Many to Many Mapping with Solr

2016-04-29 Thread Joel Bernstein
We really still need to know more about your use case. In particular what types of questions will you be asking of the data? It's useful to do this in plain english without mapping to any specific implementation. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 29, 2016 at 9:

Re: Decide on facets from results

2016-04-29 Thread Joel Bernstein
6.1 Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Apr 29, 2016 at 10:38 AM, Mark Robinson wrote: > Thanks much everyone! > Appreciate your responses. > > Best, > Mark > > On Thu, Apr 28, 2016 at 10:52 AM, Jay Potharaju > wrote: > > > On the same lines

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-01 Thread Joel Bernstein
Can you post your stack trace? I suspect this has to do with how the Streaming API is interacting with SolrCloud. We can probably also create a jira ticket for this. Joel Bernstein http://joelsolr.blogspot.com/ On Sun, May 1, 2016 at 4:02 AM, Ryan Yacyshyn wrote: > Hi all, > > I&#x

Re: Streaming expression for suggester

2016-05-01 Thread Joel Bernstein
This is the type of thing that Streaming Expressions does well, but there isn't one yet for the suggester. Feel free to add a SuggestStream jira ticket, it should be very easy to add. Joel Bernstein http://joelsolr.blogspot.com/ On Sat, Apr 30, 2016 at 6:30 AM, Pranaya Behera wrote:

Re: solr sql & streaming

2016-05-01 Thread Joel Bernstein
It appears that you are not formatting the streaming expression properly. Can you post your entire http request? Joel Bernstein http://joelsolr.blogspot.com/ On Sun, May 1, 2016 at 2:01 PM, Chaushu, Shani wrote: > Yes I'm running in solr cloud mode. > I managed to make the query wo

Re: Streaming expression for suggester

2016-05-01 Thread Joel Bernstein
Sure take a look at the RandomStream. You can copy the basic structure of it but have it work with the suggester. The link below shows the test cases as well: https://github.com/apache/lucene-solr/commit/7b5f12e622f10206f3ab3bf9f79b9727c73c6def Joel Bernstein http://joelsolr.blogspot.com/ On

Re: solr sql & streaming

2016-05-02 Thread Joel Bernstein
Try putting quotes around the fl parameter. search(collections_test, q="*:*", fl="id,name,inStock", sort="id asc") Joel Bernstein http://joelsolr.blogspot.com/ On Mon, May 2, 2016 at 2:09 AM, Chaushu, Shani wrote: > U tri

Re: solr sql & streaming

2016-05-02 Thread Joel Bernstein
back to the client. In branch_6x this is fixed. You can still see the root cause in the logs in both Solr 6.0 and 6.1. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, May 2, 2016 at 9:05 AM, Chaushu, Shani wrote: > It worked! > thanks > > -Original Message----- > F

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-02 Thread Joel Bernstein
()) { Joel Bernstein http://joelsolr.blogspot.com/ On Mon, May 2, 2016 at 10:06 PM, Ryan Yacyshyn wrote: > Yes stack trace can be found here: > > http://pastie.org/10821638 > > > > On Mon, 2 May 2016 at 01:05 Joel Bernstein wrote: > > > Can you post your stack t

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-03 Thread Joel Bernstein
I'll look into this today. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 3, 2016 at 9:22 AM, Kevin Risden wrote: > What I think is happening is that since the CloudSolrClient is from the > SolrCache and the collection was reloaded. zkStateReader is actually null > sinc

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-03 Thread Joel Bernstein
the StreamHandler. So I think the correct fix is to create the SolrClientCache in inform(), that way it will get recreated with each reload. As long as the closeHook has closed the existing SolrClientCache this shouldn't cause any connection leaks with reloads. Joel Bernstein

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-03 Thread Joel Bernstein
I opened SOLR-9059. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 3, 2016 at 10:31 AM, Joel Bernstein wrote: > What I believe is happening is that the core is closing on the reload, > which is triggering the closeHook and shutting down all the connections in > SolrCl

Re: Parallel SQL Interface returns "java.lang.NullPointerException" after reloading collection

2016-05-03 Thread Joel Bernstein
Ryan, there is a patch (for the master branch) up on SOLR-9059 that resolves the issue. This will be in 6.1 and 6.0.1 if there is one. Thanks for the bug report! Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 3, 2016 at 10:41 AM, Joel Bernstein wrote: > I opened SOLR-9059. >

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread Joel Bernstein
ering if you're tripping a ClassNotFoundException once the parsing of the json result comes back. I've seen instances where ClassNotFoundExceptions get swallowed. Can you post your classpath? Joel Bernstein http://joelsolr.blogspot.com/ On Thu, May 5, 2016 at 4:57 AM, deniz wrote: >

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-05 Thread Joel Bernstein
adata Tuple. The error you are seeing will occur if the metadata Tuple is not present or if the first Tuple is null. My guess is the first Tuple is null do to a ClassNotFoundException which is getting swallowed up during the parse. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, May 5, 2016 at 8:

Re: collection alias and solr streaming expression

2016-05-05 Thread Joel Bernstein
Yes, this needs to be supported. If you open up a ticket, I'll be happy to review. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, May 5, 2016 at 2:24 PM, sudsport s wrote: > I tried to run solr streaming expression using collection alias , I get > null pointer expression. af

Re: Re-ranking query: issue with sort criteria and how to disable it

2016-05-06 Thread Joel Bernstein
f the ReRanker. I think it's a good idea but it's not implemented yet. I'm not sure if anyone has any ideas about conditionally adding the ReRanker using configurations? Joel Bernstein http://joelsolr.blogspot.com/ On Fri, May 6, 2016 at 4:10 AM, Andrea Gazzarini wrote: > Hi guys,

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-06 Thread Joel Bernstein
client appears to be from the 6.0 release but the server could be an older version. The reason I ask this, is that older versions of the /sql handler don't have the metadata Tuple logic. So the query would be processed correctly but the metadata Tuple wouldn't be there. Joel Bern

Re: Re-ranking query: issue with sort criteria and how to disable it

2016-05-06 Thread Joel Bernstein
ack on the secondary score sort or remove the reRanker. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, May 6, 2016 at 1:39 PM, Andrea Gazzarini wrote: > Hi Joel, > many thanks for the response and sorry for this late reply. > > About the first question, I can open a JIRA

Re: Filtering on nGroups

2016-05-06 Thread Joel Bernstein
You may want to check this out: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=62693238 It does aggregations that might work for you. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, May 6, 2016 at 2:31 PM, Nick Vasilyev wrote: > I guess it would also work if I co

Re: CloudSolrStream returns only top 30 results.

2016-05-09 Thread Joel Bernstein
r and uses the default rows and start. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, May 9, 2016 at 7:16 AM, Roshan Kamble < roshan.kam...@smartstreamrdu.com> wrote: > Hello, > > I have a plan to use streaming API for join queries. > > But it has been observed that C

Re: Solr 6 / Solrj RuntimeException: First tuple is not a metadata tuple

2016-05-09 Thread Joel Bernstein
Yes, /sql has been in trunk / master for a long time (more then 6 months). But it was not released in the 5x branch because it requires Java 8. I'm wondering what the issue is with the server setup that you have that is throwing the NPE. Joel Bernstein http://joelsolr.blogspot.com/ On Mon

Re: Streaming expressions join operations

2016-05-09 Thread Joel Bernstein
Hi, The example in the cwiki would require setting up the people and pets collections. Unless I'm mistaken this won't work with the out of the box schemas. So you'll need to setup some test schemas to get started. Although having out of the box streaming schemas is a great idea.

Re: Streaming expressions join operations

2016-05-09 Thread Joel Bernstein
The example is using two collections: people and pets. So these collections would need to be present for the join expression to work. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, May 9, 2016 at 10:43 PM, Ryan Cutter wrote: > Thanks Joel, I added the personId and ownerId fields bef

Re: Streaming expressions join operations

2016-05-10 Thread Joel Bernstein
Can you post the entire stack trace? I'd like to see what line the NPE is coming from. The line you pasted in is coming from the wrapper exception I believe. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 10, 2016 at 12:30 AM, Ryan Cutter wrote: > Yes, the people collection

Re: Streaming expressions join operations

2016-05-10 Thread Joel Bernstein
The block of code the NPE is coming from is where the collection nodes are being gathered for the query. So this points to some issue with the cloud setup or the query. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, May 10, 2016 at 9:52 AM, Joel Bernstein wrote: > Can you post the ent

Re: Collapsing Query Parser returns one record per shard...was not expecting this...

2015-08-03 Thread Joel Bernstein
same shard. We should make this clear in the documentation. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Aug 3, 2015 at 4:20 PM, Peter Lee wrote: > From my reading of the solr docs (e.g. > https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results >

Re: Collapsing Query Parser returns one record per shard...was not expecting this...

2015-08-03 Thread Joel Bernstein
fields with an accurate group count. If you don't need ngroups, then Grouping is usually just as fast if not faster. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Aug 3, 2015 at 10:14 PM, Joel Bernstein wrote: > Your findings are the expected behavior for the Collapsing qpar

Re: Streaming API running a simple query

2015-08-07 Thread Joel Bernstein
em so we can get all the error messages covered. Thanks, Joel Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Aug 7, 2015 at 6:19 AM, Selvam wrote: > Hi, > > Sorry, it is working now. > > curl --data-urlencode > 'stream=search(gettingstarted,q="*:*",fl=&

Re: Streaming API running a simple query

2015-08-08 Thread Joel Bernstein
Can you describe your use case? Joel Bernstein http://joelsolr.blogspot.com/ On Sat, Aug 8, 2015 at 7:36 AM, Selvam wrote: > Hi, > > Thanks, good to know, in fact my requirement needs to merge multiple > expressions, while current streaming expressions supports only two > exp

Re: Streaming API running a simple query

2015-08-08 Thread Joel Bernstein
This sounds doable using nested merge functions like this: merge(search(...), merge(search(...), search(),...), ...) Joel Bernstein http://joelsolr.blogspot.com/ On Sat, Aug 8, 2015 at 8:08 AM, Selvam wrote: > Hi, > > I needed to run a multiple subqueries each with its own

Re: Performance warning overlapping onDeckSearchers

2015-08-12 Thread Joel Bernstein
You'll want to check to see if there are any static warming queries being run as well. How often are you committing and opening a new searcher? Are you using autoCommits or explicitly committing? Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Aug 12, 2015 at 3:57 AM, Adrian Liew

Re: Collapse & Expand

2015-08-22 Thread Joel Bernstein
Can you explain your use case a little more? Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Aug 21, 2015 at 5:43 PM, Kiran Sai Veerubhotla wrote: > how can i use collapse & expand on the docValues with json facet api? >

Re: Merging documents from a distributed search

2015-09-02 Thread Joel Bernstein
The merge strategy probably won't work for the type of distributed collapse you're describing. You may want to begin exploring the Streaming API which supports real-time map/reduce operations, http://joelsolr.blogspot.com/2015/03/parallel-computing-with-solrcloud.html Joel Bern

Re: Merging documents from a distributed search

2015-09-04 Thread Joel Bernstein
things like fully distributed grouping. How many records are processed in a typical query and what type of response time do you need? Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 3, 2015 at 3:25 PM, tedsolr wrote: > Thanks Joel, that link looks promising. The CloudSolrStream bypasse

Re: Question related to reranking and RankQuery

2015-09-18 Thread Joel Bernstein
own RankQuery should be the last resort if you can't make a Function Query do what you need to do. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Sep 17, 2015 at 10:44 PM, Ajinkya Kale wrote: > Hi all, > > I am new to Solr. I have a QParser plugin which uses an imple

Re: Question related to reranking and RankQuery

2015-09-18 Thread Joel Bernstein
The syntax would be something like this: q=hello+world&rq={!rerank reRankQuery=$rqq reRankDocs=100}&rqq={!func}myFunc() I'm not sure if there is a test case demonstrating this but it should work. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Sep 18, 2015 at 2:42 PM, Ajinky

Re: faceting is unusable slow since upgrade to 5.3.0

2015-09-21 Thread Joel Bernstein
Have you looked at your Solr instance with a cpu profiler like YourKit? It would be useful to see the hotspots which should be really obvious with 20 second response times. Also are you running in distributed mode or on a single Solr instance? Joel Bernstein http://joelsolr.blogspot.com/ On Mon

Re: faceting is unusable slow since upgrade to 5.3.0

2015-09-22 Thread Joel Bernstein
Can you also try testing with one facet at a time and see if we hit a particular facet that is slow? Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Sep 22, 2015 at 9:36 AM, Uwe Reh wrote: > The exact version as shown by the UI is: > - solr-impl 5.3.0 1696229 - noble - 2015-08-17

Re: Expand Component Fields Response

2015-11-17 Thread Joel Bernstein
Hi Marshall, This sounds pretty reasonable. I should have some to review the patch later in the week. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Nov 17, 2015 at 3:42 PM, Sanders, Marshall (AT - Atlanta) < marshall.sand...@autotrader.com> wrote: > Well I didn't receive

Re: Parallel SQL / calcite adapter

2015-11-19 Thread Joel Bernstein
It's an interesting question. The JDBC driver is still very basic. It would depend on how much of the JDBC spec needs to be implemented to connect to Calcite/Drill. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Nov 19, 2015 at 3:28 AM, Kai Gülzau wrote: > > We are currently

Re: Parallel SQL / calcite adapter

2015-11-20 Thread Joel Bernstein
After reading https://calcite.apache.org/docs/tutorial.html, I think it should be possible to use the Solr's JDBC Driver with Calcites JDBC adapter. If you give it a try and run into any problems, please create a jira. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Nov 19, 2015 at 7:

Re: Joins with SolrCloud

2015-12-11 Thread Joel Bernstein
restaurantId" ) The parallel function will return the tuples from the innerJoin which is performed on 20 workers in this example. The worker nodes will be selected from "workerCollection" which can be any SolrCloud collection with enough nodes. The "partitionKeys" parameter ha

Re: rankquery usage bug?

2015-02-20 Thread Joel Bernstein
Ryan, This looks like a good jira ticket to me. Joel Bernstein Search Engineer at Heliosearch On Fri, Feb 20, 2015 at 6:40 PM, Ryan Josal wrote: > Hey guys, I put a rq in defaults but I can't figure out how to override it > with no rankquery. Looks like one option might be checkin

Re: ExpandComponent not expanding

2015-03-06 Thread Joel Bernstein
The expand component only displays the groups heads when it finds expanded documents in the group. And it only expands for the current page. Are you finding situations where there are group heads on the page, that have child documents that are not being expanded? Joel Bernstein Search Engineer

Re: Collapse and Expand behaviour on result with 1 document.

2015-03-30 Thread Joel Bernstein
The expanded section will only include groups that have expanded documents. So, if the document that in the main result set has no documents to expand, then this is working as expected. Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Mar 30, 2015 at 8:43 PM, Derek Poh wrote: > Hi &g

Re: Collapse and Expand behaviour on result with 1 document.

2015-03-31 Thread Joel Bernstein
You should be able to use collapse/expand with one result. Does the document in the main result set have group members that aren't being expanded? Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Mar 31, 2015 at 2:00 AM, Derek Poh wrote: > If I want to group the results (by a

Re: Collapse and Expand behaviour on result with 1 document.

2015-03-31 Thread Joel Bernstein
there is an expanded group. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Mar 31, 2015 at 7:37 AM, Joel Bernstein wrote: > You should be able to use collapse/expand with one result. > > Does the document in the main result set have group members that aren't > being expan

Re: Collapse and Expand behaviour on result with 1 document.

2015-04-01 Thread Joel Bernstein
Exactly correct. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 1, 2015 at 5:44 AM, Derek Poh wrote: > Hi Joel > > Correct me if my understanding is wrong. > Using supplier id as the field to collapse on. > > - If thecollapse group heads inthe main result set has

Re: Collapse and Expand behaviour on result with 1 document.

2015-04-07 Thread Joel Bernstein
release. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Apr 7, 2015 at 3:27 AM, Derek Poh wrote: > Hi Joel > > Is the number of documents info available when using collapse and expand > parameters? > > I can't seem to find it in the return xml. > I know the numFound

Re: rq breaks wildcard search?

2015-04-22 Thread Joel Bernstein
This should be resolved in https://issues.apache.org/jira/browse/SOLR-6323. Solr 4.10.3 Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 15, 2015 at 6:23 PM, Ryan Josal wrote: > Using edismax, supplying a rq= param, like {!rerank ...} is causing an > UnsupportedOperationExc

Re: rq breaks wildcard search?

2015-04-22 Thread Joel Bernstein
Just confirmed that wildcard queries work with Re-Ranking following SOLR-6323. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Apr 22, 2015 at 7:26 PM, Joel Bernstein wrote: > This should be resolved in https://issues.apache.org/jira/browse/SOLR-6323 > . > > Solr 4.10.3 > &

Re: rq breaks wildcard search?

2015-04-22 Thread Joel Bernstein
For your own implementation you'll need to implement the following methods: public Query rewrite(IndexReader reader) throws IOException public void extractTerms(Set terms) You can review the 4.10.3 version of the ReRankQParserPlugin to see how it implements these methods. Joel Bernstein

  1   2   3   4   5   6   7   8   >