Re: Accessing Solr collections at different ports - Need help

2019-05-02 Thread Salmaan Rashid Syed
Thanks Jorn for your reply. I say that the nodes are limited to 4 because when I launch Solr in cloud mode, the first prompt that I get is to choose number of nodes [1-4]. When I tried to enter 7, it says that they are more than 4 and choose a smaller number. *Thanks and Regards,* Salmaan Rashid

Re: Accessing Solr collections at different ports - Need help

2019-05-02 Thread Salmaan Rashid Syed
Thanks Walter, Since I am new to Solr and by looking at your suggestion, it looks like I am trying to do something very complicated and out-of-box capabilities of Solr. I really don't want to do that. I am not from Computer Science background and my specialisation is in Analytics and AI. Let me

Re: Accessing Solr collections at different ports - Need help

2019-05-02 Thread Jörn Franke
BTW why do you think that SolrCloud is limited to 4 nodes? More are for sure possible. > Am 03.05.2019 um 07:54 schrieb Salmaan Rashid Syed > : > > Hi Solr Users, > > I am using Solr 7.6 in cloud mode with external zookeeper installed at > ports 2181, 2182, 2183. Currently we have only one ser

Re: Accessing Solr collections at different ports - Need help

2019-05-02 Thread Jörn Franke
You can have dedicarse clusters per Client and/or you can protect it via Kerberos or Basic Auth or write your own authorization plugin based on OAuth. I am not sure why you want to offer this on different ports to different clients. > Am 03.05.2019 um 07:54 schrieb Salmaan Rashid Syed > : > >

Re: Accessing Solr collections at different ports - Need help

2019-05-02 Thread Walter Underwood
The best option is to run all the collections at the same port. Intra-cluster communication cannot be split over multiple ports, so this would require big internal changes to Solr. And what about communication that does not belong to a collection, like electing an overseer node? Why do you want

Accessing Solr collections at different ports

2019-05-02 Thread Salmaan Rashid Syed
Hi Solr Users, I am using Solr 7.6 in cloud mode with external zookeeper installed at ports 2181, 2182, 2183. Currently we have only one server allocated for Solr. We are planning to move to multiple servers for better sharing, replication etc in near future. Now the issue is that, our organis

Accessing Solr collections at different ports - Need help

2019-05-02 Thread Salmaan Rashid Syed
Hi Solr Users, I am using Solr 7.6 in cloud mode with external zookeeper installed at ports 2181, 2182, 2183. Currently we have only one server allocated for Solr. We are planning to move to multiple servers for better sharing, replication etc in near future. Now the issue is that, our organisati

Re: Reverse-engineering existing installation

2019-05-02 Thread David Smiley
Consider trying to diff configs from a default at the version it was copied from, if possible. Even better, the configs should be in source control and then you can browse history with commentary and sometimes links to issue trackers and code reviews. Also a big part that you can’t see by staring

Re: Reverse-engineering existing installation

2019-05-02 Thread Alexandre Rafalovitch
My presentation from 2016 may be interesting as I deconstruct a Solr example, including the tips/commands on how to do so: https://www.slideshare.net/arafalov/rebuilding-solr-6-examples-layer-by-layer-lucenesolrrevolution-2016 The commands start around the slide 20. Hope this helps, Alex. P.s

Reverse-engineering existing installation

2019-05-02 Thread Doug Reeder
The documentation for SOLR is good. However it is oriented toward setting up a new installation, with the data model known. I have inherited an existing installation. Aspects of the data model I know, but there's a lot of ways things could have been configured in SOLR, and for some cases, I don'

Re: Why did Solr stats min/max values were returned as float number for field of type="pint"?

2019-05-02 Thread Joel Bernstein
This syntax is bringing back correct data types: rows=0&version=2&q=stock_s:10&stats=true&NOW=1556849474583&isShard=true&wt=javabin&stats.field={!max=true }id_i&stats.field={!max=true }response_d This is the query that the stats Stream Expressions writes under the covers. The Streaming Expression

Why did Solr stats min/max values were returned as float number for field of type="pint"?

2019-05-02 Thread Wendy2
Hi Solr users, I have a pint field: But Solr stats min/max values were returned as float numbers ( "min":0.0, "max":1356.0) . I thought "pint" type fields should return min/max as int. Is there something that user can do to make sure it returns as int type (which matches the field definition)?

Re: SolrPlugin update existing documents in newSearcher()

2019-05-02 Thread Jan Høydahl
I think you cannot do that. The callback is sent AFTER a searcher is opened on the segment, so the index is already there. Normally you re-index from source if you need changes in schema or processing. If that is not possible, you must first check if ALL your fields are stored or docValues, if no

Re: SolrPlugin update existing documents in newSearcher()

2019-05-02 Thread Maria Muslea
Yes, I will want to also do that, but initially I need to modify the docs that are already in SOLR, and I thought of doing that at startup. I am able to get the documents that I would like to modify, but the operations for modifying the documents don't seem to be doing anything. Do you see anythin

Re: problem indexing GPS metadata for video upload

2019-05-02 Thread Tim Allison
Sorry build #182: https://builds.apache.org/job/tika-branch-1x/ On Thu, May 2, 2019 at 12:01 PM Tim Allison wrote: > > I just pushed a fix for TIKA-2861. If you can either build locally or > wait a few hours for Jenkins to build #182, let me know if that works > with straight tika-app.jar. > > O

Re: problem indexing GPS metadata for video upload

2019-05-02 Thread Tim Allison
I just pushed a fix for TIKA-2861. If you can either build locally or wait a few hours for Jenkins to build #182, let me know if that works with straight tika-app.jar. On Thu, May 2, 2019 at 5:00 AM Where is Where wrote: > > Thank you Alex and Tim. > I have looked at the solrconfig.xml file (I a

Re: Potential authorization bug when making HTTP requests

2019-05-02 Thread Jan Høydahl
Fixed in 6.6.6 and 7.7, please upgrade https://lucene.apache.org/solr/news.html https://issues.apache.org/jira/browse/SOLR-12514 -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.c

Re: Status of solR / HDFS-v3 compatibility

2019-05-02 Thread Nicolas Paris
Thanks kevin, and also thanks for your blog on hdfs topic > https://risdenk.github.io/2018/10/23/apache-solr-running-on-apache-hadoop-hdfs.html On Thu, May 02, 2019 at 09:37:59AM -0400, Kevin Risden wrote: > For Apache Solr 7.x or older yes - Apache Hadoop 2.x was the dependency. > Apache Solr 8.

Re: Status of solR / HDFS-v3 compatibility

2019-05-02 Thread Kevin Risden
For Apache Solr 7.x or older yes - Apache Hadoop 2.x was the dependency. Apache Solr 8.0+ has Hadoop 3 compatibility with SOLR-9515. I did some testing to make sure that Solr 8.0 worked on Hadoop 2 as well as Hadoop 3, but the libraries are Hadoop 3. The reference guide for 8.0+ hasn't been releas

Status of solR / HDFS-v3 compatibility

2019-05-02 Thread Nicolas Paris
Hi solr doc [1] says it's only compatible with hdfs 2.x is that true ? [1]: http://lucene.apache.org/solr/guide/7_7/running-solr-on-hdfs.html -- nicolas

Re: Pagination with streaming expressions

2019-05-02 Thread Joel Bernstein
There is an open ticket which deals with this: https://issues.apache.org/jira/browse/SOLR-12209 I've been very focused though on anything that enhances the Solr Math Expressions or has been needed for the Fusion SQL engine, which is what I work on at LucidWorks. SOLR-12209 doesn't fall into that

JSON Facet Count All Information

2019-05-02 Thread Furkan KAMACI
Hi, I have a multivalued field at which I store some metadata. I want to see top 4 metadata at my documents and also total metadata count. I run that query: q=metadata:[*+TO+*]&rows=0&json.facet={top_tags:{type:terms,field:metadata,limit:4,mincount:1}} However, how can I calculate total term cou

Re: Determing Solr heap requirments and analyzing memory usage

2019-05-02 Thread Erick Erickson
Brian: Many thanks for letting us know what you found. I’ll attach this to SOLR-13003 which is about this exact issue but doesn’t contain this information. This is a great help. > On May 2, 2019, at 6:15 AM, Brian Ecker wrote: > > Just to update here in order to help others that might run in

Potential authorization bug when making HTTP requests

2019-05-02 Thread adfel70
Atuhorization bug (?) when making HTTP requests We are experiencing a problem when making HTTP requests to a cluster with authorization plugin enabled. Permissions are configured in security.json the following: { ... authentication_settings ... "authorization":{ "class":"solr.RuleBasedAuthor

Re: SolrPlugin update existing documents in newSearcher()

2019-05-02 Thread Jan Høydahl
Hi I don't see your requirement clearly. Sounds like what you really need is an UpdateRequestProcessor where you CAN intercept docs being added and modify them as you wish. https://lucene.apache.org/solr/guide/7_7/update-request-processors.html -- Jan Høydahl, search solution architect Cominve

Re: Update Solr 7.7 Reference Guide graceTime -> graceDuration

2019-05-02 Thread Jan Høydahl
Thanks. Actually you may edit the page and submit a GitHub PullRequest directly if you wish at https://github.com/apache/lucene-solr/blob/master/solr/solr-ref-guide/src/solrcloud-autoscaling-triggers.adoc

Re: Determing Solr heap requirments and analyzing memory usage

2019-05-02 Thread Brian Ecker
Just to update here in order to help others that might run into similar issues in the future, the problem is resolved. The issue was caused by the queryResultCache. This was very easy to determine by analyzing a heap dump. In our setup we had the following config: In reality this maxRamMB="3072"

Re: problem indexing GPS metadata for video upload

2019-05-02 Thread Where is Where
Thank you Alex and Tim. I have looked at the solrconfig.xml file (I am trying the techproducts demo config), the only related place I can find is the extract handle true true links ignored_ I am using this command bin/post -c techproducts examp