Integrating Solr with my existing java web application

2019-10-31 Thread Khare, Kushal (MIND)
Hello mates ! Hope you people are doing good ! Well, I am trying to integrate the SolrJ code for indexing and querying the documents through Solr with my java web app. I am facing a very wired issue, that when I run my method for Solr as java app (independently using main() function) it works f

Query on stemming

2019-10-31 Thread Shubham Goswami
Hello Community I am using a filter class EnglishPorterFilterFactory for stemming filter but because of usage of this class, my solr is not able reload the schema. Can somebody please let me know what exactly this class does and how can i implement stemming ? Any help will be appreciated. Thanks

Security Vulnerability Consultation

2019-10-31 Thread Huawei PSIRT
Dear, This is Huawei PSIRT. We have learned that a security researcher released an Apache Solr RCE suspected vulnerability on October 31, 2019. The links are as follow: https://meterpreter.org/unpatch-apache-solr-remote-c

Use copyField with wildcard in source; how then to work out where a value came from?

2019-10-31 Thread Richard Walker
I've got a collection for which the schema has a number of copyFields that have a wildcard in the source: The idea is that I have fields in each document that contain language-specific values in fields that have field names that end in a language tag, i.e., "skos_prefLabel-en", "skos_prefLabel

Solr 7.6.0 High CPU Usage Deadlock (Generating 70% of futex system call)

2019-10-31 Thread Daniel de Oliveira Mantovani
I have a Solr 7.6.0 Cloud with 4 nodes and while indexing Solr hangs. $ java -version java version "1.8.0_231" Java(TM) SE Runtime Environment (build 1.8.0_231-b11) Java HotSpot(TM) 64-Bit Server VM (build 25.231-b11, mixed mode $ sudo strace -f -c -p 5972 % time seconds usecs/call calls

Re: avgFieldLength calculation in BM25 in solr 7.4

2019-10-31 Thread Edward Ribeiro
Hi, Looking at the source code and term frequencies, it looks like: fieldLength = number of tokens prior to ngram filter processing avgFieldLength = / As you are using n-gram then 11 is the total number of terms while fieldLegth is 2. See: https://lucene.apache.org/core/7_4_0/core/org/apache

Re: Autoscaling in 8.2

2019-10-31 Thread Jörn Franke
You can have replication policies if you don’t want to replicate manually, but automatically: https://lucene.apache.org/solr/guide/7_1/solrcloud-autoscaling-auto-add-replicas.html >> Am 31.10.2019 um 15:55 schrieb Pranaya Behera : > So my setup is this: > 1 node > 1 collection (created via col

Re: Autoscaling in 8.2

2019-10-31 Thread Erick Erickson
So you want the new node to host some part of the original collection, right? use the Collections API ADDREPLICA or MOVEREPLICA commands is the easiest. Best, Erick > On Oct 31, 2019, at 10:55 AM, Pranaya Behera wrote: > > So my setup is this: > 1 node > 1 collection (created via collection AP

Re: Autoscaling in 8.2

2019-10-31 Thread Pranaya Behera
So my setup is this: 1 node 1 collection (created via collection API) 1 shard 1 replica This node is connected to zookeeper. Now let's say I added one more node to the zookeeper, this node is new, hence there won't be any collection created for me automatically. It is a barebane node i.e. connecte

Re: DIH across two SQL DBs

2019-10-31 Thread Jan Høydahl
Hmm, I'll have a look, but the SELECT is a bit more involved so the IDs from the other DB will be OR'ed into the WHERE clause, i.e. be added to those selected from other part of the where clause, so it's not a pure join. I'll think some more -- Jan Høydahl, search solution architect Cominvent A

Re: DIH across two SQL DBs

2019-10-31 Thread Mikhail Khludnev
Hello, Jan. Have you considered join="zipper" ? On Thu, Oct 31, 2019 at 12:52 AM Jan Høydahl wrote: > I need a SELECT which filters IDS based on an ‘id’ list coming from > another database, i.e. SELECT * FROM maindb.maintable WHERE id IN (SELECT > myid FROM otherdb.other_table). > > The docs ar

Re: Autoscaling in 8.2

2019-10-31 Thread Jörn Franke
You need to create a replica of the collection on the other node: https://lucene.apache.org/solr/guide/6_6/collections-api.html See addreplica >> Am 31.10.2019 um 09:46 schrieb Pranaya Behera : > Hi, > I have one node started with solrcloud. I have created one collection > with the defaul

Re: Autoscaling in 8.2

2019-10-31 Thread Erick Erickson
I really don’t understand the question. If you’ve created a new collection, presumably it’s got a different name, correct? So you need to send some documents to that collection and then query it for it to “do any work”. I.e. http://localhost:8983/solr/original_collection/update…. http://localho

avgFieldLength calculation in BM25 in solr 7.4

2019-10-31 Thread Pedro Sousa
Hello all, I have a standard solr 7.4 installation and i have a question regarding how BM25 similarity is computed. Here is an example to describe my question 1. create core `test_core` 2. add to `test_core/conf/managed-schema`: the following field and fieldType

Autoscaling in 8.2

2019-10-31 Thread Pranaya Behera
Hi, I have one node started with solrcloud. I have created one collection with the default configsets. When I am creating another node joining the same cluster i.e. zookeeper chroot, is there any way to create the collection ? Currently it is just sitting idle, not doing any work. In the docum

DIH across two SQL DBs

2019-10-31 Thread Jan Høydahl
I need a SELECT which filters IDS based on an ‘id’ list coming from another database, i.e. SELECT * FROM maindb.maintable WHERE id IN (SELECT myid FROM otherdb.other_table). The docs are fetched from a MySql DB while the list of IDs to includ in that first SELECT WHERE statement is fetched fro