Re: IndexMergeTool to adhere to TieredMergePolicyFactory settings

2017-12-01 Thread Zheng Lin Edwin Yeo
Hi, Is it possible for the merging not to merge to one large segment? Regards, Edwin On 28 November 2017 at 12:05, Zheng Lin Edwin Yeo wrote: > Hi, > > I'm currently using Solr 6.5.1. > > I found that in the IndexMergeTool.java, we found that there is this line > which set the maxNumSegments

Solr score use cases

2017-12-01 Thread Faraz Fallahi
Hi A simple question: what are the most common use cases for the solr score of documents retrieved after firing queries? I dont have a real understanding of its purpose at the moment. Thx for helping

Range facet over currency field

2017-12-01 Thread Aman Tandon
Hi, I have a doubt regarding how to do the range facet on some different currency. I have indexed the price data in USD inside the field price_usd_c and I have currency.xml which is getting generated by a process. If I want to do the range facet on the field price_usd_c in Euro currency, then ho

Passing Metadata from an RTF-file via TIKA to SOLR ...

2017-12-01 Thread Jan . Christopher . Schluchtmann-EXT
Hi there! I am quite new to Lucene/Solr/Tika, etc., so I would appreciate you help concerning the following matter. I have a RTF-document, that I want to index in Solr, using Tika. The RTF-indexing works in general, but since I changed the Solr-schema, the indexer complains about missing mandat

Re: Solr score use cases

2017-12-01 Thread Aman Tandon
Hi Faraz, Solr score which you could retrieved by adding in fl parameter could be helpful to understand the following: 1) search relevance ranking: how much score solr has given to the top & second top document, and with debug=true you could better understand what is causing that score. 2) You c

Re: Solr score use cases

2017-12-01 Thread Faraz Fallahi
Oki but If ID Just make an simple query with a "where Claude" and sort by a field i See no sense in calculating a score right? Am 01.12.2017 16:33 schrieb "Aman Tandon" : > Hi Faraz, > > Solr score which you could retrieved by adding in fl parameter could be > helpful to understand the following:

Re: Solr score use cases

2017-12-01 Thread Faraz Fallahi
Or does the Score even get calculated when i sort or Not? Am 01.12.2017 4:38 nachm. schrieb "Faraz Fallahi" < faraz.fall...@googlemail.com>: > Oki but If ID Just make an simple query with a "where Claude" and sort by > a field i See no sense in calculating a score right? > > Am 01.12.2017 16:33 s

JVM GC Issue

2017-12-01 Thread Dominique Bejean
Hi, We are encountering issue with GC. Randomly nearly once a day there are consecutive full GC with no memory reclaimed. So the old generation heap usage grow up to the limit. Solr stop responding and we need to force restart. We are using Solr 6.6.1 with Oracle 1.8 JVM. The JVM settings are

Re: Solr LTR plugin - Training

2017-12-01 Thread ilayaraja
Also, when I want to add phrase match as a feature as below, it does not support it: { "store" : "tsf", "name" : "productTitleMatchGuestQuery", "class" : "org.apache.solr.ltr.feature.SolrFeature", "params" : { "q" : "{!dismax qf=p_title^1.0}${user_query}" } }, { "store" : "tsf

Re:LTR model upload

2017-12-01 Thread Christine Poerschke (BLOOMBERG/ QUEEN VIC)
Hi Brian, Thank you for this question! It sounds like you may be experiencing the issue reported in https://issues.apache.org/jira/browse/SOLR-11049 and perhaps the same workaround could work for you? And in the upcoming Solr 7.2 release https://issues.apache.org/jira/browse/SOLR-11250 will pr

Re: JVM GC Issue

2017-12-01 Thread Toke Eskildsen
Dominique Bejean wrote: > We are encountering issue with GC. > Randomly nearly once a day there are consecutive full GC with no memory > reclaimed. [... 1.2M docs, Xmx 6GB ...] > Gceasy suggest to increase heap size, but I do not agree It does seem strange, with your apparently modest index &

Request return behavior when trigger DataImportHandler updates

2017-12-01 Thread Nathan Friend
Hello, When triggering the DataImportHandler to update via an HTTP request, I've noticed the handler behaves differently depending on how I specify the request parameters. If I use query parameters, e.g. http://localhost:8983/solr/mycore/dataimport?command=full-import, the HTTP request is not

Re: Fwd: solr-security-proxy

2017-12-01 Thread Rick Leir
The default blacklist is qt and stream, because there are examples of nasty things which can be done using those parms. But it seems much wiser to whitelist just the parms your web app needs to use. Am I missing something? Is there a simpler way to protect a Solr installation which just serves a

starting SolrCloud nodes

2017-12-01 Thread Steve Pruitt
Thanks to previous help. I have a ZK ensemble of three nodes running. I have uploaded the config for my collection and the solr.xml file. I have Solr installed on three machines. I think my next steps are: Start up each Solr instance: bin/solr start -c -z "zoo1:2181,zoo2:2181,zoo3:2181" //

Re: JVM GC Issue

2017-12-01 Thread Erick Erickson
Your autowarm counts are rather high, bit as Toke says this doesn't seem outrageous. I have seen situations where Solr is running close to the limits of its heap and GC only reclaims a tiny bit of memory each time, when you say "full GC with no memory reclaimed" is that really no memory _at all_?

Re: starting SolrCloud nodes

2017-12-01 Thread Erick Erickson
Looks good. If you set ZK_HOST in your solr.in.sh you can forgo setting it when you start, but that's not necessary. Best, Erick On Fri, Dec 1, 2017 at 9:13 AM, Steve Pruitt wrote: > Thanks to previous help. I have a ZK ensemble of three nodes running. I > have uploaded the config for my coll

Re: [EXTERNAL] - Re: Basic SolrCloud help

2017-12-01 Thread Shawn Heisey
On 11/30/2017 8:53 AM, Steve Pruitt wrote: > I took the hint and looked at both solr.in.cmd and solr.in.sh. Clearly > setting ZK_HOST is a first step. I am sure this is explained somewhere, but > I overlooked it. > From here, once I have Solr installed, I can run the Control Script to upload >

Re: Solr score use cases

2017-12-01 Thread Erick Erickson
Sorting certainly ignores scoring, I'm pretty sure it's just not calculated in that case. If your sorting results in multiple documents in the same bin, people will combine the primary sort with a secondary sort on score, so in that case the score is definitely calculated, ie "&sort=day asc, score

Reg:- Indexing MySQL data with Solr

2017-12-01 Thread @Nandan@
Hi , I am working on an Ecommerce database . I have more then 40 tables and around 20GB of data. I want to index data with solr for more effective search feature. Please tell me how to index MySQL data with Apache solr. Thanks in advance Nandan Priyadarshi

Re: Request return behavior when trigger DataImportHandler updates

2017-12-01 Thread Shawn Heisey
On 12/1/2017 9:37 AM, Nathan Friend wrote: > When triggering the DataImportHandler to update via an HTTP request, I've > noticed the handler behaves differently depending on how I specify the > request parameters. > > If I use query parameters, e.g. > http://localhost:8983/solr/mycore/dataimport

Re: Reg:- Indexing MySQL data with Solr

2017-12-01 Thread Sujay Bawaskar
You can use data import handler with cache, its faster. Check document : https://lucene.apache.org/solr/guide/6_6/uploading-structured-data-store-data-with-the-data-import-handler.html On Sat, Dec 2, 2017 at 12:21 AM, @Nandan@ wrote: > Hi , > I am working on an Ecommerce database . I have more

RE: [Marketing Mail] Re: Request return behavior when trigger DataImportHandler updates

2017-12-01 Thread Nathan Friend
Thanks for the reply, Shawn. One additional detail I should have mentioned - in both scenarios, I'm making a POST request, not a GET. Even when using a POST, Solr seems to be able to accept URL query parameters. I'm making test requests using Postman (https://www.getpostman.com/), so it's als

Java 9 and Solr 6.6

2017-12-01 Thread marotosg
HI all. Would you recommend installing Solr 6.6.1 with Java 9 for a production environement? Thanks, Sergio -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Reg:- Indexing MySQL data with Solr

2017-12-01 Thread Erick Erickson
Or, depending on your environment and comfort with Java, use SolrJ. Here's an example: https://lucidworks.com/2012/02/14/indexing-with-solrj/ Best, Erick On Fri, Dec 1, 2017 at 11:22 AM, Sujay Bawaskar wrote: > You can use data import handler with cache, its faster. > > Check document : > https

RE: Re:LTR model upload

2017-12-01 Thread Brian Yee
Thanks Christine, that makes sense. I am currently working around the issue by limiting how many trees Ranklib produces which reduces the file size. --Brian -Original Message- From: Christine Poerschke (BLOOMBERG/ QUEEN VIC) [mailto:cpoersc...@bloomberg.net] Sent: Friday, December 01,

Re: JVM GC Issue

2017-12-01 Thread Dominique Bejean
Hi, Thank you both for your responses. I just have solr log for the very last period of the CG log. Grep command allows me to count queries per minute with hits > 1000 or > 1 and so with the biggest impact on memory and cpu during faceting > 1000 59 11:13 45 11:14 36 1

Re: starting SolrCloud nodes

2017-12-01 Thread Shawn Heisey
On 12/1/2017 10:13 AM, Steve Pruitt wrote: > Thanks to previous help. I have a ZK ensemble of three nodes running. I > have uploaded the config for my collection and the solr.xml file. > I have Solr installed on three machines. > > I think my next steps are: > > Start up each Solr instance: bin

Re: Solr score use cases

2017-12-01 Thread Faraz Fallahi
Thx for the clarification Best regards Am 01.12.2017 18:25 schrieb "Erick Erickson" : > Sorting certainly ignores scoring, I'm pretty sure it's just not > calculated in that case. > > If your sorting results in multiple documents in the same bin, people > will combine the primary sort with a seco

Re: Reg:- Indexing MySQL data with Solr

2017-12-01 Thread Shawn Heisey
On 12/1/2017 11:51 AM, @Nandan@ wrote: > I am working on an Ecommerce database . I have more then 40 tables and > around 20GB of data. > I want to index data with solr for more effective search feature. > Please tell me how to index MySQL data with Apache solr. There are multiple possible ways to

Re: Java 9 and Solr 6.6

2017-12-01 Thread Shawn Heisey
On 12/1/2017 12:32 PM, marotosg wrote: > Would you recommend installing Solr 6.6.1 with Java 9 for a production > environement? Solr 7.x has been tested with Java 9 and should work with no problems.  I believe that code changes were required to achieve this compatibility, so 6.6 might have issues

Re: JVM GC Issue

2017-12-01 Thread Erick Erickson
Doninique: Actually, the memory requirements shouldn't really go up as the number of hits increases. The general algorithm is (say rows=10) Calcluate the score of each doc If the score is zero, ignore If the score is > the minimum in my current top 10, replace the lowest scoring doc in my current