Solr overcluster performance problem

2018-07-06 Thread 苗海泉
Everybody is good, we ran into two solr problem hope can get help, the amount of data is large, we one day 24.5 TB, record number 110 billion, we had used the 49 solr node, the data is not enough memory expanded to more than 100 cluster, we found that the 60 solrcloud performance and the elder brot

Re: how to use HTMLStripCharFilter in solrJ?

2018-07-06 Thread Arturas Mazeika
Hi Alex, I suppose the explanation in [0] (references) did not bring enough of light into the reasons. So I'll try to give additional and more detailed arguments. I can take the HTML text, strip it of HTML tags and index the content. I can store the original text in solr as well. Storing the inte

Re: how to use HTMLStripCharFilter in solrJ?

2018-07-06 Thread Arturas Mazeika
Hi Ahmet, Thanks a lot for the post, details and infos. I've started trying out all the options that you suggested. And... I must say that I am not able to reproduce my error. Which means that even the code that I posted works with flying colors. I am puzzled. Cheers, Arturas On Thu, Jul 5, 2

Re: Maximum number of SolrCloud collections in limited hardware resource

2018-07-06 Thread Sharif Shahriar
Hi Erick, Setting the size parameter to 0 in solrconfig.xml can stop document caching, but it cannot control how much memory it will take initially when creating a collection, right? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Delta import not working with Oracle in Solr

2018-07-06 Thread shruti suri
HI, Please help me with delta import form one oracle table into solr. I don't have any primary key in the table. We need to use composite key using (LOCAL_MASTER_ID,LOCAL_ID). - Regards Shruti -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

increase timeout before zookeeper times out on startup

2018-07-06 Thread Sushant Vengurlekar
I am setting up zookeeper ensemble on aws ecs and due to the difference in time at which all the zookeeper instances come up they timeout during the election process and all of them fail one after another. how can I make sure that there is some delay before they all start or how to increase the tim

Use fqdn instead of IP address with zookeeper ensemble

2018-07-06 Thread Sushant Vengurlekar
I want to use a FQDN of each of the zookeeper instances instead of the IP address in the zookeeper config. has anyone done this before and can point to some examples. Thank you

Re: Indexing part of Binary Documents and not the entire contents

2018-07-06 Thread neotorand
Gus You are never biased. I explored a bit about JesterJ. Looks quite promising. I will keep you posted on my experience to you soon. Regards Neo -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Unbale to Create a Core

2018-07-06 Thread neotorand
Hi List, I am unable to create a core.Unable to figure out what wrong. I get below error. ERROR: Failed to create collection 'XXX' due to: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException:Error from server at http://xyz.com:8983/solr: Error CREATEing SolrCore 'docpocc_sh

Re: Use fqdn instead of IP address with zookeeper ensemble

2018-07-06 Thread Vincenzo D'Amore
Just use the fqdn of each instance in zoo.cfg. For example: server.1=zk-1.example.local:2888:3888 server.2=zk-2.example.local:2888:3888 server.3=zk-3.example.local:2888:3888 On Fri, Jul 6, 2018 at 3:03 PM Sushant Vengurlekar < svengurle...@curvolabs.com> wrote: > I want to use a FQDN of each of

Re: Use fqdn instead of IP address with zookeeper ensemble

2018-07-06 Thread Sushant Vengurlekar
I am doing the same but somehow its not working. I get the following errors Resolved hostname: zk-1.example.local to address: zk-1.example.local/ 172.16.3.85 Cannot open channel to 2 at election address zk-1.example.local/ 172.16.3.85:3888 INFO [QuorumPeer[myid=3]/0.0.0.0:2183:QuorumPeer$Quorum

Hit highlighting

2018-07-06 Thread Dwane Hall
Good evening solr community. I have not had a lot of luck on another community source seeking advice on using the unified highlighter so I thought I'd try my luck with the solr experts. Any recommendations would be appreciated when you get time. Apache Solr 6.4 saw the release of the unified

Re: Delta import not working with Oracle in Solr

2018-07-06 Thread Alexandre Rafalovitch
Which version of Solr is it and in which way is it not working. And should not the deltaQuery and deltaImportQuery both have "as ID" part? Regards, Alex. On 6 July 2018 at 07:53, shruti suri wrote: > HI, > > Please help me with delta import form one oracle table into solr. I don't > have any

Re: Unbale to Create a Core

2018-07-06 Thread Erick Erickson
"df" is not defaultFieldType, it's the default search field. It looks like you're using "schemaless" mode. defaultFieldType is part of that process. Incidentally, we don't recommend schemaless for production systems as it has to make assumptions about how you want to search. It's fine for getting

Re: increase timeout before zookeeper times out on startup

2018-07-06 Thread Shawn Heisey
On 7/6/2018 6:20 AM, Sushant Vengurlekar wrote: > I am setting up zookeeper ensemble on aws ecs and due to the difference in > time at which all the zookeeper instances come up they timeout during the > election process and all of them fail one after another. how can I make > sure that there is som

Re: increase timeout before zookeeper times out on startup

2018-07-06 Thread Sushant Vengurlekar
How do I subscribe to the zk mailing list? Thanks On Fri, Jul 6, 2018 at 8:11 AM Shawn Heisey wrote: > On 7/6/2018 6:20 AM, Sushant Vengurlekar wrote: > > I am setting up zookeeper ensemble on aws ecs and due to the difference > in > > time at which all the zookeeper instances come up they time

Re: Use fqdn instead of IP address with zookeeper ensemble

2018-07-06 Thread Shawn Heisey
On 7/6/2018 7:50 AM, Sushant Vengurlekar wrote: > I am doing the same but somehow its not working. I get the following errors > > Resolved hostname: zk-1.example.local to address: zk-1.example.local/ > 172.16.3.85 > > Cannot open channel to 2 at election address zk-1.example.local/ > 172.16.3.85:38

Re: Delta import not working with Oracle in Solr

2018-07-06 Thread Shawn Heisey
On 7/6/2018 5:53 AM, shruti suri wrote: > Please help me with delta import form one oracle table into solr. I don't > have any primary key in the table. We need to use composite key using > (LOCAL_MASTER_ID,LOCAL_ID). > > > query="select * from dat

Re: increase timeout before zookeeper times out on startup

2018-07-06 Thread Shawn Heisey
On 7/6/2018 9:13 AM, Sushant Vengurlekar wrote: > How do I subscribe to the zk mailing list? It's a completely separate software project within the Apache Foundation.  They have their own resources.  There are "Mailing Lists" and "IRC Channel" links on this page: http://zookeeper.apache.org/ Tha

CSVResponseWriter doesnt return non-stored field even when docValues is enabled

2018-07-06 Thread Karthikeyan Shanmugasundaram
Hi, As part of this Jira, https://issues.apache.org/jira/browse/SOLR-2970?attachmentSortBy=fileName CSVResponseWriter doesnt return fields whose stored attribute set to false, but looks docvalues is not considered. Whereas it is not same for response writer like json/xml ie., fields with only do

Re: Unbale to Create a Core

2018-07-06 Thread Greenhorn Techie
Erick, Good Evening!! A question further on the below. If schema-oriented design is recommended for production systems, then how should we design such that it production systems would cater for inevitable schema changes? Should we reindex the data and rebuild the collections again? Thanks On 6

Re: CSVResponseWriter doesnt return non-stored field even when docValues is enabled

2018-07-06 Thread Erick Erickson
Do you have any evidence that this doesn't work? Because when I tried it just now it works fine. This was on master. Best, Erick On Fri, Jul 6, 2018 at 10:06 AM, Karthikeyan Shanmugasundaram wrote: > Hi, > > As part of this Jira, > > https://issues.apache.org/jira/browse/SOLR-2970?attachmentSort

Re: CSVResponseWriter doesnt return non-stored field even when docValues is enabled

2018-07-06 Thread Karthikeyan Shanmugasundaram
Yea i just tried again and below is the info, - Solr/Lucene Version : 7.2.1 - Created collection with below fields - Added few documents contentid,testint,testlong id,1,56 id2,2,66 - http://machine:port/solr/testdocvalue/select?q=*:*&wt=json

common ecommerce use case

2018-07-06 Thread Sreenivas.T
Hi, It's a common use case in ecommerce world and I would like to hear best approaches to implement them. What are the options to implement "red shoes" (color category), "Men's bikes" (Gender category) or "Samsung TV" (brand catgeory) kind of queries? is it better to implement using filters lik

Re: common ecommerce use case

2018-07-06 Thread Alexandre Rafalovitch
Have you tried searching for presentation videos on solr ecommerce? I seem to remember similar discussions from SolrRevolution and http://www.mices.co conferences. Regards, Alex On Fri, Jul 6, 2018, 10:26 PM Sreenivas.T, wrote: > Hi, > > It's a common use case in ecommerce world and I would