Re: Having replica will slow down Solr?

2015-12-30 Thread Binoy Dalal
If I understand the cloud setup correctly having a replica will serve for redundancy and won't slow your searches down. In your case for the slow response times, are you returning any large stored fields? On Wed, 30 Dec 2015, 13:26 Zheng Lin Edwin Yeo wrote: > Hi, > > I would like to find out, w

Re: Having replica will slow down Solr?

2015-12-30 Thread davidphilip cherian
Few questions: What are your memory configs: xms and xmx values, available ram size? Were you also indexing at the time when the search response was so slow? In the sense, were you committing often with openSearcher=true, in any case? What is the QTime for consequent searches? Are the caches ena

Re: Issue with Join

2015-12-30 Thread Mikhail Khludnev
Hello, Have you considered to pass NOT {!join from=prac_spec_code to=practicing_specialties_codes fromIndex=autosuggest}*:* as a q and look at debug output. Also there was a trick for dealing with pure negative queries q=*:* -foo:bar though it might be obsolete. On Tue, Dec 29, 2015 at 7

Maximum number of values in a Solr multi-valued field

2015-12-30 Thread Vishnu perumal
Hi, I am using SOLR 4.10. I have around 350M documents indexed in SOLR. In my case, i have one multi-valued field to store the generated ids and also this field is searchable. Would large number of values (100K or 200K or 1M) in this multi-valued field pose any problem for SOLR or is there any lim

Re: How to achieve join like behavior on solr-cloud

2015-12-30 Thread Alok Bhandari
Hi Dennis , thanks for your reply. As I wanted this for some production system so may not be able to upgrade to under-development branch of solr. but thanks a lot for pointing me to this possible approach. -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-achieve-join

Re: Maximum number of values in a Solr multi-valued field

2015-12-30 Thread Upayavira
I am not aware of a specific limit to the number of values in a multivalued field. Essentially, a multi-valued field is the same as a very long tokenised field - so a document containing a full Shakespeare play for example. If you are doing searches against a document set of this type, then you wi

Parameter Substitution / Macro Expansion

2015-12-30 Thread Alessandro Benedetti
I was taking a look to this article from Yonik [1] . I like the feature and actually it could useful for some use cases of mine. Started to play with it in Solr 5.4 . I verified it is working if you pass both the query and the parameters to substitute as request parameters. I verified it is worki

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Erik Hatcher
I dunno why that doesn't work but try {!mlt ... v=$master_id} and set a default value in your config for master_id and that should at least work. Erik > On Dec 30, 2015, at 08:37, Alessandro Benedetti wrote: > > I was taking a look to this article from Yonik [1] . > I like the feature and

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Yonik Seeley
On Wed, Dec 30, 2015 at 8:37 AM, Alessandro Benedetti wrote: > I was taking a look to this article from Yonik [1] . > I like the feature and actually it could useful for some use cases of mine. > Started to play with it in Solr 5.4 . > > I verified it is working if you pass both the query and the

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Alessandro Benedetti
Erick, your suggestion worked : Hotels Similarity edismax 5 *,score active:true explicit json {!boost b=recip(dist(2,0,star_rating,0,$star_rating),1,10,10)}{!boost b=recip(geodist(lat_lon,$lat,$lon),2,200,20)}{!mlt qf=n

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Alessandro Benedetti
debugging I confirm you are right Yonik, but also that the defaults are already applied at this point : org/apache/solr/request/json/RequestUtil.java:158 Could be a resolution of properties that happens at solrconfig, xml level ? It verifies if any java properties is in there when running sol

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Alessandro Benedetti
Reference : https://wiki.apache.org/solr/SolrConfigXml#System_property_substitution On 30 December 2015 at 15:30, Alessandro Benedetti wrote: > debugging I confirm you are right Yonik, but also that the defaults > are already applied at this point : > org/apache/solr/request/json/RequestUti

Re: Changing Solr Schema with Data

2015-12-30 Thread Salman Ansari
Thanks. Salman On Tue, Dec 29, 2015 at 9:33 PM, Binoy Dalal wrote: > What shalin says is solid and will work with solr 5.x as well as 3.x > You could do a little poc if you want to be absolutely certain. Shouldn't > take you very long. > Your only concern will be that your old docs won't be mat

Re: multi term analyzer error

2015-12-30 Thread Erick Erickson
Right, you may be one of the few people to actually implement your own multiTerm analyzer function despite the fact that this has been in the code for years! If you look at the factories and see if they implement the "MultiTermAwareComponent" interface, and PatternReplaceCharFitlerFactory does _no

Re: Parameter Substitution / Macro Expansion

2015-12-30 Thread Yonik Seeley
On Wed, Dec 30, 2015 at 10:30 AM, Alessandro Benedetti wrote: > debugging I confirm you are right Yonik, but also that the defaults > are already applied at this point : > org/apache/solr/request/json/RequestUtil.java:158 > > Could be a resolution of properties that happens at solrconfig, xml

Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-30 Thread Mark Horninger
I have gotten Teiid and Solr wired up, but it seems like the only way to query is with the default Solr Query Engine, and nothing else. In asking Dr. Google, this is a data black hole. The more I look at it, the more I think I'm going to end up having to write a custom translator. Is there an

Testing Solr configuration, schema, and other fields

2015-12-30 Thread Davis, Daniel (NIH/NLM) [C]
At my organization, I want to create a tool that allows users to keep a solr configuration as a Git repository. Then, I want my Continuous Integration environment to take some branch of the git repository and "publish" it into ZooKeeper/SolrCloud. Working on my own, it is only a very small pa

RE: Testing Solr configuration, schema, and other fields

2015-12-30 Thread Mark Horninger
Daniel, Sounds almost like you're reinventing the wheel. Could you possibly automate this through puppet or Chef? With a VDI environment, then all you would need to do is build a new VM Node based on original setup. Then you can just roll out the node as one of the zk nodes. Just a thought

RE: Testing Solr configuration, schema, and other fields

2015-12-30 Thread Davis, Daniel (NIH/NLM) [C]
Your bottom line point is that EmbeddedSolrServer is different, and some configurations will not work on it where they would work on a SolrCloud. This is well taken. Maybe creating a new collection on existing dev nodes could be done. As far as VDI and Puppet. My requirements are differen

Error importing data - java.util.concurrent.RejectedExecutionException

2015-12-30 Thread Jeff Chastain
I will preface this with the fact that I am still pretty new to both Solr and Tomcat, so hopefully this is something obvious to somebody out there. I have two 4.3.10 Solr servers set up in separate contexts, running on a Tomcat 7 application server on Windows 2012. When I attempt to import dat

Re: Stable Versions in Solr 4

2015-12-30 Thread Shawn Heisey
On 12/28/2015 5:12 AM, abhi Abhishek wrote: >i am trying to determine stable version of SOLR 4. is there a blog which > we can refer.. i understand we can read through Release Notes. I am > interested in user reviews and challenges seen with various versions of > SOLR 4. Here's some informatio

Re: Testing Solr configuration, schema, and other fields

2015-12-30 Thread Erick Erickson
Yeah, the notion of DTDs have gone around several times but always founder on the fact that you can, say, define your own Filter with it's own set of parameters etc. Sure, you can make a generic DTD that accommodates this, but then it becomes so general as to be little more than a syntax checker.

RE: Testing Solr configuration, schema, and other fields

2015-12-30 Thread Davis, Daniel (NIH/NLM) [C]
I think of enterprise search as very similar to RDBMS: - It belongs in the backend behind your app. - Each project ought to control its own schema and data. So, I want the configset for each team's Solr collections to be stored in our Git server just as the RDBMS schema is if a developer is usin

Re: Issue with Join

2015-12-30 Thread William Bell
Yeah I ran it. It appears to only have an issue if the field for the core on the outside is MultiValue, and the inside field is single value, and the order of the field has the code not as the first entry. Like: practicing_specialties_codes: > [ > - "PS1010", > -

Add me to the Solr ContributorsGroup

2015-12-30 Thread Saïd Radhouani
Hi - I'd appreciate if you could add me to the Contributor Group. Here are my account info : - Name: Saïd Radhouani - User name: radhouani - email: said.radhou...@gmail.com Thanks, -Saïd

Re: Add me to the Solr ContributorsGroup

2015-12-30 Thread Erick Erickson
Done On Wed, Dec 30, 2015 at 5:36 PM, Saïd Radhouani wrote: > Hi - I'd appreciate if you could add me to the Contributor Group. Here are > my account info : > > - Name: Saïd Radhouani > - User name: radhouani > - email: said.radhou...@gmail.com > > Thanks, > -Saïd

Re: Stable Versions in Solr 4

2015-12-30 Thread Shyam R
I will always look around here for versions / new functionality or fixes / release notes https://issues.apache.org/jira/browse/SOLR/?selectedTab=com.atlassian.jira.jira-projects-plugin:changelog-panel Thanks On Thu, Dec 31, 2015 at 4:05 AM, Shawn Heisey wrote: > On 12/28/2015 5:12 AM, abhi Abh

Re: Having replica will slow down Solr?

2015-12-30 Thread Zheng Lin Edwin Yeo
Hi Binoy, The only large stored field I have is content, which is indexed from the content of the rich text documents. Regards, Edwin On 30 December 2015 at 16:20, Binoy Dalal wrote: > If I understand the cloud setup correctly having a replica will serve for > redundancy and won't slow your s

Re: Having replica will slow down Solr?

2015-12-30 Thread Zheng Lin Edwin Yeo
Hi DavidPhilip, What are your memory configs: xms and xmx values, available ram size? > I'm using Solr 5.3.0, so I've only set the -Xmx value at 14g. My available RAM size is 64GB Were you also indexing at the time when the search response was so slow? In the sense, were you committing often with

Re: Having replica will slow down Solr?

2015-12-30 Thread Binoy Dalal
1) If your stored fields are very large, it will lead to high response times since solr will have to decompress the field and then return the whole thing. I had faced such an issue with one of my implementations where we had stored fields around 100KB of text per document and the response times wer

SOLR 5.4.0?

2015-12-30 Thread William Bell
How is SOLR 5.4.0 ? I heard there was a quick 5.4.1 coming out? Any major issues? -- Bill Bell billnb...@gmail.com cell 720-256-8076

Re: Testing Solr configuration, schema, and other fields

2015-12-30 Thread Alexandre Rafalovitch
I might be just confused here, but I am not sure what your bottle neck actually is. You seem to know your critical path already, so how can we help? Starting new solr core from given configuration directory is easy. Catching hard errors from that is probably just gripping logs or a custom logger.

Using post.jr for indexing in Solr 5.4.0

2015-12-30 Thread Zheng Lin Edwin Yeo
Hi, Would like to find out, is there any changes to the post.jar for Solr 5.4? I tried to use the post.jar from Solr 5.3.0, and it gives me the following error during indexing: java.lang.NoSuchMethodError: org.apache.solr.h andler.extraction.ExtractingDocumentLoader.(Lorg/apache/solr/reques

Re: Teiid with Solr - using any other engine except the SolrDefaultQueryEngine

2015-12-30 Thread Alexandre Rafalovitch
Are you trying to do federated search? What about carrot? Not the one that ships with Solr, the parent project. Regards, Alex On 31 Dec 2015 12:21 am, "Mark Horninger" wrote: > I have gotten Teiid and Solr wired up, but it seems like the only way to > query is with the default Solr Query Engi

Re: Using post.jr for indexing in Solr 5.4.0

2015-12-30 Thread davidphilip cherian
Did you try using the latest post jar (shipped with 5.4 version) to index same docs? What happened? Did you get the same error or no? On Thu, Dec 31, 2015 at 11:12 AM, Zheng Lin Edwin Yeo wrote: > Hi, > > Would like to find out, is there any changes to the post.jar for Solr 5.4? > I tried to u

Re: SOLR 5.4.0?

2015-12-30 Thread Ere Maijala
Well, for us SOLR-8418 is a major issue. I haven't encountered other issues, but that one was sort of a show-stopper. --Ere 31.12.2015, 7.27, William Bell kirjoitti: How is SOLR 5.4.0 ? I heard there was a quick 5.4.1 coming out? Any major issues? -- Ere Maijala Kansalliskirjasto / The Nat