To Detect Wheter Core is Available To Post

2016-01-25 Thread Edwin Lee
Hi All, Our team is using the Solr to process log and we met a problem in SOLR posting. We want to detect the health of each core —- whether they are available to post. We have to figure out ways to do that: 1. Using luke request . —- Cost is a bit high for core loading 2. We have designed

Re: Solr multicore join performance tuning

2016-01-25 Thread Mikhail Khludnev
What a solr version, query parameters and debug output? 26.01.2016 6:38 пользователь "Bhawna Asnani" написал: > Hi, > I am using solr multicore join queries for some admin filters. The queries > are really slow taking up to 40-60 seconds ins some cases. > > I recently read that the schema field u

Re: Query results change

2016-01-25 Thread Shawn Heisey
On 1/25/2016 7:47 PM, Brian Narsi wrote: > We have increased the number of documents in the SolrCloud collection to > several million now and are seeing the "issue" again: > > If there are 10 documents each with exactly the same highest score and we > run the query again and again, the order of doc

Re: Read time out exception - exactly 10 minutes after starting committing

2016-01-25 Thread David Andrews
I just got bit by this today. I tracked it down to the default solr.xml file in ./server/solr/solr.xml with the following: ${socketTimeout:60} ${connTimeout:6} I’m on Solr 5.3.1 now, and I wasn’t having this problem with 4.10.3, and sure enough, 4.10.3 has the values at 0

Re: Query results change

2016-01-25 Thread Brian Narsi
We have increased the number of documents in the SolrCloud collection to several million now and are seeing the "issue" again: If there are 10 documents each with exactly the same highest score and we run the query again and again, the order of documents changes. So strictly speaking although all

Solr multicore join performance tuning

2016-01-25 Thread Bhawna Asnani
Hi, I am using solr multicore join queries for some admin filters. The queries are really slow taking up to 40-60 seconds ins some cases. I recently read that the schema field used to join to should have 'docValues=true'. Besides that, any suggestion to improve the performance? -Bhawna

Re: Solr partial date range search

2016-01-25 Thread Shawn Heisey
On 1/25/2016 5:59 PM, vsriram30 wrote: > I am using solr 4.6.1. I have a date field (TrieDateField) in my schema and > I am trying to perform partial date range search as given in > https://cwiki.apache.org/confluence/display/solr/Working+with+Dates > Query = date_field:[2016-01-11 TO NOW] > But I

Solr partial date range search

2016-01-25 Thread vsriram30
Hi, I am using solr 4.6.1. I have a date field (TrieDateField) in my schema and I am trying to perform partial date range search as given in https://cwiki.apache.org/confluence/display/solr/Working+with+Dates Query = date_field:[2016-01-11 TO NOW] But I am getting, "error": { "msg": "Invalid

Re: unmerged index segments

2016-01-25 Thread Jack Krupansky
What exacting are you merge policy settings in solrconfig? They control when the background merges will be performed. Sometimes they do need to be tweaked. -- Jack Krupansky On Mon, Jan 25, 2016 at 1:50 PM, James Mason wrote: > Hi, > > I’ve have a large index that has been added to over several

unmerged index segments

2016-01-25 Thread James Mason
Hi, I’ve have a large index that has been added to over several years, and I’ve discovered that I have many segments that haven’t been updated for well over a year, even though I’m adding, updating and deleting records daily. My five largest segments all haven’t been updated for over a year. M

RE: Content translation using Solr

2016-01-25 Thread Markus Jelsma
Here's a short example: https://tika.apache.org/1.11/examples.html#Translation_using_the_Microsoft_Translation_API -Original message- > From:Shamir, Maya > Sent: Monday 25th January 2016 16:15 > To: solr-user@lucene.apache.org > Subject: RE: Content translation using Solr > > Its sou

Re: Accessing Index Modification Information

2016-01-25 Thread Shawn Heisey
On 1/25/2016 7:05 AM, Björn Keil wrote: > I am using Solr 5.1 (within a Tomcat6 server) and am trying to find out how > get information from a Solr server about the exact time of the last commit > and the total number of documents in a given index, and I need to query this > information in a scr

RE: Content translation using Solr

2016-01-25 Thread Shamir, Maya
Its sounds interesting, do you have an example? I found the documentation of this package but didn’t find any example Thanks, Maya -Original Message- From: Markus Jelsma [mailto:markus.jel...@openindex.io] Sent: Monday, January 25, 2016 14:53 To: solr-user@lucene.apache.org Subject: RE:

indexing rich data with solr 5.3.1 integreting in Ubuntu server

2016-01-25 Thread kostali hassan
0down votefavorite I have a problem with integrating solr in Ubuntu server.Before using solr on ubuntu server i tested it on my mac it was working perfectly for DIH request handler and update/extract

Accessing Index Modification Information

2016-01-25 Thread Björn Keil
Hello, I am using Solr 5.1 (within a Tomcat6 server) and am trying to find out how get information from a Solr server about the exact time of the last commit and the total number of documents in a given index, and I need to query this information in a scripted way. The total number of document

Re: POST request on slave server & error (Urgent )

2016-01-25 Thread Shawn Heisey
On 1/24/2016 7:42 AM, Midas A wrote: > where can i see solr these solr log. The reply from Binoy Dalal outlines one location where the log can be if you're running Solr 5.x. {Solr_dist}/server/logs/solr.log Assuming version 5.0 or later, there are also other possible places that it could be dep

Re: JSON FACET solrj support (i am using solr 5.4)

2016-01-25 Thread Mikhail Khludnev
Neither I'm aware of. Why don't traverse NamedList QueryResponse.getResponse() and pickup what's necessary? On Mon, Jan 25, 2016 at 12:32 PM, Sumeet Sharma wrote: > Hi > > Is there any work going on for parsing json facet response in solrj? If yes > can someone link me to the project or document

Re: Understanding solr commit

2016-01-25 Thread Rahul Ramesh
Thank you Emir, Allesandro for the inputs. We use sematext for monitoring. We understand that Solr needs more memory but unfortunately we have to move towards an altogether new range of servers. As you say eventually, we will have to upgrade our servers. Thanks, Rahul On Mon, Jan 25, 2016 at 6:3

Re: Understanding solr commit

2016-01-25 Thread Emir Arnautovic
Hi Rahul, It is hard to tell without seeing metrics, but 8GB heap seems small for such setup - e.g. with indexing buffer of 32MB and 30 collections, it will eat almost 1GB memory. About commits, you can set auto commit to be more frequent (keep openSearcher=false) and add soft commits every 3 m

RE: Content translation using Solr

2016-01-25 Thread Markus Jelsma
Hi - Solr doesn't have any translation on board. But with Tika you could easily make a Solr UpdateProcessor and use Tika's o.a.t.language.translate package. Markus -Original message- > From:Shamir, Maya > Sent: Monday 25th January 2016 13:45 > To: solr-user@lucene.apache.org > Subject

Content translation using Solr

2016-01-25 Thread Shamir, Maya
Hello, Im using Solr to store my clients website content and query them to get insights. The problem is that I have to translate the query into many languages. I thought about translate the non-English pages into English using Solr, but I didn't find any possibility. Am I missing something? Does

Re: Understanding solr commit

2016-01-25 Thread Rahul Ramesh
Can you give us bit more details about Solr heap parameters. Each node has 32Gb of RAM and we are using 8Gb for heap. Index size in each node is around 80Gb #of collections 30 Also can you give us info about auto commit (both hard and soft) you used when experienced OOM. 15000 15000 false soft

RE: Using Custom Enum

2016-01-25 Thread Prateek Jain J
Finally found the error. It was a typo fieldType was marked as filedType Regards, Prateek Jain -Original Message- From: Prateek Jain J [mailto:prateek.j.j...@ericsson.com] Sent: 25 January 2016 12:11 PM To: solr-user@lucene.apache.org Subject: Using Custom Enum Hi, I am trying to de

Re: Understanding solr commit

2016-01-25 Thread Emir Arnautovic
Hi Rahul, It is good that you commit only once, but not sure how external commits can do something auto commit cannot. Can you give us bit more details about Solr heap parameters. Running Solr on the edge of OOM is always risk of starting snowball effect and crashing entire cluster. Also can yo

Using Custom Enum

2016-01-25 Thread Prateek Jain J
Hi, I am trying to define application specific enums in solr. While running test cases, solr complains for unknown type, here are the steps performed: 1. Defined enum type in schema.xml like 2. Created enums.xml in conf directory with contents

Re: facet by update date

2016-01-25 Thread Erik Hatcher
Test it and see :) But it's more whether it'll achieve your goal or not as I imagine the performance difference is negligible. But test and see (and report back please) > On Jan 24, 2016, at 20:35, Jay Potharaju wrote: > > Which is a better option facet.interval or facet.query in terms of > pe

Re: Understanding solr commit

2016-01-25 Thread Rahul Ramesh
Thanks for your replies. A bit more detail about our setup. The index size is close to 80Gb spread across 30 collections. The main memory available is around 32Gb. We are always in short of memory! Unfortunately we could not expand the memory as the server motherboard doesnt support it. We tried

Re: Understanding solr commit

2016-01-25 Thread Alessandro Benedetti
Let me answer in line : On 25 January 2016 at 11:02, Rahul Ramesh wrote: > We are facing some issue and we are finding it difficult to debug the > problem. We wanted to understand how solr commit works. > A background on our setup: > We have 3 Node Solr Cluster running in version 5.3.1. Its a i

Re: Understanding solr commit

2016-01-25 Thread Emir Arnautovic
Hi Rahul, If I got your mail right there is misconception of SolrCloud - nodes are infrastructure of cloud and collection is something that is "unit". So when you commit, you are committing changes you did on collection and SolrCloud will handle nodes. When you commit to three 3 nodes it is ac

Understanding solr commit

2016-01-25 Thread Rahul Ramesh
We are facing some issue and we are finding it difficult to debug the problem. We wanted to understand how solr commit works. A background on our setup: We have 3 Node Solr Cluster running in version 5.3.1. Its a index heavy use case. In peak load, we index 400-500 documents/second. We also want t

JSON FACET solrj support (i am using solr 5.4)

2016-01-25 Thread Sumeet Sharma
Hi Is there any work going on for parsing json facet response in solrj? If yes can someone link me to the project or documentation? -- Sumeet R Sharma

Re: POST request on slave server & error (Urgent )

2016-01-25 Thread Midas A
my solr version :4.2.1 On Sun, Jan 24, 2016 at 8:32 PM, Binoy Dalal wrote: > {Solr_dist}/server/logs/solr.log > > On Sun, 24 Jan 2016, 20:12 Midas A wrote: > > > Shawn, > > where can i see solr these solr log. > > > > On Fri, Jan 22, 2016 at 8:54 PM, Shawn Heisey > wrote: > > > > > On 1/22/20