Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Greg Pendlebury
Oh my bad. I thought it was already in. Thanks for the correction. Ta, Greg On 17 March 2014 15:55, Shalin Shekhar Mangar wrote: > Greg, SOLR-4735 (using the codahale metrics lib) hasn't been committed > yet. It is still work in progress. > > Actually the internal Solr Metrics class has a metho

Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Shalin Shekhar Mangar
Greg, SOLR-4735 (using the codahale metrics lib) hasn't been committed yet. It is still work in progress. Actually the internal Solr Metrics class has a method to return 1 minute stats but it is not used. On Mon, Mar 17, 2014 at 10:06 AM, Greg Pendlebury wrote: > In the codahale metrics library

Re: Solr metrics in Codahale metrics and Graphite?

2014-03-16 Thread Greg Pendlebury
In the codahale metrics library there are 1, 5 and 15 minute moving averages just like you would see in a tool like 'top'. However in Solr I can only see 5 and 15 minute values, plus 'avgRequestsPerSecond'. I assumed this was the 1 minute value initially, but it seems to be something like the avera

Re: Solr Japanese support

2014-03-16 Thread Erick Erickson
Tri Dang: Please follow the instructions here: https://lucene.apache.org/solr/discussion.html Best, Erick On Sun, Mar 16, 2014 at 6:15 PM, Tri Dang wrote: > Please unsubscribe me. > > > > > > On Sunday, March 16, 2014 9:10 PM, Alexandre Rafalovitch > wrote: > > Which version of Solr are you

Re: example schema now stores most field values

2014-03-16 Thread Alexandre Rafalovitch
What do you expect to get out of updates except for stability/new-features? In schema.xml, there is a version field. If you don't change that, you should not be affected by new defaults. As to new features (e.g. Near-Real-Time), you have to enable it explicitly in couple of places to get it going.

Re: Solr Japanese support

2014-03-16 Thread Tri Dang
Please unsubscribe me. On Sunday, March 16, 2014 9:10 PM, Alexandre Rafalovitch wrote: Which version of Solr are you on? Because for Solr 4, the endpoint should be /update and the Content-Type should be correct. See: http://wiki.apache.org/solr/UpdateCSV I would expect the problem NOT to

Re: Solr Japanese support

2014-03-16 Thread Alexandre Rafalovitch
Which version of Solr are you on? Because for Solr 4, the endpoint should be /update and the Content-Type should be correct. See: http://wiki.apache.org/solr/UpdateCSV I would expect the problem NOT to be around Japanese, but around other things. You could for example try to index Japanese into th

Re: Querying specific database attributes or table

2014-03-16 Thread Ahmet Arslan
Hi Oliver, If you index a field (say source) holding table name, you can filter by that field. e.q. fq=source:TableA    http://wiki.apache.org/solr/CommonQueryParameters#fq It is possible to query a specific attribute of a table. This is usually corresponds to fields in solr. See https://cwiki

Querying specific database attributes or table

2014-03-16 Thread Olivier Austina
Hi, I am new to Solr. I would like to index and querying a relational database. Is it possible to query a specific table or attribute of the database. Example if I have 2 tables A and B both have the attribute "name" and I want to have only the results form the table A and not from table B. Is it

Re: Solr Japanese support

2014-03-16 Thread Benson Margulies
Your problem has nothing to do with Japanese. Perhaps a content-type for CSV would work better? On Sat, Mar 15, 2014 at 12:50 PM, Bala Iyer wrote: > Hi, > > I am new to Solr japanese. > I added the support for japanese on schema.xml > How can i insert Japanese text into that field either by solr

Re: [solr 4.7.0] analysis page: issue with HTMLStripCharFilterFactory

2014-03-16 Thread Stefan Matheis
Oh .. i'm sorry .. late to the party - didn't see the response from Doug .. so feel free to ignore that mail (: On Sunday, March 16, 2014 at 9:38 PM, Stefan Matheis wrote: > Hey Dmitry > > We had a similar issue reported and already fixed: > https://issues.apache.org/jira/browse/SOLR-5800 >

Re: [solr 4.7.0] analysis page: issue with HTMLStripCharFilterFactory

2014-03-16 Thread Stefan Matheis
Hey Dmitry We had a similar issue reported and already fixed: https://issues.apache.org/jira/browse/SOLR-5800 i'd suspect that this patch fixes your issue too? would like to hear back from you, if that's the case :) -Stefan On Saturday, March 15, 2014 at 6:58 PM, Dmitry Kan wrote: > Hello,

Re: Problems using solr.SpatialRecursivePrefixTreeFieldType

2014-03-16 Thread Hamish Campbell
(apologies, gmail sent that a bit early.. continued below!) Hi Lajos, Running Jetty - I've checked file permissions, they're definitely correct. Against the advice of the wiki, I've tried adding them to the solr contrib folder with a lib entry in solrconfig. The log then shows it as loaded, but t

Re: Problems using solr.SpatialRecursivePrefixTreeFieldType

2014-03-16 Thread Hamish Campbell
Hi Lajos, Running Jetty - I've checked file permissions, they're definitely correct. Against the advice of the wiki, I've tried adding them to the solr contrib folder with On Mon, Mar 17, 2014 at 2:22 AM, Lajos wrote: > Hi Hamish, > > Are you running Jetty? > > In Tomcat, I've put jts-1.13.jar

Re: bulk indexing - EofExceptions and big latencies after soft-commit

2014-03-16 Thread Shawn Heisey
On 3/16/2014 10:34 AM, adfel70 wrote: > I have a 12-node solr 4.6.1 cluster. each node has 2 solr procceses, running > on 8gb heap jvms. each node has total of 64gb memory. > My current collection (7 shards, 3 replicas) has around 500 million docs. > I'm performing bulk indexing into the collectio

Re: Result merging takes too long

2014-03-16 Thread Chris W
Can you share a sample query ? Ensure you have filterquery, fl fields and query result cache settings well tuned To give you an example: A month ago I had an issue where a few of our queries were taking 3+seconds with 5 shards and as I added more shards the query was taking even longer. I figured

bulk indexing - EofExceptions and big latencies after soft-commit

2014-03-16 Thread adfel70
Hi I have a 12-node solr 4.6.1 cluster. each node has 2 solr procceses, running on 8gb heap jvms. each node has total of 64gb memory. My current collection (7 shards, 3 replicas) has around 500 million docs. I'm performing bulk indexing into the collection. I set softCommit to 10 minutes and hardC

solr-user@lucene.apache.org

2014-03-16 Thread Joel Bernstein
Tim, When using the CollapsingQParserPlugin facet counts will be calculated for the collapsed result set. With grouping you need to specify group.truncate to calculate facet counts on the collapsed result set. You can use the tag/exclude facet options to remove the CollapsingQParserPlugin filter

Re: Result merging takes too long

2014-03-16 Thread Shalin Shekhar Mangar
On Thu, Mar 13, 2014 at 1:49 PM, remi tassing wrote: > > I've used the fl=id parameter to avoid retrieving the actual documents > (step <4> in your mail) but the problem still exists. > Any ideas on how to find the merging time(step <3>)? Actually that doesn't skip steps #4 and #5. That optimizat

Re: example schema now stores most field values

2014-03-16 Thread Michael Sokolov
Thanks for hunting that down, Jack. It may very well have been a change that we made (to remove the stored="true". Sorry if I led you on a wild goose chase. Actually I wonder if people have a better method for performing config upgrades than mine. I find that every time I take a Solr upgrad

Re: Nested documents, block join - re-indexing a single document upon update

2014-03-16 Thread Jack Krupansky
You stumbled upon the whole point of block join – that the documents are and must be managed as a block and not individually. -- Jack Krupansky From: danny teichthal Sent: Sunday, March 16, 2014 6:47 AM To: solr-user@lucene.apache.org Subject: Nested documents, block join - re-indexing a singl

Re: Problems using solr.SpatialRecursivePrefixTreeFieldType

2014-03-16 Thread Lajos
Hi Hamish, Are you running Jetty? In Tomcat, I've put jts-1.13.jar in the WEB-INF/lib directory of the unpacked distribution and restarted. It worked fine. Maybe check file permissions as well ... Regards, Lajos On 16/03/2014 10:18, Hamish Campbell wrote: Hey all, Trying to use Spatial

Nested documents, block join - re-indexing a single document upon update

2014-03-16 Thread danny teichthal
Hi All, To make things short, I would like to use block joins, but to be able to index each document on the block separately. Is it possible? In more details: We have some nested parent-child structure where: 1. Parent may have a single level of children 2. Parent and child

Problems using solr.SpatialRecursivePrefixTreeFieldType

2014-03-16 Thread Hamish Campbell
Hey all, Trying to use SpatialRecursivePrefixTreeFieldType to store extent polygons but I can't seem to get it configured correctly. Hitting this on start up: 4670 [main] ERROR org.apache.solr.core.SolrCore - Error loading > core:java.util.concurrent.ExecutionException: > java.lang.NoClassDefFou

Re: Result merging takes too long

2014-03-16 Thread remi tassing
>So I have to ask what the end goal is here. In our case, the purpose of sharding was/is to speed up the process. We've noticed that as the index size was growing, response speed kept going down so we decided to split the index across 5 machines. >Are your response times really in need of improvem