Re: PriceJunkie.com using solr!

2007-11-14 Thread Tim
idea of how many indexed records too? I realize project scopes vary, but at least we can ballpark it. In my case I'm trying to figure if I need a dedicated server for this project. Tim Bangordailynews.com New Media On Nov 14, 2007, at 8:22 PM, "Nick Jenkin" <[EMAIL PROTE

Re: Exception in SOLR when querying for fields of type string

2007-11-15 Thread Tim
In scheme.XML in your example/solr/conf folder look for [text] [text] is the field you'll want to be the default field. You'll have to restart Solr to make the change take affect Bangordailynews.com New Media On Nov 14, 2007, at 4:29 PM, Kasi Sankaralingam <[EMAIL PROTECTED]> wrote: No

[CDCR]Unable to locate core

2019-01-30 Thread Tim
I'm trying to setup CDCR but I'm running into an issue where one or two shards/replicas will not be replicated but the rest will out of the six cores. The only error that appears in the logs is: "Unable to locate core". Occasionally restarting the instance will fix this but then the issue will r

Re: [CDCR]Unable to locate core

2019-02-01 Thread Tim
After some more investigation it seems that we're running into the same bug found here . However if my understanding is correct that bug in 7.3 was patched out. Unfortunately we're running into the same behavior in 7.5 CDCR is replicating succe

Re: [CDCR]Unable to locate core

2019-02-02 Thread Tim
Thank you for the reply. Sorry I did not include more information in the first post. So maybe there's some confusion here from my end. So both the target and source clusters are running in cloud mode. So I think you're correct that it is a different issue. So it looks like the source leader to ta

Re: [CDCR]Unable to locate core

2019-02-07 Thread Tim
So it looks like I'm having an issue with this fix: https://issues.apache.org/jira/browse/SOLR-11724 So I've messed around with this for a while and every time the leader to leader replica portion works fine. But the Recovery portion (implemented as part of the fix above) fails. I've run a few t

Geospatial search question - document with multiple locations

2015-12-24 Thread Tim Hearn
-70 is not? Thanks much! Tim

Re: mlt and document boost

2015-12-24 Thread Tim Hearn
One workaround is to use the 'important terms' feature to grab the query generated by the MLT handler, then parse that list into your own solr query to use through a standard search handler. That way, you can get the same results as if you used the MLT handler, and you can also use filter querying

Re: Running Lucene/SOR on Hadoop

2016-01-04 Thread Tim Williams
Apache Blur (Incubating) has several approaches (hive, spark, m/r) that could probably help with this ranging from very experimental to stable. If you're interested, you can ask over on blur-u...@incubator.apache.org ... Thanks, --tim On Fri, Dec 25, 2015 at 4:28 AM, Dino Chopins wrote:

NPE when executing clustering query search

2016-03-22 Thread Tim Hearn
Hi everyone, I am trying to execute a clustering query to my single-core master-slave solr setup and it is returning a NullPointerException. I checked the line in the source code where it is being thrown, and it looks like the null object is some sort of 'filt' object, which doesn't make sense.

Re: Indexing 700 docs per second

2016-04-19 Thread Tim Robertson
30 concurrent users steady state (not all hitting SOLR though). It seems realistic with that kind of hardware in my experience, but you didn't mention what else was going on that might affect it (e.g. reads). HTH, Tim On Tue, Apr 19, 2016 at 7:12 PM, Erick Erickson wrote: > Make very sur

solr errors integrating with drupal

2015-09-09 Thread Tim Dunphy
to the same name: /update/json ignoring: org.apache.solr.handler.UpdateRequestHandler How can I correct these errors? I'll be able to show you whatever config files you think may lead to a solution. I'll just need to know which ones to show you, as I am still new to solr. Thanks! Tim

Re: solr training

2015-09-13 Thread Tim Dunphy
Cool, I'll check it out. Thanks! On Sun, Sep 13, 2015 at 9:53 PM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi Tim, > > A slightly delayed reply ;) > We are running Solr training in NYC next month - > http://sematext.com/training/solr-training.

Re: solr training

2015-09-17 Thread Tim Dunphy
> > How about in Denver? Nah dude. I'm in Jersey. Denver's like a half a country away! On Thu, Sep 17, 2015 at 12:18 AM, William Bell wrote: > How about in Denver? > > On Sun, Sep 13, 2015 at 7:53 PM, Otis Gospodnetić < > otis.gospodne...@gmail.com> wrote

Query to count matching terms and disable 'coord' multiplication

2015-10-06 Thread Tim Hearn
Hello everyone, I have two questions 1) Is there a way to query solr to rank results based purely on the amount of terms in the query which are contained in the document? Example: doc1: 'foo bar poo car foo' q1: 'foo, car, two, start' score(doc1, q1) = 2 (since both foo and car both occur in doc1

solr training

2015-05-02 Thread Tim Dunphy
Hey guys, My company has a training budget that it wants me to use. So what I'd like to find out is if there is any instructor lead courses in the NY/NJ area, or courses online that are instructor lead that you could recommend? Thanks, Tim -- GPG me!! gpg --keyserver pool.sks-keyserver

apache 5.1.0 under apache web server

2015-05-04 Thread Tim Dunphy
ickly. Sigh.. But thank you for your advice! Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B

Re: apache 5.1.0 under apache web server

2015-05-04 Thread Tim Dunphy
t;http-nio-8080"] 04-May-2015 15:48:27.257 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-8009"] 04-May-2015 15:48:27.258 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 3350 ms However it sounds like you're sure it'

solr 3.6.2 under tomcat 8 missing corename in path

2015-05-06 Thread Tim Dunphy
169 May 6 14:38 solr.xml Yet, when I bounce tomcat, this is the result that I get: HTTP Status 404 - missing core name in path type Status report message missing core name in path description The requested resource is not available. Cany anyone tell me what I'm doin

Re: solr 3.6.2 under tomcat 8 missing corename in path

2015-05-07 Thread Tim Dunphy
tion1 there: [root@aoadbld00032la solr]# ls -ld admin/cores/collection1 drwxr-xr-x. 5 root root 4096 May 6 17:29 admin/cores/collection1 So, if I assume correctly, that the way I reference the collection1 directory is the problem, how can I express this differently in my solr.xml file so that it wo

NPE when Faceting with MoreLikeThis handler in Solr 5.1.0

2015-05-14 Thread Tim Hearn
Hi everyone, Recently I upgraded to solr 5.1.0. When trying to generate facets using the more like this handler, I now get a a NullPointerException. I never got this exception while using Solr 4.10.0 Details are below: Stack Trace: at org.apache.solr.request.SimpleFacets.getHeatmapCounts(Simple

NPE when Faceting with MoreLikeThis handler in Solr 5.1.0

2015-05-15 Thread Tim Hearn
Hi everyone, Recently I upgraded to solr 5.1.0. When trying to generate facets using the more like this handler, I now get a a NullPointerException. I never got this exception while using Solr 4.10.0 Details are below: Stack Trace: at org.apache.solr.request.SimpleFacets.getHeatmapCounts(Simple

NPE with faceting query on MoreLikeThis handler

2015-05-18 Thread Tim Hearn
Hi everyone, Recently I upgraded to solr 5.1.0. When trying to generate facets using the more like this handler, I now get a a NullPointerException. I never got this exception while using Solr 4.10.0 Details are below: Stack Trace: at org.apache.solr.request.SimpleFacets.getHeatmapCounts(Simple

NPE when faceting with MLT Query from upgrade to Solr 5.1.0

2015-05-18 Thread Tim H
Hi everyone, Recently I upgraded to solr 5.1.0. When trying to generate facets using the more like this handler, I now get a a NullPointerException. I never got this exception while using Solr 4.10.0 Details are below: Stack Trace: at org.apache.solr.request.SimpleFacets.getHeatmapCounts(Simple

Solr Cloud 2nd Server Recover Stuck

2016-06-29 Thread Tim Chen
quot;}, "core_node4":{ "state":"down", "core":"cr_dev_shard1_replica2", "node_name":"10.2.11.244:8983_solr", "base_url":"http://10.2.11.244:8983/solr"}}}, &q

RE: Solr Cloud 2nd Server Recover Stuck

2016-06-29 Thread Tim Chen
Hi Erick, I have followed your instruction to added as new replica and deleted the old replica - works great! Everything back to normal now. Thanks mate! Cheers, Tim -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Thursday, 30 June 2016 1:49 AM To: solr

Is it possible to force a Shard Leader change?

2016-07-26 Thread Tim Chen
shutdown a single Replica that is currently a Shard Leader and force Solr to elect a different replica to be new Shard Leader? Thanks guys! Regards, Tim [Roots Wednesday 27 July 8.30pm]<http://www.sbs.com.au/programs/roots/>

RE: Is it possible to force a Shard Leader change?

2016-07-28 Thread Tim Chen
election. Thanks again. Cheers, Tim -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Thursday, 28 July 2016 12:10 AM To: solr-user Subject: Re: Is it possible to force a Shard Leader change? The REBALANCELEADERS stuff was put in to deal with 100s of leaders winding

Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-04 Thread Tim Chen
uster. Am I right? 2, Apparently we should not pushing too many documents to Solr, how do you guys handle this? Set a limit somewhere? Thanks, Tim [Premiere League Starts Saturday 13 August 9.30pm on SBS]<http://theworldgame.sbs.com.au/>

RE: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-05 Thread Tim Chen
restart it. A bit dirty, but may work for a short term. I don't know too much about how documents indexed, and how to save memory from that. Will probably work with a developer on this as well. Many Thanks guys. Cheers, Tim -Original Message- From: Shawn Heisey [mailt

RE: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-07 Thread Tim Chen
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Many thanks, Tim -Original Message- From: Erick Erickson [mailto:erickerick..

RE: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-07 Thread Tim Chen
ck where you started. And just as a sanity check: You didn't perchance increase the maxWarmingSearchers parameter in solrconfig.xml, did you? If so, that's really a red flag. Best, Erick On Fri, Aug 5, 2016 at 12:41 AM, Tim Chen wrote: > Thanks Guys. Very very helpful. > > I will

RE: Solr Cloud with 5 servers cluster failed due to Leader out of memory

2016-08-09 Thread Tim Chen
Guys, (@Erick & @Shawn), Thanks for the great suggestions! I have increased Tomcat MaxThreads from 200 to 1 on our staging environment. So far so good. I will perform some more indexing test and see how it goes. Many thanks, Tim -Original Message- From: Shawn Heisey [mailto

Solr 4.10 Joins: Slow performance with millions of documents

2016-08-14 Thread Tim Frey
Hi there. I'm trying to fix a performance problem I have with queries that use Solr's Join feature. The query is intended to find all Job Applications that have an Interview in a particular state. There are 20 million Job Applications and around 7 million Interviews, with 1 million Interviews in

Configuration options/concerns for multiple Solr versions

2016-10-14 Thread Tim Parker
o do so - any thoughts? Am I missing something?] -- Tim Parker Senior Engineer PaperThin, Inc. 300 Congress Street, Suite 303 Quincy, MA 02169 Ph: 617.471.4440 x203 CommonSpot helps organizations improve engagement across the web, mobile devices, and social media outlets to achieve better marketing

child doc filter

2016-11-03 Thread Tim Williams
ryWrapperFilter right after the child query is created[1] but before I did that, I wanted to see if there's a built-in way to achieve the same behavior? Thanks, --tim [1] - https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/search/join/BlockJoinParentQParser.java#L69

Re: Spatial Search based on the amount of docs, not the distance

2017-06-22 Thread Tim Casey
e are going to suggest some heuristic which avoids this problem. What Erick is suggesting is down this path. Query around a point and sort by distance taking the top K results. The result is taking a linear slice of the n^2 distance attribute. tim On Wed, Jun 21, 2017 at 7:50 PM, Erick Erickson

Re: Arabic words search in solr

2017-08-02 Thread Tim Casey
There should be a way to use a phrasal query for the specific names. On Wed, Aug 2, 2017 at 2:15 PM, Phil Scadden wrote: > Hopefully changing to default AND solves your problem. If so, I would be > quite interested in what your index config looks like in the end. I also > have upcoming need to i

Re: Solr query help

2017-08-18 Thread Tim Casey
29 30 31), which does all the days in march and apr. A more complicated nested query would do more complicated date ranges. I don't know if there is a way to get repeating date range queries, like the fourth tuesday for all months in a year. The date support is usually about querying a spec

Re: Java profiler?

2017-12-06 Thread Tim Casey
I really like Profiler. It takes a little bit of set up, but it works. tim On Wed, Dec 6, 2017 at 2:04 AM, Peter Sturge wrote: > Hi, > We'be been using JPRofiler (www.ej-technologies.com) for years now. > Without a doubt, the most comprehensive and useful profiler for java. >

Re: Howto search for § character

2017-12-07 Thread Tim Casey
separate tokens. So what happens to "§!" or "§?" or "?§", and in the case of things like text/email what happens to "§". In any event, my 2 pence worth tim On Thu, Dec 7, 2017 at 10:00 AM, Shawn Heisey wrote: > On 12/7/2017 9:37 AM, Bernd Schmi

Re: Question about best way to architect a Solr application with many data sources

2017-02-22 Thread Tim Casey
I would possibly extend this a bit futher. There is the source, then the 'normalized' version of the data, then the indexed version. Sometimes you realize you miss something in the normalized view and you have to go back to the actual source. This will be as likely as there are number of sources

Re: query rewriting

2017-03-07 Thread Tim Casey
et of required terms/phrases, then you can add terms to boost or remove non-required terms without any loss to the overall result set. This changes the order in which items are returned, so may impact user perception of recall, but is possible under for specific reasons. tim On Sun, Mar 5, 2017 at 11:

Re: model building

2017-03-21 Thread Tim Casey
l the result. tim On Mon, Mar 20, 2017 at 4:42 PM, Joel Bernstein wrote: > I've only tested with the training data in it's own collection, but it was > designed for multiple training sets in the same collection. > > I suspect you're training set is too small to

RE: Limit on # of collections -SolrCloud

2014-03-21 Thread Tim Potter
Hi Chris, Thanks for the link to Patrick's github (looks like some good stuff in there). One thing to try (and this isn't the final word on this, but is helpful) is to go into the tree view in the Cloud panel and find out which node is hosting the Overseer (/overseer_elect/leader). When restart

Solr Cloud Shards and Replica not reviving after restarting

2014-05-20 Thread Tim Burner
Hi Everyone, I have installed Solr Cloud 4.6.2 with external Zookeeper and Tomcat, having 3 shards with 2 replica each. I tried indexing some documents which went easy. After which I restarted my Tomcat, and now the Shards are not getting up, its coming up with bunch of Exceptions. First exceptio

Vague Behavior while setting Solr Cloud

2014-05-20 Thread Tim Burner
Hi Everyone, I am trying to setup Solr Cloud referring to the blog http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html if I complete the set in one go, then it seems to be going fine. when the setup is complete and I am trying to restart Solr by restarted Tomcat instance, it d

Re: Solr Cloud Shards and Replica not reviving after restarting

2014-05-20 Thread Tim Burner
is the log on the server. It's possible that > you've changed the configuration such that Solr can't start. Shot in > the dark, but that's where I'd start looking. > > Best, > Erick > > On Tue, May 20, 2014 at 4:45 AM, Tim Burner wrote: > > Hi

Re: Vague Behavior while setting Solr Cloud

2014-05-20 Thread Tim Burner
Thanks Shawn, I much appreciate your help I got it fixed, actually there were some background process already running for tomcat which weren't stopped by the time I faced these issues. Thanks again! Tim On Tue, May 20, 2014 at 11:33 PM, Shawn Heisey wrote: > On 5/20/2014 7:10 AM, Ti

Indexing getting failed after some millions of documents

2014-05-20 Thread Tim Burner
lr.common.SolrException: Error getting leader from zk for shard shard2"* Any suggestions/advice would be appreciated! Thanks! Tim

Re: Indexing getting failed after some millions of documents

2014-05-22 Thread Tim Burner
ocol.java:585) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:722) Looking forward for your respo

fq caching question

2013-10-14 Thread Tim Vaillancourt
sed 2 separate filter queries than 1 of 2 is still cached)? Cheers, Tim Vaillancourt

Re: fq caching question

2013-10-14 Thread Tim Vaillancourt
Thanks Koji! Cheers, Tim On 14/10/13 03:56 PM, Koji Sekiguchi wrote: Hi Tim, (13/10/15 5:22), Tim Vaillancourt wrote: Hey guys, Sorry for such a simple question, but I am curious as to the differences in caching between a "combined" filter query, and many separate filter quer

Skipping caches on a /select

2013-10-16 Thread Tim Vaillancourt
way to do this (without disabling my caches in solrconfig.xml), or is this feature request? Thanks! Tim Vaillancourt

Re: SolrCloud on SSL

2013-10-16 Thread Tim Vaillancourt
Not important, but I'm also curious why you would want SSL on Solr (adds overhead, complexity, harder-to-troubleshoot, etc)? To avoid the overhead, could you put Solr on a separate VLAN (with ACLs to client servers)? Cheers, Tim On 12 October 2013 17:30, Shawn Heisey wrote: > On 10

Re: Skipping caches on a /select

2013-10-17 Thread Tim Vaillancourt
, my guess is in the queryResultCache. At first the query takes 500ms+, then all subsequent requests take 0-1ms. I'll confirm this queryResultCache assumption today. Cheers, Tim On 16/10/13 06:33 PM, Yonik Seeley wrote: On Wed, Oct 16, 2013 at 6:18 PM, Tim Vaillancourt wrote: I am debugging s

Re: Skipping caches on a /select

2013-10-17 Thread Tim Vaillancourt
prevent the filterCache from being consulted for that query. " I will update the docs sometime soon to reflect that this can apply to any query (q or fq). Cheers, Tim On 17/10/13 01:44 PM, Chris Hostetter wrote: : Does "cache=false" appl

Re: difference between apache tomcat vs Jetty

2013-10-24 Thread Tim Vaillancourt
fair to go as far as saying Jetty is 100% THE "recommended" container for Solr, or should a recommendation be avoided, and maybe just a list of pros/cons? Cheers, Tim

Re: difference between apache tomcat vs Jetty

2013-10-24 Thread Tim Vaillancourt
Hmm, thats an interesting move. I'm on the fence on that one but it surely simplifies some things. Good info, thanks! Tim On 24 October 2013 16:46, Anshum Gupta wrote: > Thought you may want to have a look at this: > > https://issues.apache.org/jira/browse/SOLR-4792 > &g

Re: difference between apache tomcat vs Jetty

2013-10-25 Thread Tim Vaillancourt
I (jokingly) propose we take it a step further and drop Java :)! I'm getting tired of trying to scale GC'ing JVMs! Tim On 25/10/13 09:02 AM, Mark Miller wrote: Just to add to the “use jetty for Solr” argument - Solr 5.0 will no longer consider itself a webapp and will consider the

Re: Chegg is looking for a search engineer

2013-11-18 Thread Tim Casey
I have been chasing the chegg recruiters. I expect to here back from Glenn sometime tomorrow. tim On Mon, Nov 18, 2013 at 6:37 PM, Walter Underwood wrote: > I work at Chegg.com and I really like it, but we have more search work > than I can do by myself, so we are hiring a senior so

RE: Questions about commits and OOE

2013-12-04 Thread Tim Potter
Hi Metin, I think removing the softCommit=true parameter on the client side will definitely help as NRT wasn't designed to re-open searchers after every document. Try every 1 second (or even every few seconds), I doubt your users will notice. To get an idea of what threads are running in your J

RE: Setting routerField/shardKey on specific collection?

2013-12-04 Thread Tim Potter
Hi Daniel, I'm not sure how this would apply to an existing collection (in your case collection1). Try using the collections API to create a new collection and pass the router.field parameter. Grep'ing over the code, the parameter is named: router.field (not routerField or routeField). Cheers,

Inconsistent numFound in SC when querying core directly

2013-12-04 Thread Tim Vaillancourt
ld return inconsistent, flapping results if there are no deletes issued in my app to cause such jumps? Am I incorrect in my assumption that I am querying the core "directly"? An interesting observation is when I do an /admin/cores call to see the docCount of the core's index, it does not fluctuate, only the query result. That was hard to explain, hopefully someone has some insight! :) Thanks! Tim

Re: Inconsistent numFound in SC when querying core directly

2013-12-04 Thread Tim Vaillancourt
y /clusterstate.json - something is really wrong with this cloud! Would a Zookeeper issue explain my varied results when querying a core directly? Thanks again! Tim On 04/12/13 02:17 PM, Tim Vaillancourt wrote: Hey guys, I'm looking into a strange issue on an unhealthy 4.3.1 SolrClo

Re: Inconsistent numFound in SC when querying core directly

2013-12-04 Thread Tim Vaillancourt
rstanding how to directly query a core. Cheers, Tim On 04/12/13 02:46 PM, Markus Jelsma wrote: https://issues.apache.org/jira/browse/SOLR-4260 Join the club Tim! Can you upgrade to trunk or incorporate the latest patches of related issues? You can fix it by trashing the bad node's da

Re: Inconsistent numFound in SC when querying core directly

2013-12-04 Thread Tim Vaillancourt
Chris, this is extremely helpful and it's silly I didn't think of this sooner! Thanks a lot, this makes the situation make much more sense. I will gather some proper data with your suggestion and get back to the thread shortly. Thanks!! Tim On 04/12/13 02:57 PM, Chris Hoste

Re: Inconsistent numFound in SC when querying core directly

2013-12-04 Thread Tim Vaillancourt
st chain without recovering/re-replicating from leader. I imagine my Zookeeper ensemble is having some problems unrelated to Solr that is the real root cause. Thanks! Tim On 04/12/13 03:00 PM, Tim Vaillancourt wrote: Chris, this is extremely helpful and it's silly I didn't think of th

Re: Inconsistent numFound in SC when querying core directly

2013-12-05 Thread Tim Vaillancourt
e/destroy of the bad replica. Thanks all! Tim On 4 December 2013 16:50, Mark Miller wrote: > Keep in mind, there have been a *lot* of bug fixes since 4.3.1. > > - Mark > > On Dec 4, 2013, at 7:07 PM, Tim Vaillancourt wrote: > > > Hey all, > > > > Now that

RE: starting up solr automatically

2013-12-05 Thread Tim Potter
Apologies for chiming in late on this one ... just wanted to mention what I've used with good success in the past is supervisord (http://supervisord.org/). It's easy to install and configure and has the benefit of restarting nodes if they crash (such as due to an OOM). I'll also mention that you

Re: Inconsistent numFound in SC when querying core directly

2013-12-05 Thread Tim Vaillancourt
I spoke too soon, my plan for fixing this didn't quite work. I've moved this issue into a new thread/topic: "No /clusterstate.json updates on Solrcloud 4.3.1 Cores API UNLOAD/CREATE". Thanks all for the help on this one! Tim On 5 December 2013 11:37, Tim Vaillancourt

No /clusterstate.json updates on Solrcloud 4.3.1 Cores API UNLOAD/CREATE

2013-12-05 Thread Tim Vaillancourt
as the health of the Zookeeper ensemble, and all 3 Zookeepers have the same mZxid, ctime, mtime, etc for /clusterstate.json and receive updates no problem, just this node isn't updating Zookeeper somehow. Any thoughts are much appreciated! Thanks! Tim

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread Tim Potter
Hi Michael, Can you /get clusterstate.json again to see the contents? Also, maybe just a typo but you have `cate clusterstate.json` vs. `cat ..` Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com From: michael.boom Sent: Wednesday, Dece

RE: Cloud graph gone after manually editing clusterstate.json

2013-12-11 Thread Tim Potter
r. Software Engineer, LucidWorks www.lucidworks.com From: michael.boom Sent: Wednesday, December 11, 2013 8:21 AM To: solr-user@lucene.apache.org Subject: RE: Cloud graph gone after manually editing clusterstate.json Thanks for the reply Tim, Yes, tha

RE: Load existing HDFS files into solr?

2013-12-12 Thread Tim Potter
Hi Chen, I'm not aware of any direct integration between the two at this time. You might ping the Hive user list with this question too. That said, I've been thinking whether it makes sense to build a Hive StorageHandler for Solr? That at least seems like a quick way to go. However, it might al

RE: How can you move a shard from one SolrCloud node to another?

2013-12-16 Thread Tim Potter
Hi Chris, The easiest approach is to just create a new core on the new machine that references the collection and shard you want to migrate. For example, say you split shard1 of a collection named "cloud", which results in having: shard1_0 and shard1_1. Now let's say you want to migrate shard 1

RE: How can you move a shard from one SolrCloud node to another?

2013-12-16 Thread Tim Potter
re Engineer, LucidWorks www.lucidworks.com From: Yago Riveiro Sent: Monday, December 16, 2013 9:32 AM To: solr-user@lucene.apache.org Subject: Re: How can you move a shard from one SolrCloud node to another? Tim, Can you explain how the replication snapshot is done using the coreAdminAPI

RE: SolrCloud Suggester java ClassNotFoundException: org.apache.solr.suggest.tst.TSTLookup

2013-12-16 Thread Tim Potter
There have been some recent refactorings in this area of the code. The following class name should work: org.apache.solr.spelling.suggest.tst.TSTLookupFactory Cheers, Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com From: Trevor Handl

RE: SolrCloud Suggester java ClassNotFoundException: org.apache.solr.suggest.tst.TSTLookup

2013-12-16 Thread Tim Potter
Cloud Suggester java ClassNotFoundException: org.apache.solr.suggest.tst.TSTLookup Brilliant, thanks Timothy! Changing the solrconfig.xml lookupImpl (not className) to the org.apache.solr.spelling.suggest.tst.TSTLookupFactory fixed this issue for me. Thanks, Trevor -Original Message- From

RE: solr cloud - deleting and adding the same doc

2013-12-17 Thread Tim Potter
Yes, SolrCloud uses a transaction log to keep track of ordered updates to a document. The latest update will be immediately visible from the real-time get handler /get?id=X even without a commit. Cheers, Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com ___

RE: Solr failure results in misreplication?

2013-12-18 Thread Tim Potter
Any chance you still have the logs from the servers hosting 1 & 2? I would open a JIRA ticket for this one as it sounds like something went terribly wrong on restart. You can update the /clusterstate.json to fix this situation. Lastly, it's recommended to use an OOM killer script with SolrClou

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
I'm using logstash4solr (http://logstash4solr.org) for something similar ... I setup my Solr to use Log4J by passing the following on the command-line when starting Solr: -Dlog4j.configuration=file:///$SCRIPT_DIR/log4j.properties Then I use a custom Log4J appender that writes to RabbitMQ: htt

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
use I used Socketappender directly to write to logstash and logstash disk got full. that's why I moved to using AsyncAppender, and I plan on moving to using rabbit. but this is also why I wanted to filter some of the logs. indexing 150K docs prodcued 50GB of logs. this seemed too much. Tim

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
ubject: RE: monitoring solr logs And are you using any tool like kibana as a dashboard for the logs? Tim Potter wrote > We're (LucidWorks) are actively developing on logstash4solr so if you have > issues, let us know. So far, so good for me but I upgraded to logstash > 1.3.2 even though t

RE: side logging requests

2013-12-30 Thread Tim Potter
You can wire-in a custom UpdateRequestProcessor - http://wiki.apache.org/solr/UpdateRequestProcessor Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com From: elmerfudd Sent: Monday, December 30, 2013 10:26 AM To: solr-user@lucene.apache.

Re: Redis as Solr Cache

2014-01-02 Thread Tim Vaillancourt
es" needed logic outside of nginx but I didn't spend too much time on it. Tim On 2 January 2014 07:51, Alexander Ramos Jardim < alexander.ramos.jar...@gmail.com> wrote: > You touched an interesting point. I am really assuming if a quick win > scenario is even possible. Bu

RE: Solr Cloud Query Scaling

2014-01-09 Thread Tim Potter
Absolutely adding replicas helps you scale query load. Queries do not need to be routed to leaders; they can be handled by any replica in a shard. Leaders are only needed for handling update requests. In general, a distributed query has two phases, driven by a controller node (what you called c

Re: Perl Client for SolrCloud

2014-01-10 Thread Tim Vaillancourt
ld as input? Looking for ideas here. Thanks! Tim On 08/01/14 09:35 AM, Chris Hostetter wrote: :> I couldn't find anyone which can connect to SolrCloud similar to SolrJ's :> CloudSolrServer. : : Since I have a load balancer in front of 8 nodes, WebService::Solr[1] still : works f

RE: Trying to config solr cloud

2014-01-21 Thread Tim Potter
Hi Svante, It seems like the TermVectorComponent is in the search component chain of your /select search handler but you haven't indexed docs with term vectors enabled (at least from what's in the schema you provided). Admittedly, the NamedList code could be a little more paranoid but I think t

4.3.1 SC - IndexWriter issues causing replication + failures

2014-02-05 Thread Tim Vaillancourt
ys!! http://timvaillancourt.com.s3.amazonaws.com/tmp/solr.log-summarized.txt Thanks all, Tim

Re: 4.3.1 SC - IndexWriter issues causing replication + failures

2014-02-06 Thread Tim Vaillancourt
ute(SolrCore.java:1820) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:656) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:359) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:155) ... " T

RE: Solr Permgen Exceptions when creating/removing cores

2014-02-26 Thread Tim Potter
Hi Josh, Try adding: -XX:+CMSPermGenSweepingEnabled as I think for some VM versions, permgen collection was disabled by default. Also, I use: -XX:MaxPermSize=512m -XX:PermSize=256m with Solr, so 64M may be too small. Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com ___

RE: Replicating Between Solr Clouds

2014-03-04 Thread Tim Potter
Unfortunately, there is no out-of-the-box solution for this at the moment. In the past, I solved this using a couple of different approaches, which weren't all that elegant but served the purpose and were simple enough to allow the ops folks to setup monitors and alerts if things didn't work.

RE: SOLRJ and SOLR compatibility

2014-03-04 Thread Tim Potter
Just my 2 cents on this while I wait for a build ... I think we have to ensure that an older client will work with a newer server or newer client will work with older server to support hot rolling upgrades. It's not unheard of these days for an org to have 10's (or even 100's) of Solr cloud serv

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-14 Thread Tim Potter
Try adding shards.info=true and debug=track to your queries ... these will give more detailed information about what's going behind the scenes. On Mon, Oct 13, 2014 at 11:11 PM, S.L wrote: > Erick, > > I have upgraded to SolrCloud 4.10.1 with the same toplogy , 3 shards and 2 > replication facto

Re: Recovering from Out of Mem

2014-10-14 Thread Tim Potter
jfyi - the bin/solr script does the following: -XX:OnOutOfMemoryError="$SOLR_TIP/bin/oom_solr.sh $SOLR_PORT" where $SOLR_PORT is the port Solr is bound to, e.g. 8983 The oom_solr.sh script looks like: SOLR_PORT=$1 SOLR_PID=`ps waux | grep start.jar | grep $SOLR_PORT | grep -v grep | awk '{print

Re: Frequent recovery of nodes in SolrCloud

2014-10-17 Thread Tim Potter
A couple of things to check: 1) How many znodes are under the /overseer/queue (which you can see in the Cloud Tree panel in the Admin UI) 2) How often are you committing? The general advice is that your indexing client(s) should not send commits and instead rely on auto-commit settings in solrconf

Re: Recovering from Out of Mem

2014-10-17 Thread Tim Potter
restarts and > > troubleshooting manually > > > > > > e.g. something like the following for a java_error.sh will drop an email > > with a timestamp > > > > > > > > echo `date` | mail -s "Java Error: General - $HOSTNAME" > not...@domain.com > >

Solr error : sorry, no dataimport-handler defined!

2014-11-02 Thread Tim Dunphy
Hey guys, I'm real new at working with Solr. But I need to get up to speed and I appreciate your bearing with me. I've installed solr 4 and am running it under tomcat 7. The install went perfectly fine and everything seems to work, up to a point. I've even automated the installation with puppet

Re: Solr error : sorry, no dataimport-handler defined!

2014-11-02 Thread Tim Dunphy
revented it from fulfilling this request.* The only way for me to recover from this is to restore the solrconfig.xml from the backup file I created before altering the original. But of course when I do that, I still don't have the ability to import data from mysql. :( Any other ideas? T

  1   2   3   4   5   >