Replication after re adding nodes to cluster (sleeping replicas)

2013-11-01 Thread michael.boom
I have a SolrCloud cluster holding 4 collections, each with with 3 shards and replication factor = 2. They all live on 2 machines, and I am currently using this setup for testing. However, i would like to connect this test setup to our live application, just for benchmarking and evaluating if it c

Custom Plugin exception : Plugin init failure for [schema.xml]

2013-11-01 Thread Parvin Gasimzade
Hi all, I have a problem with custom plugin development in solr 4.x versions. I have developed custom filter and trying to install it but I got following exception. Schema xml : Btw, I could not get any exception on 3.x versions. Any he

Re: Store Solr OpenBitSets In Solr Indexes

2013-11-01 Thread Erick Erickson
Why are you saving this? Because if the bitset you're saving has anything to do with, say, filter queries, it's probably useless. The internal bitsets are often based on the internal Lucene doc ID, which will change when segment merges happen, thus the caution. Otherwise, theres the binary type y

Re: Indexing logs files of thousands of GBs

2013-11-01 Thread Erick Erickson
Throwing a multi-gigabyte file at Solr and expecting it to index it is asking for a bit too much. You either have to stream it up and break it apart or something similar. And consider what happens if you just index the log as a single document. How do you search it? Do you return several G as the

Re: Simple (?) zookeeper question

2013-11-01 Thread Alan Woodward
Unknown document router errors are usually caused by using different solr and solrj versions - which version of solr and solrj are you using? Alan Woodward www.flax.co.uk On 1 Nov 2013, at 04:19, Jack Park wrote: > After digging deeper (slow for a *nix newbee), I uncovered issues with > the ja

Re: How to get similarity score between 0 and 1 not relative score

2013-11-01 Thread Peter Keegan
There's another use case for scaling the score. Suppose I want to compute a custom score based on the weighted sum of: - product(0.75, relevance score) - product(0.25, value from another field) For this to work, both fields must have values between 0-1, for example. Toby's example using the scale

Can I combine standardtokenizer with solr.WordDelimiterFilterFactory?

2013-11-01 Thread eShard
Good morning, Here's the issue: I have and ID that consists of two letters and a number. The whole user title looks like this: Lastname, Firstname (LA12345). Now, with my current configuration, I can search for LA12345 and find the user. However, when I type in just the number I get zero results.

Re: HTTP Basic Authentication with solr's jetty

2013-11-01 Thread Fabiano Sidler
Thus wrote Fabiano Sidler: > Hi folks! > > I was asking this question last week already on the jetty mailing list, but > haven't got any answer. > > I'm going to run multiple Solr instances on one server, which arises the need > of user authentication in front of Solr. I've done the following ste

Re: Can I combine standardtokenizer with solr.WordDelimiterFilterFactory?

2013-11-01 Thread Oussama Jilal
Yes you can and I don't see any reason why you should not Le 01/11/2013 15:38, eShard a écrit : Good morning, Here's the issue: I have and ID that consists of two letters and a number. The whole user title looks like this: Lastname, Firstname (LA12345). Now, with my current configuration, I can

Re: Can I combine standardtokenizer with solr.WordDelimiterFilterFactory?

2013-11-01 Thread Yonik Seeley
On Fri, Nov 1, 2013 at 11:38 AM, eShard wrote: > I have and ID that consists of two letters and a number. > The whole user title looks like this: Lastname, Firstname (LA12345). > Now, with my current configuration, I can search for LA12345 and find the > user. > However, when I type in just the nu

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
Alan, That was brilliant! My test harness was behind a couple of notches. Hah! So, now we open yet another can of strange looking creatures, namely: No live SolrServers available to handle this request:[http://127.0.1.1:8983/solr/collection1] at org.apache.solr.client.solrj.impl.CloudSolrServer.

Re: Custom Plugin exception : Plugin init failure for [schema.xml]

2013-11-01 Thread Shawn Heisey
On 11/1/2013 4:18 AM, Parvin Gasimzade wrote: > I have a problem with custom plugin development in solr 4.x versions. I > have developed custom filter and trying to install it but I got following > exception. Later you indicated that you can use it with Solr 3.x without any problem. Did you recom

Exclude urls without 'www' from Nutch 1.7 crawl

2013-11-01 Thread Reyes, Mark
I'm currently using Nutch 1.7 to crawl my domain. My issue is specific to URLs being indexed as www vs. non-www. Specifically, after firing the crawl and index to Solr 4.5 then validating the results on the front-end with AJAX Solr, the search results page lists results/pages that are both 'www

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
/clusterstate.json seems to clearly state that all 3 nodes are alive, have ranges, and are active. Still, it would seem that java is still not properly installed. ZooKeeper is dropping zookeeper.out in the /bin directory, which says this, among other things: Server environment:java.home=/usr/loca

RE: Exclude urls without 'www' from Nutch 1.7 crawl

2013-11-01 Thread Markus Jelsma
Hi - Use the domain-urlfilter for host, domain and TLD filtering. Also, please ask questions on the Nutch list, you're on Solr now :) -Original message- > From:Reyes, Mark > Sent: Friday 1st November 2013 17:24 > To: solr-user@lucene.apache.org > Subject: Exclude urls without 'www' fr

Re: Exclude urls without 'www' from Nutch 1.7 crawl

2013-11-01 Thread Furkan KAMACI
As Markus pointed Nutch has a feature for such kind of situation. Here is Solr list but one more thing for you: www.mywebsite.com and mywebsite.commay point to "different" pages. 2013/11/1 Markus Jelsma > Hi - Use the domain-urlfilter for host, domain and TLD filtering. > > Also, please ask que

Re: Exclude urls without 'www' from Nutch 1.7 crawl

2013-11-01 Thread Reyes, Mark
Noted and will do (that goes twice for the suggestions and putting this on the nutch list instead). Thanks all, Mark On 11/1/13, 10:53 AM, "Furkan KAMACI" wrote: >As Markus pointed Nutch has a feature for such kind of situation. Here is >Solr list but one more thing for you: www.mywebsite.com

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
The top error message at my test harness is this: No live SolrServers available to handle this request: [http://127.0.1.1:8983/solr/collection1, http://127.0.1.1:7574/solr/collection1, http://127.0.1.1:7590/solr/collection1] I have to assume that error message was somehow shipped by zookeeper, be

Re: Simple (?) zookeeper question

2013-11-01 Thread Shawn Heisey
On 11/1/2013 12:07 PM, Jack Park wrote: The top error message at my test harness is this: No live SolrServers available to handle this request: [http://127.0.1.1:8983/solr/collection1, http://127.0.1.1:7574/solr/collection1, http://127.0.1.1:7590/solr/collection1] I have to assume that error me

Re: Simple (?) zookeeper question

2013-11-01 Thread Jack Park
Thanks. I reviewed clusterstate.json again; those URLs are alive. Why they are not responding seems to be the mystery du jour. I reviewed my test suite: it is using field names in schema.xml, and the server is configured to use the update responders I installed, all of which work fine in a non-clo

Re: Error with CollapsingQParserPlugin when trying to use tagging

2013-11-01 Thread dboychuck
The following unit test in TestCollapseQParserPlugin.java illustrates the bug ModifiableSolrParams params = new ModifiableSolrParams(); params.add("q", "*:*"); params.add("fq", "{!collapse field=group_s}"); params.add("defType", "edismax"); params.add("bf", "field(test_ti)"); params.add("fq","{!ta

Re: Error with CollapsingQParserPlugin when trying to use tagging

2013-11-01 Thread dboychuck
I've created the following tracker for the issue: https://issues.apache.org/jira/browse/SOLR-5416 -- View this message in context: http://lucene.472066.n3.nabble.com/Error-with-CollapsingQParserPlugin-when-trying-to-use-tagging-tp4098709p4098862.html Sent from the Solr - User mailing list archi

Re: Highlight: simple.pre/post not being applied always

2013-11-01 Thread Furkan KAMACI
Could you write down your parameters for highlighting and information about your "analysts_texts" field type? 2013/10/31 Andy Pickler > Solr: 4.5.1 > > I'm sending in a query of "july" and getting back the results and > highlighting I expect with one exception: > > > > > @@@hl@@@Julie@@@endh

Problem of facet on 170M documents

2013-11-01 Thread Mingfeng Yang
I have an index with 170M documents, and two of the fields for each doc is "source" and "url". And I want to know the top 500 most frequent urls from Video source. So I did a facet with "fq=source:Video&facet=true&facet.field=url&facet.limit=500", and the matching documents are about 9 millions.