Re: Are we still using jetty with solr 5?

2015-02-27 Thread Aman Tandon
Thanks Chris and Alex for clarification :) With Regards Aman Tandon On Fri, Feb 27, 2015 at 10:27 PM, Chris Hostetter wrote: > > : So are we still using the jetty? Are we still dependent on war file? > > As explained in the ref guide... > > > https://cwiki.apache.org/confluence/display/solr/Maj

About solr recovery

2015-02-27 Thread 龚俊衡
HI, Our production solr’s replication was offline in some time but both zookeeper and network is ok, and Solr jvm is normal. my question are there any other reason will let solr’s replication into recovering state?

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread h15234
> Followup: > > I was able to get Solr 5.0.0 started under the jetty9 distribution you > mentioned. I unpacked the jetty archive, changed into the unpacked > directory, and did these extremely simple and fast steps: > > * Copied solr.war from solr-5.0.0/server/webapps (in the Solr download) > in

Re: Unstemmed searching

2015-02-27 Thread Jan Høydahl
Passing query params down into analysis chain has been discussed before but I think it is a bit controversial/complex. How about a more high-level approach to be able to change query analyzer, e.g. [f..]q.analyzer= Then query parsers would use the specified analyzer for a field instead of the sc

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread Shawn Heisey
On 2/27/2015 4:29 PM, Shawn Heisey wrote: > On 2/27/2015 10:59 AM, h15...@mailas.com wrote: >> I'm trying a 1st deploy of Solr 5.0.0 in Jetty9 >> (jetty-distribution-9.2.9.v20150224). > > >> I've obviously misconfigured something. >> >> Appreciate any help figuring out what! Followup: I was abl

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread h15234
Thanks to all for the info. I'd made the mistake of staring with 3rd party tutorials which seem to miss some of the salient details!. RTFM'ing the official stuff now ... > I would strongly recommend that you simply run Solr 5 with the jetty > server (and the bin/solr script) that's included in

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread Shawn Heisey
On 2/27/2015 10:59 AM, h15...@mailas.com wrote: > I'm trying a 1st deploy of Solr 5.0.0 in Jetty9 > (jetty-distribution-9.2.9.v20150224). > I've obviously misconfigured something. > > Appreciate any help figuring out what! Add-on info to the replies you have already received: This may be hard

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread Chris Hostetter
: In 5.0 "the new way" is to not use a servlet container, just use the : start/stop scripts. More specifically... https://cwiki.apache.org/confluence/display/solr/Major+Changes+from+Solr+4+to+Solr+5 Internally, Solr is still implemented via Servlet APIs and is powered by Jetty -- but this is s

Re: deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread Erick Erickson
In 5.0 "the new way" is to not use a servlet container, just use the start/stop scripts. you should find a ...solr/bin/solr that you use to start/stop/whatever. You can still run with a "normal" servlet container, but is there a particular reason you need to? If not, just use the start/stop comme

Re: Encrypt Data in SOLR

2015-02-27 Thread Jack Krupansky
You could simply hash the value before sending it to Solr and then hash the user query before sending it to Solr as well. Do you need or want only exact matches, or do you need keyword search, wildcards, etc? -- Jack Krupansky On Fri, Feb 27, 2015 at 4:38 PM, Alexandre Rafalovitch wrote: > Don'

Re: Suggestion on indexing complex xml

2015-02-27 Thread Alexandre Rafalovitch
On 27 February 2015 at 16:11, Vishal Swaroop wrote: > I am able to index XML with same "name" element but in different XPATH by > using XPathEntityProcessor "forEach" (e.g. below) > > Just wondering if there is better way to handle this xml format. DIH's XML parser is rather limited and literally

Re: Encrypt Data in SOLR

2015-02-27 Thread Alexandre Rafalovitch
Don't store it? stored=false, indexed=true You may need bit more details really. There is no encryption, if you encrypt it, you cannot search it. So, you should concentrate on security of access instead and/or full-disk encryption (at the cost to performance) Regards, Alex. Solr Analy

Encrypt Data in SOLR

2015-02-27 Thread EXTERNAL Taminidi Ravi (ETI, AA-AS/PAS-PTS)
HI, Do Any one know how to encrypt the Solr Data Stored ? e.g. I have to do a search on the address for the customer, but the data should be not able to read by naked eyes? Thanks Ravi

RE: Unstemmed searching

2015-02-27 Thread Markus Jelsma
Hello Robert. Unstemmed terms have slightly higher IDF so they gain more weight, but stemmed tokens usually have slightly higher TF, so differences are marginal at best, especially when using standard TFIDFSimilarity. However, by setting a payload for stemmed terms, you can recognize them at sea

Suggestion on indexing complex xml

2015-02-27 Thread Vishal Swaroop
Hi, I am able to index XML with same "name" element but in different XPATH by using XPathEntityProcessor "forEach" (e.g. below) Just wondering if there is better way to handle this xml format. a) Is there any better way to handle this scenario as xml file will have multiple sub-menu attributes (

Unstemmed searching

2015-02-27 Thread Robert Haschart
Several months ago Tom-Burton West asked: The Solr wiki says "A repeated question is "how can I have the original term contribute more to the score than the stemmed version"? In Solr 4.3, the KeywordRepeatFilterFactory has been added to assist this functionality. " https://wi

Re: how to debug solr performance degradation

2015-02-27 Thread Shawn Heisey
On 2/27/2015 12:51 PM, Tang, Rebecca wrote: > Thank you guys for all the suggestions and help! I'Ve identified the main > culprit with debug=timing. It was the mlt component. After I removed it, > the speed of the query went back to reasonable. Another culprit is the > expand component, but I ca

Re: how to debug solr performance degradation

2015-02-27 Thread Tang, Rebecca
Thank you guys for all the suggestions and help! I'Ve identified the main culprit with debug=timing. It was the mlt component. After I removed it, the speed of the query went back to reasonable. Another culprit is the expand component, but I can't remove it. We've downgraded our amazon instance

Re: Does shard splitting double host count

2015-02-27 Thread tuxedomoon
I'd forgotten that DzkHost refers to the Zookeeper hosts not SOLR hosts. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Does-shard-splitting-double-host-count-tp4189595p4189703.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Does shard splitting double host count

2015-02-27 Thread Garth Grimm
You can't just add a new core to an existing collection. You can add the new node to the cloud, but it won't be part of any collection. You're not going to be able to just slide it in as a 4th shard to an established collection of 3 shards. The root of that comes from routing (I'll assume you

Re: Does shard splitting double host count

2015-02-27 Thread Shawn Heisey
On 2/27/2015 11:42 AM, tuxedomoon wrote: > What about adding one new leader/replica pair? It seems that would entail > > a) creating the r3.large instances and volumes > b) adding 2 new Zookeeper hosts? > c) updating my Zookeeper configs (new hosts, new ids, new SOLR config) > d) restarting all ZK

Re: Does shard splitting double host count

2015-02-27 Thread tuxedomoon
What about adding one new leader/replica pair? It seems that would entail a) creating the r3.large instances and volumes b) adding 2 new Zookeeper hosts? c) updating my Zookeeper configs (new hosts, new ids, new SOLR config) d) restarting all ZKs e) restarting SOLR hosts in sequence needed for co

deploying solr5 in Jetty9 - error "No context on this server matched or handled this request." ?

2015-02-27 Thread h15234
I'm trying a 1st deploy of Solr 5.0.0 in Jetty9 (jetty-distribution-9.2.9.v20150224). I've installed Jetty9 /etc/init.d/jetty check Checking arguments to Jetty: START_INI = /usr/local/etc/jetty/base/start.ini START_D= /usr/local/etc/jetty/base/start.d

Re: Are we still using jetty with solr 5?

2015-02-27 Thread Chris Hostetter
: So are we still using the jetty? Are we still dependent on war file? As explained in the ref guide... https://cwiki.apache.org/confluence/display/solr/Major+Changes+from+Solr+4+to+Solr+5#MajorChangesfromSolr4toSolr5-SolrisNowaStandaloneServer "Internally, Solr is still implemented via Servlet

Re: Solr Document expiration with TTL

2015-02-27 Thread Chris Hostetter
: There were no changes made in the solrconfig.xml file except added that : : block. ok, first off: if you already *had* another updateRequestProcessorChain that said 'default="true"' just adding a new one would be weird and would likely give you errors. you have t oconsider the whole context

Delimited payloads input issue

2015-02-27 Thread Markus Jelsma
Hi - we attempt to use payloads to identify different parts of extracted HTML pages and use the DelimitedPayloadTokenFilter to assign the correct payload to the tokens. However, we are having issues for some language analyzers and issues with some types of content for most regular analyzers. If

Re: [ANNOUNCE] Luke 4.10.3 released

2015-02-27 Thread Tomoko Uchida
Hi Dmitry, In my environment, I cannot produce this pivots's error in HotSpot VM 1.7.0, please give me some time... Or, I'll try to make pull requests https://github.com/DmitryKey/luke for pivots's version. At any rate, it would be best to manage both of (current) thinlet's and pivots's versions

Re: Does shard splitting double host count

2015-02-27 Thread Shawn Heisey
On 2/27/2015 7:15 AM, tuxedomoon wrote: > I currently have a SolrCloud with 3 shards + replicas, it is holding 130M > documents and the r3.large hosts are running out of memory. As it's on 4.2 > there is no shard splitting, I will have to reindex to a 4.3+ version. > > If I had that feature would

RE: Does shard splitting double host count

2015-02-27 Thread Garth Grimm
Well, if you're going to reindex on a newer version, just start out with the number of shards you feel is appropriate, and reindex. But yes, if you had 3 shards, wanted to split some of them, you'd really have to split all of them (making 6), if you wanted the shards to be about the same size. As

Does shard splitting double host count

2015-02-27 Thread tuxedomoon
I currently have a SolrCloud with 3 shards + replicas, it is holding 130M documents and the r3.large hosts are running out of memory. As it's on 4.2 there is no shard splitting, I will have to reindex to a 4.3+ version. If I had that feature would I need to split each shard into 2 subshards result

Re: Solr Document expiration with TTL

2015-02-27 Thread Alexandre Rafalovitch
Yep, Your default URP chain is probably not being triggered due to the initParams. initParams are new in Solr 5, so this is still rough around the edges advice. But try giving your chain a name and adding explicit "update.chain" value to the requestHandler section (not initParams) section. Alter

Re: Dependency Need to include for embedded solr.

2015-02-27 Thread Shawn Heisey
On 2/27/2015 12:51 AM, Danesh Kuruppu wrote: > I am doing some feasibility studies for moving directly to solr 5.0.0. > > One more thing, It is related to standalone server. > > How security handle in solr standalone server. lets say, I configured my > application to use remote solr standalone se

Re: Solr Document expiration with TTL

2015-02-27 Thread Makailol Charls
Hi Thanks for the reply. I am just beginning with the solr, so not much familiar with the settings of the solr. I have created solr "collection1" core with the following command. bin/solr create -c collection1 Then modified the managed-schema file to add required field definitions There were n

Re: Solr Document expiration with TTL

2015-02-27 Thread Makailol Charls
Hi, Thanks for the reply. I tried adding following code block in in solrconfig.xml. timestamp_dt and added field definition in managed-schema But then dont see this field is getting populated in document. Thanks, Makailol On Thu, Feb 26, 2015 at 8:08 PM, Alexandre Rafalovitch wrote:

Re: qt.shards in solrconfig.xml

2015-02-27 Thread Oleg Savrasov
Hi Benson, Shalin, One more thing that I noticed in your configuration is incorrect definition of default Solr parameters. You should use tag, not Oleg 2015-02-27 6:23 GMT+03:00 Shalin Shekhar Mangar : > Hi Benson, > > Do not use shards.qt with a leading '/'. See > https://issues.apache.org/j

Re: Are we still using jetty with solr 5?

2015-02-27 Thread Alexandre Rafalovitch
Yes, but these are now implementation details and may change in 5.x version (as opposed to waiting for 6.0). So, if you are troubleshooting, it is Jetty underneath with a war file. But from the architectural point of view, it is now a black box. So, Tomcat deployments are officially no longer supp

Re: Can't index all docs in a local folder with DIH in Solr 5.0.0

2015-02-27 Thread Gary Taylor
Alex, I've created JIRA ticket: https://issues.apache.org/jira/browse/SOLR-7174 In response to your suggestions below: 1. No exceptions are reported, even with onError removed. 2. ProcessMonitor shows only the very first epub file is being read (repeatedly) 3. I can repeat this on Ubuntu (14.

Solr highlighting of multiple terms, what is the separator of the string that is returned

2015-02-27 Thread happysailingdude
http://stackoverflow.com/questions/4014820/solr-highlighting-of-multiple-terms tells us how to have multiple snippets be returned containing highlighted searched terms.. my question is: What is the separator of the string that is returned? I'm seeing it as a carriage return which isn't very helpfu

Re: Solr logs encoding

2015-02-27 Thread Rajesh Hazari
I have seen this log earlier, I just changed the log level of this class to WARN. On Feb 27, 2015 12:03 AM, "Moshe Recanati" wrote: > Hi, > > I've wired situation. Starting yesterday restart I've issue with log > encoding. My log looks like: > > DEBUG - 2015-02-27 10:47:01.432; << > "[0x4][0xfc

Re: Log numfound, qtime, ...

2015-02-27 Thread Mikhail Khludnev
Did you check Kibana/Banana ? On Fri, Feb 27, 2015 at 2:07 PM, bengates wrote: > Hello everyone, > > Here's my need : I'd like to log Solr Responses so as to achieve some > business statistics. > I'd like to report, as a daily/weekly/yearly/whateverly basis, the > following > KPIs : > - Most pop

Log numfound, qtime, ...

2015-02-27 Thread bengates
Hello everyone, Here's my need : I'd like to log Solr Responses so as to achieve some business statistics. I'd like to report, as a daily/weekly/yearly/whateverly basis, the following KPIs : - Most popular requests (hits) - Average numfound for each request - Average response time for each request

Are we still using jetty with solr 5?

2015-02-27 Thread Aman Tandon
Hi, I am trying to understand the new verson of solr 5 and when I was trying to stop the solr instance with the command "*bin/solr stop -p 8983*", I found this message, *Sending stop command to Solr running on port 8983 ... waiting 5 seconds to allow Jetty process 7028 to stop gracefully.* So ar