Re: Do we really need to build all existing index data again after changing schema? [scottchu]

2016-06-21 Thread Alexandre Rafalovitch
Well, if you are changing query analyzer chain, you can get away without reindexing. But if you change index analyzer chain, then your older tokens are stored in a different ways. Even if Solr does not complain, it will not match and may lead to very obscure issues. And if you change the type rad

Do we really need to build all existing index data again after changing schema? [scottchu]

2016-06-21 Thread scott.chu
According to https://wiki.apache.org/solr/HowToReindex, If I understand right, once we change schema after index built, we have to rebuild all index again. Is there really no other way to keep existing index data and still apply new schema? scott.chu,scott@udngroup.com 2016/6/22 (週三)

Re: SolrCloud: Adding a very large collection to a pre-existing cluster

2016-06-21 Thread Erick Erickson
One other option is to index "somewhere else", then use the collections API to "addreplica"s on your prod cluster. Then perhaps delete replica on the nodes that are "somewhere else". Best, Erick On Jun 21, 2016 4:27 PM, "Jeff Wartes" wrote: There’s no official way of doing #1, but there are som

Re: Solr Query Processing Detail

2016-06-21 Thread Erick Erickson
Where are you seeing that this does anything? It wouldn't be the first time new functionality happened that I totally missed, but I've never seen that config. You might get some mileage out of ReRankingQParserPlugin though, that runs the top N queries from one query through another. Best, Erick O

Re: AW: How many cores is too many cores?

2016-06-21 Thread Erick Erickson
Good luck! This really requires that you can configure your solr to cache N cores and don't expect more than N-M users in parallel. Or you don't mind if some users see periodic slow responses. You can sometimes make a hidden call when a user signs on to pre-load her core, but again your usage patte

RE: Solr 5.5 | Field boosting not working as per expectation

2016-06-21 Thread Erick Erickson
I strongly suspect you're making a false correlation between insertion time and results. Or you somehow have a sort by date clause. Solr does not do anything to automatically consider recency, you have to tell it to... Best, Erick On Jun 21, 2016 2:51 AM, "Megha Bhandari" wrote: > We have the fo

Re: Updating solr schema for a collection in place

2016-06-21 Thread Erick Erickson
Well, if it works... changing schema factories should be fine, assuming you've correctly configured before reload, I.e. point at the right schema file etc. My comments were more thinking about changing the schema rather than the config. Best, Erick On Jun 20, 2016 10:26 PM, "Stephen Lewis" wrote:

Multiple context field / filters in Solr suggester

2016-06-21 Thread Shamik Bandopadhyay
Hi, Just trying to understand if Solr suggester supports multiple filtering through the "contextField" option. As shown in the config below, is it possible to have two contextFields defined where I can use "cat" and "manu" as filtering criteria on the suggested result ? mySuggester

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Trey Grainger
Congrats Doug and John! Writing a book like this is a very long, arduous process (as several folks on this list can attest to). Writing a great book like this is considerably more challenging. I read through this entire book a few months ago before they put the final touches on it, and (for anyone

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Erik Hatcher
Hat tip, indeed. It’s a painful process and those that have survived it get my respect. Who doesn’t want Relevant Search? — Erik Hatcher, Senior Solutions Architect http://www.lucidworks.com > On Jun 21, 2016, at 2:12 PM, Doug Turnbull > wrote: > > Not much

Re: SolrCloud: Adding a very large collection to a pre-existing cluster

2016-06-21 Thread Jeff Wartes
There’s no official way of doing #1, but there are some less official ways: 1. The Backup/Restore API provides some hooks into loading pre-existing data dirs into an existing collection. Lots of caveats. 2. If you don’t have many shards, there’s always rsync/reload. 3. There are some third-party

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Alexandre Rafalovitch
Congratulations. I know it was a very long road. MEAP was really good, I am looking forward to reading the final version. Regards, Alex. Newsletter and resources for Solr beginners and intermediates: http://www.solr-start.com/ On 22 June 2016 at 04:12, Doug Turnbull wrote: > Not much

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Alessandro Benedetti
Congrats Doug ! I already pre-ordered a copy :) Well done ! Cheers ! On Tue, Jun 21, 2016 at 7:12 PM, Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Not much more to add than my post here! This book is targeted towards > Lucene-based search (Elasticsearch and Solr) relevance. > > A

Solr Query Processing Detail

2016-06-21 Thread John Bickerstaff
Hi all, I have a question about whether sub-queries in Solr requestHandlers go against the total index or against the results of the previous query. Here's a simple example: {!edismax qf=blah, blah} {!edismax qf=blah, blah} My question is: What does Query2 run "against

Re: How do we get terms suggestion from SuggestComponent?

2016-06-21 Thread Ahmet Arslan
Hi, With grams parameter of FreeTextLookupFactory, no? Ahmet On Tuesday, June 21, 2016 1:19 PM, solr2020 wrote: Thanks Ahmet. It is working fine. Now i would like to get suggestions for multiple terms. How do i get suggestions for multiple terms?

SolrCloud: Adding a very large collection to a pre-existing cluster

2016-06-21 Thread Kelly, Frank
We have about 200 million documents (~70 GB) we need to keep indexed across 3 collections. Currently 2 of the 3 collections are already indexed (roughly 90m docs). We'd like to create the remaining collection (about 100 m documents) but minimizing the performance impact on the existing collecti

RE: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Allison, Timothy B.
Not that I need any other book beyond this one... but I didn't realize that the 50% discount code applies to all books in the order. :) Congratulations, Doug and John! -Original Message- From: Doug Turnbull [mailto:dturnb...@opensourceconnections.com] Sent: Tuesday, June 21, 2016 2:12 P

RE: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Allison, Timothy B.
>Awesome, 0 pre and 1 post works! Great! > What if I wanted to match thirty, but exclude if six or seven are included > anywhere in the document? Any time you need "anywhere in the document", use a "regular" query (not SpanQuery). As you wrote initially, you can construct a BooleanQuery that

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread John Blythe
awesome, will definitely pick up a copy. booking my ticket to revolution before the next early bird special lapses, see some of you there! -- *John Blythe* Product Manager & Lead Developer 251.605.3071 | j...@curvolabs.com www.curvolabs.com 58 Adams Ave Evansville, IN 47713 On Tue, Jun 21, 201

Re: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Brandon Miller
Awesome, 0 pre and 1 post works! I replaced pre with Integer.MAX_VALUE and post with Integer.MAX_VALUE - 5 and it works! If I replace post with Integer.MAX_VALUE - 4 (or -3, -2, -1, -0), it fails. But, if it's -(5+), it appears to work. Thank you guys for suffering through my inexperience with So

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Doug Turnbull
Thanks Will and John! You both have also been helpful. If you want a great relevance-heavy search conference, you better be at Lucene/Solr Revolution in October!! http://lucenerevolution.org/ "Lucene Revolution: Officially Endorsed by the Authors of Relevant Search" See everyone on the mailing l

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread John Bickerstaff
Congrats! Now you can enjoy those huge royalty payments that I'm sure are coming in... Great book and it's been hugely helpful to me. --JohnB On Tue, Jun 21, 2016 at 12:12 PM, Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Not much more to add than my post here! This book i

Re: [ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Will Hayes
W00t! Congrats! On Jun 21, 2016 8:12 PM, "Doug Turnbull" < dturnb...@opensourceconnections.com> wrote: > Not much more to add than my post here! This book is targeted towards > Lucene-based search (Elasticsearch and Solr) relevance. > > Announcement with discount code: > http://opensourceconnectio

[ANN] Relevant Search by Manning out! (Thanks Solr community!)

2016-06-21 Thread Doug Turnbull
Not much more to add than my post here! This book is targeted towards Lucene-based search (Elasticsearch and Solr) relevance. Announcement with discount code: http://opensourceconnections.com/blog/2016/06/21/relevant-search-published/ Related hacker news thread: https://news.ycombinator.com/item?

RE: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Allison, Timothy B.
>Perhaps I'm misunderstanding the pre/post parameters? Pre/post parameters: " 'six' or 'seven' should not appear $pre tokens before 'thirty' or $post tokens after 'thirty' Maybe something like this: spanNear([ spanNear([field:one, field:thousand, field:one, field:hundred], 0, true), spanNot(

Re: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Brandon Miller
I saw the second post--the first post was new to me. We plan on connecting with those people later on, but right now, I'm trying to write a stop-gap dtSearch compiler until we can at least secure the funding we need to employ their help. Right now, I have a very functional query parser, with just

RE: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Allison, Timothy B.
> dtSearch allows a user to have NOTs embedded in proximity searches. And, if you're heading down the path of building your own queryparser to handle dtSearch's syntax, please read and heed Charlie Hull's post: http://www.flax.co.uk/blog/2016/05/13/old-new-query-parser/ See also: http://www.fl

RE: All Datanodes are Bad

2016-06-21 Thread Markus Jelsma
Hello Joseph, Your datanodes are in a bad state, you probably overwhelmed it when indexing. Check your max open files on those nodes. Usual default of 1024 is way too low. Markus -Original message- > From:Joseph Obernberger > Sent: Monday 20th June 2016 19:36 > To: solr-user@lucene

RE: SpanQuery - How to wrap a NOT subquery

2016-06-21 Thread Allison, Timothy B.
In the syntax for LUCENE-5205’s SpanQueryParser [0], that’d be [“one thousand one hundred thirty” (six seven)]!~0,1 In English: find “one thousand one hundred thirty”, but not if six or seven comes immediately after it. [0] https://github.com/tballison/lucene-addons/tree/master/lucene-5205 Fr

AW: How many cores is too many cores?

2016-06-21 Thread Sebastian Riemer
Thanks for your respone Erick! Currently we are trying to keep things simple so we don't use SolrCloud. I'll give it a look, configuration seems easy, however testing with many clients in parallel seems not so much. Thanks again, Sebastian -Ursprüngliche Nachricht- Von: Erick Erickson

Re: How do we get terms suggestion from SuggestComponent?

2016-06-21 Thread solr2020
Thanks Ahmet. It is working fine. Now i would like to get suggestions for multiple terms. How do i get suggestions for multiple terms?

RE: Solr 5.5 | Field boosting not working as per expectation

2016-06-21 Thread Megha Bhandari
We have the following in solrconfig.xml, nothing related to timestamp edismax metatag.keywords^90.1 metatag.description^50.1 title^1.1 h1^1000.7 h2^700.6 h3^10.1 h4^5.4 h5^1.3 h6^1.2 _text_^1.0 And the explain query doesn’

Re: Regarding CDCR SOLR 6

2016-06-21 Thread Renaud Delbru
Hi, On 15/06/16 03:18, Bharath Kumar wrote: Hi Renaud, Thank you so much for your response. It is very helpful and it helped me understand the need for turning on buffering. Is it recommended to keep the buffering enabled all the time on the source cluster? If the target cluster is up and runn

Re: Encryption to Solr indexes – Using Custom Codec

2016-06-21 Thread Renaud Delbru
Hi, maybe it is the way you created the jar ? Why not applying the patch to lucene/solr trunk and use ant jar instead to get the codecs jar created for you ? Also, I think the directory where you put the jars should be called "lib" instead of "Lib". you can try also to use the lib directives

RE: Encryption to Solr indexes – Using Custom Codec

2016-06-21 Thread Sidana, Mohit
Hello Bosco, As part of my thesis I am evaluating the existing solutions for Index level Encryption. I believe using this custom codec implementation would be a better choice as it provides very low level access and better control over index data.(As I am only intrested in how term dictionary

Re: Solr 5.5 | Field boosting not working as per expectation

2016-06-21 Thread Alexandre Rafalovitch
Sounds strange. Are you absolutely sure this insertion-time factor is not something you are doing explicitly? I would add debug=all parameter to see that you don't have some unexpectedly-complex biasing formula hiding in solrconfig.xml parameter. Regards, Alex. Newsletter and resources fo