Re: What exactly happens to extant documents when the schema changes?

On Tue, May 28, 2013 at 3:58 PM, Jack Krupansky wrote: > The technical answer: Undefined and not guaranteed. > I was afraid of that! > Sure, you can experiment and see what the effects "happen" to be in any > given release, and maybe they don't tend to change (too much) between most > releases,

Re: Choosing specific fields for suggestions in SpellCheckerComponent

Hi Wilson, I don't think SpellCheckComponent supports multiple fields in the same dictionary. Am I missing something? On Wed, May 29, 2013 at 10:24 AM, Wilson Passos wrote: > Hi everyone, > > > I've been searching about how to configure the SpellCheckerComponent in > Solr 4.0 to support sugges

Re: Solr 4.3: node is seen as active in Zk while in recovery mode + endless recovery

I have opened https://issues.apache.org/jira/browse/SOLR-4870 On Tue, May 28, 2013 at 5:53 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > This sounds like a bug. I'll open an issue. Thanks! > > > On Tue, May 28, 2013 at 2:29 PM, AlexeyK wrote: > >> The cluster state problem report

Re: Solr 4.3: node is seen as active in Zk while in recovery mode + endless recovery

On Thu, May 23, 2013 at 7:00 PM, AlexeyK wrote: > from what I understood from the code, for each 'add' command there is a > test > for a 'delete by query'. if there is an older dbq, it's run after the 'add' > operation if its version > 'add' version. > in my case, there are a lot of documents

Re: Sorting results by last update date

On Wed, May 29, 2013 at 12:10 PM, Kamal Palei wrote: > Hi All > I am trying to sort the results as per last updated date. My url looks as > below. > > *&fq=last_updated_date:[NOW-60DAY TO NOW]&fq=experience:[0 TO > 588]&fq=salary:[0 TO 500] OR > > salary:0&fq=-bundle:job&fq=-bundle:panel&fq=-bund

Re: delta-import tweaking?

Hi Shawn; and first off, thanks bunches for your pointers. Am Tue, 28 May 2013 09:31:54 -0600 schrieb Shawn Heisey : > My workaround was to store the highest indexed autoincrement value in > a location outside Solr. In my original Perl code, I dropped it into > a file on NFS. The latest iterati

Reindexing strategy

I see that I do need to reindex my Solr index. The index consists of 20 million documents with a few hundred new documents added per minute (social media data). The documents are mostly smaller than 1KiB of data, but some may go as large as 10 KiB. All the data is text, and all indexed fields are s

Re: Strange behavior on text field with number-text content

Hmmm, there are two things you _must_ get familiar with when diagnosing these .. 1> admin/analysis. That'll show you exactly what the analysis chain does, and it's not always obvious. 2> add &debug=query to your input and look at the parsed query results. For instance, this "name:4nSolut

Re: Note on The Book

FWIW, picking up on Alexandre's point. One of my continual frustrations with virtually _all_ technical books is they become endless pages of details without ever mentioning why the hell I should care. Unfortunately, explaining use-cases for everything would only make the book about 10,000 pages lon

Re: Keeping a rolling window of indexes around solr

I suspect you're worrying about something you don't need to. At 1 insert every 30 seconds, and assuming 30,000,000 records will fit on a machine (I've seen this), you're talking 1,000,000 seconds worth of data on a single box! Or roughly 10,000 day's worth of data. Test, of course, YMMV. Or I'm mi

Re: split document or not

But in this case phrase frequence per whole document will be not taken into accout because document is splitted by subdocuments. Or it is not true? -- View this message in context: http://lucene.472066.n3.nabble.com/split-document-or-not-tp4066170p4066734.html Sent from the Solr - User mailing

Re: Note on The Book

IMHO I prefer narrative, as Erick says, explain all use-cases it's impossible, cover the base cases is a good start. Either way I miss a book about solr different to a cookbook or a guide. Regards. -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Wednesday, May 2

How can a Tokenizer be CoreAware?

I am currently testing some things with Solr 4.0.0. I tried to make a tokenizer CoreAware, and was rewarded with: Caused by: org.apache.solr.common.SolrException: Invalid 'Aware' object: com.basistech.rlp.solr.RLPTokenizerFactory@19336006 -- org.apache.solr.util.plugin.SolrCoreAware must be an ins

Re: Reindexing strategy

I presume you are running Solr on a multi-core/CPU server. If you kept a single process hitting Solr to re-index, you'd be using just one of those cores. It would take as long as it takes, I can't see how you would 'overload' it that way. I guess you could have a strategy that pulls 100 documents

Re: Reindexing strategy

On Wed, May 29, 2013 at 2:41 PM, Upayavira wrote: > I presume you are running Solr on a multi-core/CPU server. If you kept a > single process hitting Solr to re-index, you'd be using just one of > those cores. It would take as long as it takes, I can't see how you > would 'overload' it that way. >

Re: Note on The Book

Perhaps, you will enjoy mine then: http://www.packtpub.com/apache-solr-for-indexing-data/book . I will send a formal announcement to the list a little later, but basically this is a book for advanced beginners and early intermediates and takes them from a basic index to multilingual indexing with

Problem with xpath expression in data-config.xml

Replacing the contents of solr-4.3.0\example\example-DIH\solr\rss\conf\rss-data-config.xml by url="http://beautybooks88.blogspot.com/feeds/posts/default"; processor="XPathEntityProcessor" forEach="/feed/entry" transformer="DateFormatTransformer"> c

Advice : High-traffic web site

Hi Team, Please I need your advice, I have high-traffic web site (100 million page views/month) to 22 country and I want to build fast and powerfull search engine. So, I use solr 4.3 and sperate every country to collection , but I want to build right structure to accommodates high traffic .So, Wha

Re: split document or not

Do I need first search whole document Id and next between its paragraphs stored in separated docs? -- View this message in context: http://lucene.472066.n3.nabble.com/split-document-or-not-tp4066170p4066751.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Note on The Book

Erick, your point is well taken. Although my primary interest/skill is to produce a solid foundation reference (including tons of examples), the real goal is to then build on top of that foundation. While I focus on the hard-core material - which really does include some narrative and lots of

Re: What exactly happens to extant documents when the schema changes?

On 5/29/2013 1:07 AM, Dotan Cohen wrote: > In the case of this particular application, reindexing really is > overly burdensome as the application is performing hundreds of writes > to the index per minute. How might I gauge how much spare I/O Solr > could commit to a reindex? All the data that I n

[Announce] Apache Solr 4.1 with RankingAlgorithm 1.4.7 available now -- includes realtime-search with multiple granularities

I am very excited to announce the availability of Solr 4.3 with RankingAlgorithm40 1.4.8 with realtime-search with multiple granularities. realtime-search is very fast NRT and allows you to not only lookup a document by id but also allows you to search in realtime, see http://tgels.org/realtime

Re: Advice : High-traffic web site

I don't see how multi-cores will help you. Both SolrCloud or Master-Slave can work for you. Of course, SolrCloud helps you in terms of maintaining higher availability due to replica/leader fail over. If your queries are always going to be limited to one country then creating a collection per count

Re: Reindexing strategy

On 5/29/2013 6:01 AM, Dotan Cohen wrote: > I mean 'overload' Solr in the sense that it cannot read, process, and > write data fast enough because too much data is being handled. I > remind you that this system is writing hundreds of documents per > minute. Certainly there is a limit to what Solr ca

Re: Replica shards not updating their index when update is sent to them

I found how to solve the problem. After sending a file to be indexed to a replica shard (node2): curl 'http://node2:8983/solr/update?commit=true' -H 'Content-type: text/xml' --data-binary 'asdfbig moth' I can send a "commit" param to the same shard and then it gets updated: curl 'http://node2:8

RE: Why do FQs make my spelling suggestions so slow?

Andy, I opened this ticket so that someone can eventaully invistigate: https://issues.apache.org/jira/browse/SOLR-4874 Just an instanity check, I see I had misspelled "maxCollations" as "maxCollation" in my prior response. When you tested with this set the same as "maxCollationTries", did you

Escaping & character at Query

I use Solr 4.2.1 and I analyze that keyword: kelile&dimle at admin page: WT kelile&dimle SF kelile&dimle TLCF kelile&dimle However when I escape that charter and search it: solr/select?q=kelile\&dimle here is what I see: 0 148 *kelile\* I have edismax as default query parse

RE: Choosing specific fields for suggestions in SpellCheckerComponent

I assume here you've got a spellcheck field like this: ...so that a check against "Spelling_Dictionary" always checks all 4, right? This is the only way I know to approximate having it spellcheck across multiple fields. And as you have found, short of creating several separate versions o

Re: Why do FQs make my spelling suggestions so slow?

On May 29, 2013, at 9:46 AM, "Dyer, James" wrote: > Just an instanity check, I see I had misspelled "maxCollations" as > "maxCollation" in my prior response. When you tested with this set the same > as "maxCollationTries", did you correct my spelling? Yes, definitely. Thanks for the ticket.

Re: Escaping & character at Query

Hi, try with double quotation marks (" "). Carlos. 2013/5/29 Furkan KAMACI > I use Solr 4.2.1 and I analyze that keyword: > > kelile&dimle > > at admin page: > > WT > > kelile&dimle > > SF > > kelile&dimle > > TLCF > > kelile&dimle > > However when I escape that charter and search it: > > solr

using HTTP caching with shards in Solr 4.3

Hello, I'd like to take advantage of Solr's HTTP caching feature (httpCaching never304="false" in solrconfig.xml).. It is behaving as expected when I do a standard query against a Solr instance and then repeat it: I receive an HTTP304 (not modified) response. However, when using the "shards" fun

[Announce] Apache Solr 4.3 with RankingAlgorithm 1.4.8 available now -- includes realtime-search with multiple granularities (correction)

I am very excited to announce the availability of Solr 4.3 with RankingAlgorithm40 1.4.8 with realtime-search with multiple granularities. realtime-search is very fast NRT and allows you to not only lookup a document by id but also allows you to search in realtime, see http://tgels.org/realtime

Re: Escaping & character at Query

When I write: solr/select?q="kelile\&dimle" it still says: *"kelile\* 2013/5/29 Carlos Bonilla > Hi, > try with double quotation marks (" "). > > Carlos. > > > 2013/5/29 Furkan KAMACI > > > I use Solr 4.2.1 and I analyze that keyword: > > > > kelile&dimle > > > > at admin page: > > > >

Re: Escaping & character at Query

You need to UUEncode the & with %26: ...solr/select?q=kelile%26dimle Normally, & introduces a new URL query parameter in the URL. -- Jack Krupansky -Original Message- From: Furkan KAMACI Sent: Wednesday, May 29, 2013 10:55 AM To: solr-user@lucene.apache.org Subject: Escaping & char

Re: Escaping & character at Query

Hi, I meant: solr/select?q="kelile&dimle" Cheers. 2013/5/29 Jack Krupansky > You need to UUEncode the & with %26: > > ...solr/select?q=kelile%**26dimle > > Normally, & introduces a new URL query parameter in the URL. > > -- Jack Krupansky > > -Original Message- From: Furkan KAMACI Se

Re: Problem with xpath expression in data-config.xml

On Wed, May 29, 2013 at 6:05 PM, Hans-Peter Stricker wrote: > Replacing the contents of solr-4.3.0\example\example-** > DIH\solr\rss\conf\rss-data-**config.xml > > by > > > > >http://beautybooks88.* > *blogspot.com/feeds/posts/**default

Re: Escaping & character at Query

So, make it: solr/select?q="kelile%26dimle" -- Jack Krupansky -Original Message- From: Carlos Bonilla Sent: Wednesday, May 29, 2013 11:39 AM To: solr-user@lucene.apache.org Subject: Re: Escaping & character at Query Hi, I meant: solr/select?q="kelile&dimle" Cheers. 2013/5/29

Re: Why do FQs make my spelling suggestions so slow?

I also have problems getting the solrspellchecker to utilise existing FQ params correctly. we have some fairly monster queries eg : http://pastebin.com/4XzGpfeC I cannot seem to get our FQ parameters to be honored when generating results. In essence i am getting collations that yield no results w

Re: Not able to search Spanish word with ascent in solr

Solr returning error 500, when i post data with ascent chars... Any solution for that? -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-search-Spanish-word-with-ascent-in-solr-tp4064404p4066808.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Re: error while indexing huge filesystem with data import handler and FileListEntityProcessor

The configuraiton works with LineEntityProcessor, with few documents (havn (t test with many documents yet. For information this the config ... fields de

Re: Problem with xpath expression in data-config.xml

I created https://issues.apache.org/jira/browse/SOLR-4875 On Wed, May 29, 2013 at 9:15 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > > On Wed, May 29, 2013 at 6:05 PM, Hans-Peter Stricker > wrote: > >> Replacing the contents of solr-4.3.0\example\example-** >> DIH\solr\rss\conf\r

Re: Not able to search Spanish word with ascent in solr

On 29 May 2013 21:39, jignesh wrote: > Solr returning error 500, when i post data with ascent chars... > > Any solution for that? [...] Please look in the Solr logs for the appropriate error message. Regards, Gora

Solr Cloud Using Zookeeper SASL

Hiya all, Got a question that I hope someone can help me with. I was just wondering if anyone has ever used Solr Cloud using Zookeepers that have SASL authentication turned on? I can't seem to find any documentation on it so any help at all would be amazing! Thanks, Don Tran Developer Omnifon

RE: Why do FQs make my spelling suggestions so slow?

Instead of "maxCollationTries=0", use a value greater than zero. Zero means not to check if the collation will return hits. 1 means to test 1 possible combination against the index and return it only if it returns hits. 2 tries up to 2 possibilities, etc. As you have "spellcheck.maxCollation

Re: Not able to search Spanish word with ascent in solr

On May 29, 2013, at 18:09 , jignesh wrote: > Solr returning error 500, when i post data with ascent chars... > > Any solution for that? The solution probably involves using the correct encoding, and ensuring that the HTTP request sets the appropriate header values accordingly. In other words,

Re: Why do FQs make my spelling suggestions so slow?

James, this is very useful information. Can you please add this to the wiki? On Wed, May 29, 2013 at 10:36 PM, Dyer, James wrote: > Instead of "maxCollationTries=0", use a value greater than zero. Zero > means not to check if the collation will return hits. 1 means to test 1 > possible combina

RE: Why do FQs make my spelling suggestions so slow?

It has been in the wiki, more or less. See http://wiki.apache.org/solr/SpellCheckComponent#spellcheck.count and following sections. James Dyer Ingram Content Group (615) 213-4311 -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Wednesday, May 29, 2

Seeming bug in ConcurrentUpdateSolrServer

The comment here is clearly wrong, since there is no division by two. I think that the code is wrong, because this results in not starting runners when it should start runners. Am I misanalyzing? if (runners.isEmpty() || (queue.remainingCapacity() < queue.size() // queue // is // ha

Re: Indexing Solr, Multiple Doc Types. Production of Multiple Values for UniqueKey Field Using TemplateTransformer

: org.apache.solr.common.SolrException: Document contains multiple values for : uniqueKey field: uid=[A_1, dc1999fcf12df900] By the looks of things, your TemplateTransformer is properly creating a value of "A_${atest.id}" where "${atest.id} == 1" for that document ... the problem seems to be th

Re: Seeming bug in ConcurrentUpdateSolrServer

On Wed, May 29, 2013 at 11:29 PM, Benson Margulies wrote: > The comment here is clearly wrong, since there is no division by two. > > I think that the code is wrong, because this results in not starting > runners when it should start runners. Am I misanalyzing? > > if (runners.isEmpty() || (queue.

Re: Seeming bug in ConcurrentUpdateSolrServer

Ah. So now I have to find some other explanation of why it never creates more than one thread, even when I make a very deep queue and specify 6 threads. On Wed, May 29, 2013 at 2:25 PM, Shalin Shekhar Mangar wrote: > On Wed, May 29, 2013 at 11:29 PM, Benson Margulies > wrote: > >> The comment he

Re: SOLR 4.3.0 - How to make fq optional?

Hoss, for some reason this doesn't work when I pass the latlong value via query.. This is the query.. It just returns all the values for fname='peter' (doesn't filter for Tarmac, Florida). fl=*,score&rows=10&qt=findperson&fps_latlong=26.22084,-80.29&fps_fname=peter *solrconfig.xml*

Re: SOLR 4.3.0 - How to make fq optional?

: Hoss, for some reason this doesn't work when I pass the latlong value via : query.. ... : fl=*,score&rows=10&qt=findperson&fps_latlong=26.22084,-80.29&fps_fname=peter Hmmm, are these appends & invariants on your "findperson" requestHandler? What does debugQuery=true show you th

Problem with PatternReplaceCharFilter

Hi, I have a Problem when using PatternReplaceCharFilter when indexing a field. I created the following field: --> And I created a field that is indexed and stored: I need to index a do

Support for Mongolian language

Hi All, Does solr provide support for Mongolian language? Also which filters and tokenizers must be used for Chinese, Japanese and Korean languages? Regards, Sagar Chaturvedi DISCLAIMER: --

Re: SOLR 4.3.0 - How to make fq optional?

Ok..I removed all my custom components from findperson request handler.. lucene explicit 10 AND person_name_all_i 50 32 *:* {!switch case='*:*' default=$fq_bbox v=$fps_latlong}

Re: Support for Mongolian language

Check out.. wiki.apache.org/solr/LanguageAnalysis‎ For some reason the above site takes long time to open.. -- View this message in context: http://lucene.472066.n3.nabble.com/Support-for-Mongolian-language-tp4066871p4066874.html Sent from the Solr - User mailing list archive at Nabble.co

Re: Query syntax error: Cannot parse ....

# has a separate meaning in URL.. You need to encode that.. http://lucene.apache.org/core/3_6_0/queryparsersyntax.html#Escaping%20Special%20Characters. -- View this message in context: http://lucene.472066.n3.nabble.com/Query-syntax-error-Cannot-parse-tp4066560p4066879.html Sent from the Solr

Re: Grouping results based on the field which matched the query

Not sure if you are looking for this.. http://wiki.apache.org/solr/FieldCollapsing -- View this message in context: http://lucene.472066.n3.nabble.com/Grouping-results-based-on-the-field-which-matched-the-query-tp4065670p4066882.html Sent from the Solr - User mailing list archive at Nabble.com

Re: SOLR 4.3.0 - How to make fq optional?

: ... : : {!switch case='*:*' default=$fq_bbox : v=$fps_latlong} : : : _query_:"{!bbox pt=$fps_latlong sfield=geo : d=$fps_dist}" : : ...you have your "appends" and "invariants" nested inside your defaults -- they sh

Re: SOLR 4.3.0 - How to make fq optional?

I totally missed that..Sorry about that :)...It seems to work fine now... -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-3-0-How-to-make-fq-optional-tp4066592p4066891.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Note on The Book

Jack, I'd prefer tons of information instead of a meager 300 page book that leaves a lot of questions. I'm looking forward to a paperback or hardcover book and price doesn't really matter, it is going to be worth it anyway. Thanks, Markus -Original message- > From:Jack Krupansky >

Re: Seeming bug in ConcurrentUpdateSolrServer

I now understand the algorithm, but I don't understand why is the way it is. Consider one of these objects configure with a handful of threads and a pretty big queue. When the first request comes in, the object creates one runner. It then won't create a second runner until the Q reaches 1/2-full.

RE: Slow Highlighter Performance Even Using FastVectorHighlighter

Andy, > I don't understand why it's taking 7 secs to return highlights. The size > of the index is only 20.93 MB. The JVM heap Xms and Xmx are both set to > 1024 for this verification purpose and that should be more than enough. > The processor is plenty powerful enough as well. > > Running Visual

Solr query performance tool

Hi, Lately we are seeing increased latency times on solr and we would like to know which queries / facet searches are the most time consuming and heavy for our system. Is there any tool equivalent to the mysql low log? Does solr keep the times each query takes in some log? Thank you for your hel

Re: Problem with PatternReplaceCharFilter

Just replace the stripped markup with the equivalent number of spaces to maintain positions. Was there some specific problem you were encountering? -- Jack Krupansky -Original Message- From: jasimop Sent: Wednesday, May 29, 2013 4:12 PM To: solr-user@lucene.apache.org Subject: Proble

Re: Note on The Book

Markus, Okay, more pages it is! -- Jack Krupansky -Original Message- From: Markus Jelsma Sent: Wednesday, May 29, 2013 5:35 PM To: solr-user@lucene.apache.org Subject: RE: Note on The Book Jack, I'd prefer tons of information instead of a meager 300 page book that leaves a lot of q

java.lang.IllegalAccessError when invoking protected method from another class in the same package path but different jar.

Hi, I am overriding the query component and creating a custom component. I am using _responseDocs from org.apache.solr.handler.component.ResponseBuilder to get the values. I have my component in same package (org.apache.solr.handler.component) to access the _responseDocs value. Everything works f

Re: Support for Mongolian language

On Wed, May 29, 2013, at 09:34 PM, bbarani wrote: > Check out.. > > wiki.apache.org/solr/LanguageAnalysis‎ > > For some reason the above site takes long time to open.. There's a known performance issue with the wiki. Admins are working on it. Upayavira

Re: java.lang.IllegalAccessError when invoking protected method from another class in the same package path but different jar.

My assumptions were right :) I was able to fix this error by copying all my custom jar inside webapp/web-inf/lib directory and everything started working -- View this message in context: http://lucene.472066.n3.nabble.com/java-lang-IllegalAccessError-when-invoking-protected-method-fro

solr 4.3: write.lock is not removed

Hi, I recently upgraded solr from 3.6.1 to 4.3, it works well, but I noticed that after finishing indexing write.lock is NOT removed. Later if I index again it still works OK. Only after I shutdown Tomcat then write.lock is removed. This behavior caused some problem like I could not use

Re: Solr query performance tool

Hi, The regular Solr log logs Qtime for each query. Otis Solr & ElasticSearch Support http://sematext.com/ On May 29, 2013 5:59 PM, "Spyros Lambrinidis" wrote: > Hi, > > Lately we are seeing increased latency times on solr and we would like to > know which queries / facet searches are the most

Re: Solr query performance tool

The qtimes are in the solr log, you'll see lines like: params={q=*:*} hits=32 status=0 QTime=5 QTime is the time spent serving the query but does NOT include assembling the response. Best Erick On Wed, May 29, 2013 at 5:58 PM, Spyros Lambrinidis wrote: > Hi, > > Lately we are seeing increased l

Re: java.lang.IllegalAccessError when invoking protected method from another class in the same package path but different jar.

: Subject: java.lang.IllegalAccessError when invoking protected method from : another class in the same package path but different jar. ... : I am overriding the query component and creating a custom component. I am : using _responseDocs from org.apache.solr.handler.component.ResponseB

multiple field join?

http://wiki.apache.org/solr/Join I found solr join is actually sql subquery,does solr support 3 tables jion ? the sql like this SELECT xxx, yyy FROM collection1 WHERE outer_id IN (SELECT inner_id FROM collection1 where zzz = "vvv") and outer_id2 IN (SELECT inner_id2 FROM collection1 where tt

Re: Problem with PatternReplaceCharFilter

Honestly, I have no idea how to do that. PatternReplaceCharFilter doesn't seem to have a parameter like preservePositions="true" and optionally fillCharacter=" ". And I don't think I can express this simply as regex. How would I count in a pure regex the length difference before and after the match

Re: Not able to search Spanish word with ascent in solr

Hi, I am having a same kind of issue. I am not able to search accented characters of spanish. For eg: - Según, próximos etc. I have field called attr_content which holds the content of a PDF file whose contents are in spanish. I am using Apache Tika to index the contents of a PDF file. I have

Automatic cross linking

Hello, I'm looking to use Solr for creating cross linking in text. For exemple : I'll like to be able to request for a text field, an article, in my blog. And that Solr use a script/method, request to parse the text, find all matching categories term and caps the results. Do you have any sug