solr parallel update and total indexing Issue

2014-04-17 Thread ~$alpha`
There is a bis issue in solr parallel update and total indexing Total Import syntax (working) dataimport?command=full-import&commit=true&optimize=true Update syntax(working) solr/update?softCommit=true' -H 'Content-type:application/json' -d '[{"id":"1870719","column":{"set":11}}]

'qt' parameter is not working in search call of SolrPhpClient

2014-04-17 Thread harshrossi
I am using SolrPhpClient for interacting with Solr via PHP. I am using a custom request handler ( /select_test ) with 'edismax' feature in Solr config file explicit json edismax text name topic description text 100%

Re: Another japanese analysis problem

2014-04-17 Thread Alexandre Rafalovitch
Did you read through the CJK article series? Maybe there is something in there? http://discovery-grindstone.blogspot.com/2013/10/cjk-with-solr-for-libraries-part-1.html Sorry, no help on actual Japanese. Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://ww

Re: Another japanese analysis problem

2014-04-17 Thread Shawn Heisey
On 4/10/2014 11:53 AM, Shawn Heisey wrote: > My analysis chain includes CJKBigramFilter on both the index and query. > I have outputUnigrams enabled on the index side, but it is disabled on > the query side. This has resulted in a problem with phrase queries. > This is a subset of my index analy

How to stop long running query ?

2014-04-17 Thread Jagdish Vasani
Hi , I have long query (full text search with 1K line each having Boolean query),that's running for long time, sometime utilizing 99% cpu. Except Timelimiting Collector option, do we have any other functionality to stop that query ? Thanks, Jagdish

Filtering Solr Queries

2014-04-17 Thread kumar
Hi, I am indexing the data using title, city and location fields. but different cities are having same location names like "rajaji nagar", "rajajinagar". When user types computers in rajaji nagarIt has to display results like "computers in rajajinagr" as well as "computers in rajaji n

Re: cache warming questions

2014-04-17 Thread Erick Erickson
No, the 5 most recently used in a query will be used to autowarm. If you have things you _know_ are going to be popular fqs, you could put them in newSearcher queries. Best, Erick On Thu, Apr 17, 2014 at 4:51 PM, Kranti Parisa wrote: > Erik, > > I have a followup question on this topic. > > If

Re: How to get a list of currently executing queries?

2014-04-17 Thread Alexandre Rafalovitch
Do you mean the ones currently being executed, as opposed to ones that finished? You can see ones that finished in the logs. But if you want once in flight, I don't think there is a current functionality. But there could be. A custom SearchComponent (http://wiki.apache.org/solr/SearchComponent) co

Re: waitForLeaderToSeeDownState when leader is down

2014-04-17 Thread Jessica Mallet
Hi Mark, I'm using "roughly" the 4x branch up to this commit: https://github.com/apache/lucene-solr/tree/25aaf44221e3a3be8fab1ba22f16b13f5df6c64c. Will you please point me to the jira that addressed this? I couldn't find it with "waitForLeaderToSeeDownState". Thanks, Jessica On Wed, Apr 16, 201

Re: cache warming questions

2014-04-17 Thread Kranti Parisa
Erik, I have a followup question on this topic. If we have used 10 unique FQs and when we configure filterCache=100 & autoWarm=5, then which 5 out of the 10 will be repopulated in the case of new searcher? I don't think there is a way to set the preference or there is? Thanks, Kranti K. Parisa

Spelling suggestions--any ideas?

2014-04-17 Thread Ed Smiley
Correctly spelled words are returning as not spelled correctly, with the original, correctly spelled word with a single oddball character appended as multiple suggestions... -- Ed Smiley, Senior Software Architect, eBooks ProQuest | 161 E Evelyn Ave| Mountain View, CA 94041 | USA | +1 650 475 87

RE: cache warming questions

2014-04-17 Thread Matt Kuiper
Ok, that makes sense. Thanks again, Matt Matt Kuiper - Software Engineer Intelligent Software Solutions p. 719.452.7721 | matt.kui...@issinc.com www.issinc.com | LinkedIn: intelligent-software-solutions -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Thu

Re: index merge question

2014-04-17 Thread Brett Hoerner
Sorry to bump this, I have the same issue and was curious about the sanity of trying to work around it. * I have a constant stream of realtime documents I need to continually index. Sometimes they even overwrite very old documents (by using the same unique ID). * I also have a *huge* backlog of do

why sha1?

2014-04-17 Thread Ahmet Arslan
Hello,  Artifacts http://www.us.apache.org/dist/lucene/solr/4.7.2/ distributed with SHA1 hash and .sha1 suffix is used.  According to http://www.apache.org/dev/release-signing.html#basic-facts  * An SHA checksum should also be created and must be suffixed .sha  * SHA-1 should be avoided  Is th

Re: Topology of Solr use

2014-04-17 Thread Olivier Austina
Thank you Markus, the link is very useful. Regards Olivier 2014-04-17 18:24 GMT+02:00 Markus Jelsma : > This may help a bit: > > https://wiki.apache.org/solr/PublicServers > > -Original message- > From:Olivier Austina > Sent:Thu 17-04-2014 18:16 > Subject:Topology of Solr use > To:so

Replication using relative path?

2014-04-17 Thread bbi123
Hi, I need to replicate a file outside the conf directory since that is being used by multiple SOLR cores. Is there a way to do that by specifying the relative path? Ex: Something like ../../../CommonRules/common.drl I don't want to put this file under a specific core as this will be used by

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-17 Thread Brett Hoerner
https://gist.github.com/bretthoerner/0dc6bfdbf45a18328d4b On Thu, Apr 17, 2014 at 11:31 AM, Mark Miller wrote: > Odd - might be helpful if you can share your sorlconfig.xml being used. > > -- > Mark Miller > about.me/markrmiller > > On April 17, 2014 at 12:18:37 PM, Brett Hoerner (br...@brettho

Re: Confusion when using go-live and MapReduceIndexerTool

2014-04-17 Thread Mark Miller
Odd - might be helpful if you can share your sorlconfig.xml being used. --  Mark Miller about.me/markrmiller On April 17, 2014 at 12:18:37 PM, Brett Hoerner (br...@bretthoerner.com) wrote: I'm doing HDFS input and output in my job, with the following: hadoop jar /mnt/faas-solr.jar \ -D mapr

RE: Topology of Solr use

2014-04-17 Thread Markus Jelsma
This may help a bit: https://wiki.apache.org/solr/PublicServers   -Original message- From:Olivier Austina Sent:Thu 17-04-2014 18:16 Subject:Topology of Solr use To:solr-user@lucene.apache.org; Hi All, I would to have an idea about Solr usage: number of users, industry, countries or any h

Re: deleting large amount data from solr cloud

2014-04-17 Thread Vinay Pothnis
Thanks Erick! On 17 April 2014 08:35, Erick Erickson wrote: > bq: Will it get split at any point later? > > "Split" is a little ambiguous here. Will it be copied into two or more > segments? No. Will it disappear? Possibly. Eventually this segment > will be merged if you add enough documents to

Confusion when using go-live and MapReduceIndexerTool

2014-04-17 Thread Brett Hoerner
I'm doing HDFS input and output in my job, with the following: hadoop jar /mnt/faas-solr.jar \ -D mapreduce.job.map.class=com.massrel.faassolr.SolrMapper \ --update-conflict-resolver com.massrel.faassolr.SolrConflictResolver \ --morphline-file /mnt/morphline-ignore.conf \

Topology of Solr use

2014-04-17 Thread Olivier Austina
Hi All, I would to have an idea about Solr usage: number of users, industry, countries or any helpful information. Thank you. Regards Olivier

Re: Delete field in Solr

2014-04-17 Thread Gurfan
*Sorry, missed to add Filed entry from schema.xml * Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Delete-field-in-Solr-tp4131003p4131769.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Collection - loadOnStartup

2014-04-17 Thread Rich Mayfield
You're right, we're basically working around inherent problems. SolrCloud and large numbers of cores is not a combination that yields reliable restarts. Even under the best of conditions - a completely silent (no updates, no selects) environment - if I restart two nodes, each containing ~800 replic

Re: deleting large amount data from solr cloud

2014-04-17 Thread Erick Erickson
bq: Will it get split at any point later? "Split" is a little ambiguous here. Will it be copied into two or more segments? No. Will it disappear? Possibly. Eventually this segment will be merged if you add enough documents to the system. Consider this scenario: you add 1M docs to your system and i

Re: Tipping point of solr shards (Num of docs / size)

2014-04-17 Thread Erick Erickson
Shawn: Thanks! Obviously a bad cut/paste on my part, you're absolutely correctl On Wed, Apr 16, 2014 at 11:35 AM, Toke Eskildsen wrote: > mukh@gmail.com [mukh@gmail.com] On Behalf Of Mukesh Jha > [me.mukesh@gmail.com] wrote: >> In my solr cluster I've multiple shards and each shard

Re: Collection - loadOnStartup

2014-04-17 Thread Rich Mayfield
I was actually going to try orchestrating SolrCloud restart myself using loadOnStartup="false". Did you pursue this any further? With Solr 4.7.1... I found that using core LOAD, RELOAD, and CREATE do not take a "down" replica to "active". What I've found so far is that I can startup a collection

Re: cache warming questions

2014-04-17 Thread Erick Erickson
Don't go overboard warming here, you often hit diminishing returns very quickly. For instance, if the size is 512 you might set your autowarm count to 16 and get the most bang for your buck. Beyond some (usually small) number, the additional work you put in to warming is wasted. This is especially

Re: Delete field in Solr

2014-04-17 Thread Gurfan
Thanks for the quick response. Delete works fine as suggested. Still we are facing an issue in updating document rest command: Field description in schema.xml: /curl http://192.168.213.52:8983/solr/update -H 'Content-type:application/json' -d ' [ {"id": "969dcba7c3ec49cf9d61017afe8a2768","SFiel

Re: jetty solr multicore log files

2014-04-17 Thread Shawn Heisey
On 4/17/2014 4:35 AM, Kim, Soonho (IFPRI) wrote: > I have a quick question on the log files of solr 3.4 (multicore) in Jetty > (linux). I am using this solr search linking with Drupal 6. > I tried to find the log files for this multicore (live/dev) but I couldn't > find it. > For the single core,

SolrCloud not updating clusterstate.json

2014-04-17 Thread Edward Tse
Hi, Would appreciate any pointers by experts reading this list. We have on our SolrCloud 4.6.1 cluster, it has stopped updating clusterstate.json in Zookeeper after restarted one node. Seems like the overseer process has stopped, because we cannot see a /overseer_elect/leader file in zooke

Re: deleting large amount data from solr cloud

2014-04-17 Thread Vinay Pothnis
Thanks a lot Shalin! On 16 April 2014 21:26, Shalin Shekhar Mangar wrote: > You can specify maxSegments parameter e.g. maxSegments=5 while optimizing. > > > On Thu, Apr 17, 2014 at 6:46 AM, Vinay Pothnis wrote: > > > Hello, > > > > Couple of follow up questions: > > > > * When the optimize comm

How to get a list of currently executing queries?

2014-04-17 Thread Nikhil Chhaochharia
Hello, Is there some way of getting a list of all queries that are currently executing?  Something similar to 'show full processlist' in MySQL. Thanks, Nikhil

jetty solr multicore log files

2014-04-17 Thread Kim, Soonho (IFPRI)
Dear all; I have a quick question on the log files of solr 3.4 (multicore) in Jetty (linux). I am using this solr search linking with Drupal 6. I tried to find the log files for this multicore (live/dev) but I couldn't find it. For the single core, I found it under apache-solr-3.4/example/logs/

Re: Show the score in the search result

2014-04-17 Thread Stefan Matheis
The wiki contains an explanation for that as well :) http://wiki.apache.org/solr/CommonQueryParameters#fl It includes all fields the document actually has. and since there is no 'score' field included in your document, it won't get displayed. it's a so called virtual-field, which you have to re

RE: Show the score in the search result

2014-04-17 Thread Croci Francesco Luigi (ID SWS)
I think you mean this row: * ,fullText: ... Ok, but what I understood is that the "*" means that ALL the fields are displayed anyway. Or not? Francesco -Original Message- From: Stefan Matheis [mailto:matheis.ste...@gmail.com] Sent: Donnerstag, 17. April 2014 10:04 To: solr-user@lucene

Re: Show the score in the search result

2014-04-17 Thread Stefan Matheis
That's exactly what Jack mentioned, you're defining an invariant for fl, which ignores everything you provide at runtime. From http://wiki.apache.org/solr/SearchHandler#Configuration "invariants - provides param values that will be used in spite of any values provided at request time. They ar

Re: Autocomplete with Case-insensitive feature

2014-04-17 Thread Sunayana
1.My field definition: 2.On analysis page, it shows me the lowercased word,for both index

RE: Show the score in the search result

2014-04-17 Thread Croci Francesco Luigi (ID SWS)
Hello Chris: trying to execute http://localhost:7001/solr/collection1/select?q=*%3A*&rows=1&fl=score&wt=json&indent=true&echoParams=true I get { "error": { "msg": "Invalid value 'true' for echoParams parameter, use 'EXPLICIT' or 'ALL'", "code": 400 } } With echoParams=ALL: { "