Re: sorting using org.apache.solr.client.solrj.SolrQuery not working

2013-09-13 Thread Shawn Heisey
On 9/13/2013 6:56 PM, suren wrote: > I tried below 3 methods to sort the output from solr 4.3.1., no error and not > sorting on any given field. > 1)addSort(field, order) > 2)addOrUpdateSort(field, order) > 3)setSort(field, order) > > my schema setting for the fields i tried are > multiValued="fa

Solr Patent

2013-09-13 Thread Zaizen Ushio
Hello I have a question about patent. I believe Apache license is protecting Solr developers from patent issue in Solr community. But is there any case that Solr developer or Solr users are alleged by outside of Solr Community? Is there any cases somebody experienced? Any advice is appreciat

sorting using org.apache.solr.client.solrj.SolrQuery not working

2013-09-13 Thread suren
I tried below 3 methods to sort the output from solr 4.3.1., no error and not sorting on any given field. 1)addSort(field, order) 2)addOrUpdateSort(field, order) 3)setSort(field, order) my schema setting for the fields i tried are Any one please tell me why the sorting is not working? -- Vi

Early Access Release #7 for Solr 4.x Deep Dive is now available for download on Lulu.com

2013-09-13 Thread Jack Krupansky
Okay, it's hot off the e-presses: my updated book Solr 4.x Deep Dive, Early Access Release #7 is now available for purchase and download as an e-book for $9.99 on Lulu.com at: http://www.lulu.com/shop/jack-krupansky/solr-4x-deep-dive-early-access-release-1/ebook/product-21120181.html (That lin

Re: Solr 4.5 spatial search - distance and score

2013-09-13 Thread David Smiley (@MITRE.org)
Hi Weber, Returning the distance separately from the score is really awkward without being able to use geodist() (which is coming in Solr 4.5 for the RPT spatial field). But as you note in SOLR-4255 it is possible. If you modify the Solr example schema so that the 'store' spatial field is of type

Re: Wrapper for SOLR for Compression

2013-09-13 Thread Chris Hostetter
: I asked this before... But can we add a parameter for SOLR to expose the : compression modes to solrconfig.xml ? Bill: note my previous response... https://mail-archives.apache.org/mod_mbox/lucene-solr-user/201304.mbox/%3Calpine.DEB.2.02.1304251901350.3628@frisbee%3E ...because of how the cod

Empty out a multiValue Field using SolrJ

2013-09-13 Thread edo
Hi all, i am facing an issue while trying to update a document. I am using SolrJ to add/update documents of my collection. The SolrJ version is 4.0.0 ( but i also tried with the latest 4.4.0 ) I am aware that in multivalue fields i can only add an element but not remove, in fact for those fields I

Committing when indexing in parallel

2013-09-13 Thread Phani Chaitanya
I'm wondering what happens to commit while we are indexing in parallel in Solr. Are the indexing update requests blocked until the commit finishes ? Lets say I've a process P1 which issued a commit request and there is another process P2 which is still indexing to the same index. What happens to

Re: "Unable to connect" to "http://localhost:8983/solr/"

2013-09-13 Thread Raheel Hasan
Ok I have solved it my self.. The issue was in "data" directory of "solr/{myCore}/".. I deleted this folder and it started running again. however, this is even a bigger issue now, because when the project is LIVE and it has indexed millions of records, I wont have the option to remove the "data" f

Re: Get the commit time of a document in Solr

2013-09-13 Thread phanichaitanya
Thanks Otis. I'll look into it if I can use it to solve my problem. - Phani Chaitanya -- View this message in context: http://lucene.472066.n3.nabble.com/Get-the-commit-time-of-a-document-in-Solr-tp4089624p4089949.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Empty out a multiValue Field using SolrJ

2013-09-13 Thread Chris Hostetter
: i am facing an issue while trying to update a document. : I am using SolrJ to add/update documents of my collection. The SolrJ : I am aware that in multivalue fields i can only add an element but not : remove, in fact for those fields I am overriding all the values every time. : Everything work

Re: spellcheck causing Core Reload to hang

2013-09-13 Thread Chris Hostetter
: after a lot of investigation today, I found that its the spellcheck : component which is causing the issue. If its turned off, all will run well : and core can easily reload. However, when the spellcheck is on, the core : wont reload instead hang forever. Can you take some stack traces while th

what does "UnInvertedField; UnInverted multi-valued field" means and how to fix it

2013-09-13 Thread Raheel Hasan
Hi guyz, I have an issue here in between Solr Core and Data Indexing: When I build some index from fresh setup, everything is fine: all queries and additional/update indexing, everything runs is fine. But when I reload the Core, the solr stops from that point onward forever. All i get is this li

Re: Storing/indexing speed drops quickly

2013-09-13 Thread Shawn Heisey
On 9/13/2013 12:03 AM, Per Steffensen wrote: What is it that will fill my heap? I am trying to avoid the FieldCache. For now, I am actually not doing any searches - focus on indexing for now - and certainly not group/facet/sort searches that will use the FieldCache. I don't know what makes up t

Re: Best configuration for 2 servers

2013-09-13 Thread Shawn Heisey
On 9/13/2013 12:50 PM, Branham, Jeremy [HR] wrote: Does this sound appropriate then? [assuming no 3rd server] Server A: Zoo Keeper SOLR with 1 shard Server B: SOLR with ZK Host parameter set to Server A Yes, that will work, but if the ZK on server A goes down, the entire cloud is down. Whe

Re: Stop filter changes in Solr >= 4.4

2013-09-13 Thread Yonik Seeley
On Fri, Sep 13, 2013 at 1:07 AM, Shalin Shekhar Mangar wrote: > AFAIk, enablePositionIncrements=false is deprecated in 4.x but not > removed. It will be removed in 5.0 though. Hmmm, I had missed that. Anyone have pointers to an example of what "broken" means and why it can't be fixed? It seems p

Re: Different Responses for 4.4 and 3.5 solr index

2013-09-13 Thread Jack Krupansky
I don't have any additional questions, and won't, until you are able to supply the information requested in my previous response. -- Jack Krupansky -Original Message- From: Kuchekar Sent: Friday, September 13, 2013 1:46 PM To: solr-user@lucene.apache.org Subject: Re: Different Respons

Re: Different Responses for 4.4 and 3.5 solr index

2013-09-13 Thread Kuchekar
Hi, The input text = 'cancer', field = 'content', field type ='text_general'. Analyzer for the filed is as follows : < filter class="solr.LowerCaseFilterFactory"/> Manual Search count on the term 'cancer' in the field 'content', gave me 515 hits. This makes me believe that tf

Re: spellcheck causing Core Reload to hang

2013-09-13 Thread tamanjit.bin...@yahoo.co.in
Any specific error? Anything in the logs when it hangs? -- View this message in context: http://lucene.472066.n3.nabble.com/spellcheck-causing-Core-Reload-to-hang-tp4089866p4089931.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Best configuration for 2 servers

2013-09-13 Thread Branham, Jeremy [HR]
Thanks Shawn - Does this sound appropriate then? [assuming no 3rd server] Server A: Zoo Keeper SOLR with 1 shard Server B: SOLR with ZK Host parameter set to Server A Jeremy D. Branham Performance Technologist II Sprint University Performance Support Fort Worth, TX | Tel: **DOTNET Office: +1

Federated Search Design Question

2013-09-13 Thread Alejandro Calbazana
Hi, I have a general design question about federated search that I'd like to get some thoughts on. I have several line of business applications that manage their own data. There is a need to search across these LOB apps, but each of them have different authorization schemes in terms of allowing u

changing int to long - does it definitely require a reindex?

2013-09-13 Thread Ty
I messed up. In my 50+ million document index, I have a field in my schema.xml that is of type "int". I should have made it a long; documents that have a field that overflows that integer aren't being indexed. Does changing this field type absolutely, positively require a re-index? What would h

Re: Stop filter changes in Solr >= 4.4

2013-09-13 Thread Christopher Condit
Here's the field definition: Here's the stack trace: WARNING: org.apache.solr.client.solrj.SolrServerException: java.lang.IllegalArgumentException: enablePositionIncrements=false is not supported anymore as of Lucene 4.4 as it can create broken token streams org.apache.solr.clien

explicite deltaimports by given ids

2013-09-13 Thread Peter Sch�tt
Hallo, I want to trigger a deltaimportquery by given IDs. Example: query="select oid, att1, att2 from my_table" deltaImportQuery="select oid, att1, att2 from my_table WHERE oid=${dih.delta.OID}" deltaQuery="select OID from my_table WHERE TIME_STAMP > TO_DATE

Re: Different Responses for 4.4 and 3.5 solr index

2013-09-13 Thread Kuchekar
Hi, Following is the debug query results : *Solr 3.5* true 60.67038 sum of: true 60.67038 max plus 1.0 times others of: true 0.44362593 weight(content:cancer^0.5 in 21506339), product of:

Solr wildcard search

2013-09-13 Thread Prasi S
Hi all, I am working with wildcard queries and few things are confusing. 1. Does a wildcard search omit the analysers on a particular field? 2. I have searched for q=google\ technology - >gives result q=google technology -> Gives results q=google tech* -> gives results q=google\ tech* -> 0 resu

Best configuration for 2 servers

2013-09-13 Thread Branham, Jeremy [HR]
Currently, our SOLR 1.3 installation shares 4 applications servers with other Java apps, leveraging master/slave replication. To get application isolation, we are moving from SOLR 1.3 to 4.3 and acquiring 2 new production [vm] servers for the migration. For the new SOLR configuration, we are con

Re: Solr wildcard search

2013-09-13 Thread Jack Krupansky
Wildcard applies only to a single term. The escaped space suggests that you are trying to match a wildcard on multiple terms. Try the contrib complex phrase query parser. -- Jack Krupansky -Original Message- From: Prasi S Sent: Friday, September 13, 2013 6:37 AM To: solr-user@lucene.

spellcheck causing Core Reload to hang

2013-09-13 Thread Raheel Hasan
Hi, after a lot of investigation today, I found that its the spellcheck component which is causing the issue. If its turned off, all will run well and core can easily reload. However, when the spellcheck is on, the core wont reload instead hang forever. Then the only way to get the project back a

Re: Escaping *, ? in Solr

2013-09-13 Thread Jack Krupansky
Asterisk and question mark are wildcards, not regex. Regex query is a regular expression enclosed in slashes, such as: q=/Googl.*/ And note that not all analyzer filters will be applied to regex terms. You may need to do the analysis yourself. Although simple filters likethe lower case filter

Re: Best configuration for 2 servers

2013-09-13 Thread Shawn Heisey
On 9/13/2013 10:16 AM, Branham, Jeremy [HR] wrote: Currently, our SOLR 1.3 installation shares 4 applications servers with other Java apps, leveraging master/slave replication. To get application isolation, we are moving from SOLR 1.3 to 4.3 and acquiring 2 new production [vm] servers for the

Re: Escaping *, ? in Solr

2013-09-13 Thread Shawn Heisey
On 9/13/2013 1:56 AM, Prasi S wrote: I want to do regex search in solr. E.g: Googl* . In my query api, i have used the ClientUtils.escapeQueryChars funtion to escape characters special to solr. In the above case, a search for 1. Google -> gives 677 records. 2. Googl* -> Escaped as Googl\* in co

Re: "Unable to connect" to "http://localhost:8983/solr/"

2013-09-13 Thread Raheel Hasan
You are right sir, its weird to have no error in the log... So after a full day spent only on trying to figure this out, I have found the cause (spellcheck component)... but not the solution. Se my other post with the subject "*spellcheck causing Core Reload to hang*". I have explained it there.

RE: Best configuration for 2 servers

2013-09-13 Thread Branham, Jeremy [HR]
Or another possible scenario - SOLR Cloud with one logical shard and 2 servers would give me replication without the master/slave setup. Is that correct? Jeremy D. Branham Performance Technologist II Sprint University Performance Support Fort Worth, TX | Tel: **DOTNET http://JeremyBranham.Word

Re: "Unable to connect" to "http://localhost:8983/solr/"

2013-09-13 Thread Shawn Heisey
On 9/13/2013 5:47 AM, Raheel Hasan wrote: Ok I have solved it my self.. The issue was in "data" directory of "solr/{myCore}/".. I deleted this folder and it started running again. however, this is even a bigger issue now, because when the project is LIVE and it has indexed millions of records, I

Escaping *, ? in Solr

2013-09-13 Thread Prasi S
Hi, I want to do regex search in solr. E.g: Googl* . In my query api, i have used the ClientUtils.escapeQueryChars funtion to escape characters special to solr. In the above case, a search for 1. Google -> gives 677 records. 2. Googl* -> Escaped as Googl\* in code-> gives 12 results 3. When given

Re: Profiling Solr Lucene for query

2013-09-13 Thread Dmitry Kan
Manuel, Whether to have the front end solr as aggregator of shard results depends on your requirements. To repeat, we found merging from many shards very inefficient fo our use case. It can be the opposite for you (i.e. requires testing). There are some limitations with distributed search, see her

Re: Re: Unable to getting started with SOLR

2013-09-13 Thread Rah1x
I have the same issue can anyone tell me if they found a solution? -- View this message in context: http://lucene.472066.n3.nabble.com/Unable-to-getting-started-with-SOLR-tp3497276p4089761.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: "Unable to connect" to "http://localhost:8983/solr/"

2013-09-13 Thread Raheel Hasan
?? anyone? On Thu, Sep 12, 2013 at 8:12 PM, Raheel Hasan wrote: > Hi, > > I just have this issue came out of no where > Everything was fine until all of a sudden the browser cant connect to this > solr. > > > Here is the solr log: > > INFO - 2013-09-12 20:07:58.142; org.eclipse.jetty.server

Re: Facet counting empty as well.. how to prevent this?

2013-09-13 Thread Upayavira
The simplest thing is to exclude empty values in the query: myfield:[* TO *] Upayavira On Thu, Sep 12, 2013, at 03:50 PM, Raheel Hasan wrote: > ok, so I got the idea... I will pull 7 fields instead and remove the > empty > one... > > But there must be some setting that can be done in Facet confi

Re: Solr 4.5 spatial search - distance and score

2013-09-13 Thread Bill Bell
You can apply his 4.5 patches to 4.4 or take trunk and it is there Bill Bell Sent from mobile On Sep 12, 2013, at 6:23 PM, Weber wrote: > I'm trying to get score by using a custom boost and also get the distance. I > found David's code* to get it using "Intersects", which I want to replace by

Re: Storing/indexing speed drops quickly

2013-09-13 Thread Per Steffensen
On 9/12/13 4:26 PM, Shawn Heisey wrote: On 9/12/2013 2:14 AM, Per Steffensen wrote: Starting from an empty collection. Things are fine wrt storing/indexing speed for the first two-three hours (100M docs per hour), then speed goes down dramatically, to an, for us, unacceptable level (max 10M per

Re: Stop filter changes in Solr >= 4.4

2013-09-13 Thread Shalin Shekhar Mangar
Can we see a full stack trace for that IllegalArgumentException? AFAIk, enablePositionIncrements=false is deprecated in 4.x but not removed. It will be removed in 5.0 though. On Fri, Sep 13, 2013 at 3:34 AM, Christopher Condit wrote: > While attempting to upgrade from Solr 4.3.0 to Solr 4.4.0 I r

Re: Different Responses for 4.4 and 3.5 solr index

2013-09-13 Thread Jack Krupansky
There may be some token filters that are emitting a different number of terms. There are so many changes between 3.5 and 4.4, that it simply isn't worth the trouble to track down all of them. In some cases, there may be bugs in 3.5 that have gotten fixed in any of the intervening releases. Do

Re: Different Responses for 4.4 and 3.5 solr index

2013-09-13 Thread Kuchekar
Hi, After triaging more for this, we find that the termFrequency (tf) for the same field in the same doc in solr 3.5 and 4.4 is different. example : If word "fruits" appear in some field for 20 times In 3.5 tf is reported to be 8, where as in 4.4 solr it reports to be 20. that is changing

Re: exceeded limit of maxWarmingSearchers

2013-09-13 Thread gfbj
I ended up having to do a mathematical increase of the delay because the indexing eventually would outstrip the static value I set and crash the maxWarmingSearchers. -- View this message in context: http://lucene.472066.n3.nabble.com/exceeded-limit-of-maxWarmingSearchers-tp489803p4089699.htm

Re: Get the commit time of a document in Solr

2013-09-13 Thread phanichaitanya
Thanks Jack, Shawn and Raymond. Shawn - I've to do it with every commit. So I guess apparently there is no way apart from writing custom plugins to Solr. I'll look into the pointers you suggested. Regards, Phani. - Phani Chaitanya -- View this message in context: http://lucene.472066.n3.

Re: Need help with delta import

2013-09-13 Thread umajava
Sorry but I gave up on this issue. I could not resolve it. On Tue, Sep 10, 2013 at 8:24 PM, suren [via Lucene] < ml-node+s472066n4089093...@n3.nabble.com> wrote: > Any update? I am also having the same issue. pls reply. > > This XML file does not appear to have any style information associated >

Re: Get the commit time of a document in Solr

2013-09-13 Thread phanichaitanya
Apologies again. But here is another try : I want to make sure that documents that are indexed are committed in say an hour. I agree that if you pass commitWithIn params and the like will make sure of that based on the time configurations we set. But, I want to make sure that the document is reall