Strange problem when use dismax handler

Hi. All. I am using default dismax to search within solr. The problem is when I search I want to specify the "type" to restrict the result. Here is what I do: 1. Query String with one type (Works!) :"design")) AND ((type:"product") ))) 2. Query String with 2 types (Works!) :"design")) AN

Re: Strange problem when use dismax handler

I use debugQuery to check my query url: I notice the query url is parsed incorrectly. The "type:book" was parsed as query string too. Sign~~~ +((+DisjunctionMaxQuery((keyword_level1:design^10.0 | keyword_level2:design)~0.01) DisjunctionMaxQuery((keyword_level1:type^10.0 | keyword_level2:type)~0.0

Re: [ANN] Solr 1.4.1 Released

Created issue for this. Regards, Stevo. On Sun, Jun 27, 2010 at 2:54 AM, Ken Krugler wrote: > > On Jun 26, 2010, at 5:18pm, Jason Chaffee wrote: > > It appears the 1.4.1 version was deployed with a new maven groupId >> >> For eample, if you are

Re: Strange problem when use dismax handler

Well. I figured it out. I should use fq parameter. &fq=type:music type:movie type:product On Wed, Jun 30, 2010 at 4:15 PM, Scott Zhang wrote: > I use debugQuery to check my query url: > I notice the query url is parsed incorrectly. > > The "type:book" was parsed as query string too. Sign~~~

Re: Unbuffered Exception while setting permissions

I was going through the logs, Everytime i try doing an update (and ofcourse ending up with unbuffered exception) the log outputs the following line [30/Jun/2010:09:02:52 +] "POST /solr/core1/update?wt=javabin&version=1 HTTP/1.1" 401 1389 Regards Raakhi On Wed, Jun 30, 2010 at 12:27 PM, Rakhi

Re: problem with formulating a negative query

Hi Erick, thanks for your explanations. But why are all docs being *removed* from the set of all docs that contain R in their topic field? This would correspond to a boolean AND and would stand in conflict with the clause q.op=OR. This seems a bit strange to me. Furthermore, Smiley & Pugh st

Re: Unbuffered Exception while setting permissions

This error usually occurs when i do a server.add(inpDoc). Behind the logs: 192.168.0.106 - - [30/Jun/2010:11:30:38 +] "GET /solr/GPTWPI/update?qt=%2Fupdate&optimize=true&wt=javabin&version=1 HTTP/1.1" 200 41 192.168.0.106 - - [30/Jun/2010:11:30:38 +] "GET /solr/GPTWPI/select?q=aid%3A3023

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

I get only this exception when i sort on my popularity field. WHY ??? ...&sort=score desc, popularity desc --> BAD ...&sort=score desc --> All fine. thats not good =( -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p9

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

(10/06/30 20:27), stockii wrote: Hello. I get an "SEVERE: java.lang.ArrayIndexOutOfBoundsException" and i dont know the reason for this. I have 4 cores. and every core is running but. for few minutes i get these bad exception in one core. its absolutlety not acceptable ... When i search with

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

aha. the type is "sint" do i need to use "string" ore which field did not use any tokenizer ? ^^ i thought sint is untokenized... -- View this message in context: http://lucene.472066.n3.nabble.com/ArrayIndexOutOfBoundsException-heelp-Sorting-tp932956p933003.html Sent from the Solr - User

Re: ArrayIndexOutOfBoundsException heeeeeelp !?!?!?!!?! Sorting

it makes no sense. i can on my playground-core sort for popularity, but not on my live-core. both cores, have the same configuration ... the problem occurs after use facet-search. thats maybe an reason ? or too many data ? to low server ? any idea -- View this message in context: http://

Re: REST calls

On Wed, Jun 30, 2010 at 12:39 AM, Don Werve wrote: > 2010/6/27 Jason Chaffee > >> The solr docs say it is RESTful, yet it seems that it doesn't use http >> headers in a RESTful way.  For example, it doesn't seem to use the Accept: >> request header to determine the media-type to be returned.  Ins

Re: REST calls

On Wed, Jun 30, 2010 at 7:39 AM, Don Werve wrote: > 2010/6/27 Jason Chaffee > > > The solr docs say it is RESTful, yet it seems that it doesn't use http > > headers in a RESTful way. For example, it doesn't seem to use the > Accept: > > request header to determine the media-type to be returned.

Re: REST calls

On Wed, Jun 30, 2010 at 9:17 AM, Jak Akdemir wrote: > On Wed, Jun 30, 2010 at 7:39 AM, Don Werve wrote: > >> 2010/6/27 Jason Chaffee >> >> > The solr docs say it is RESTful, yet it seems that it doesn't use http >> > headers in a RESTful way.  For example, it doesn't seem to use the >> Accept: >

Re: REST calls

Solr's APIs are described as "REST-like", and probably do qualify as "restful" the way the term is commonly used. I'm personally much more interested in making our APIs more powerful and easier to use, regardless of any REST purity tests. -Yonik http://www.lucidimagination.com

Re: dataimport.properties is not updated on delta-import

I've finally found the problem causing the delta-import to fail and thought I would post it here for future reference (if someone makes the same mistake I did). I had forgot to collect the "id" column in the deltaImportQuery. I should, of course, have known this from the log entires about documen

Is there a way to delete multiple documents using wildcard?

Hi, I am trying to delete a group of documents using wildcard. Something like update?commit=true%20-H%20"Content-Type:%20text/xml"%20--data-binary%20'6-HOST*' I want to delete all documents which contains the uid starting with 6-HOST but this query doesnt seem to work.. Am I doing anything wro

Re: REST calls

On Wed, 2010-06-30 at 16:12 +0200, Yonik Seeley wrote: > Solr's APIs are described as "REST-like", and probably do qualify as > "restful" the way the term is commonly used. > > I'm personally much more interested in making our APIs more powerful > and easier to use, regardless of any REST purity t

Re: Is there a way to delete multiple documents using wildcard?

Hi, you can delete all docs that match a certain query: uid:6-HOST* -Sascha bbarani wrote: Hi, I am trying to delete a group of documents using wildcard. Something like update?commit=true%20-H%20"Content-Type:%20text/xml"%20--data-binary%20'6-HOST*' I want to delete all documents which co

Re: Is there a way to delete multiple documents using wildcard?

Hi, Thanks a lot for your reply.. I tried the below query update?commit=true%20-H%20"Content-Type:%20text/xml"%20--data-binary%20'uid:6-HOST*' But even now none of the documents are getting deleted.. Am I forming the URL wrong? Thanks, BB -- View this message in context: http://lucene.47206

SolrQueryResponse - Solr Documents

Hello all, How can I view solr docs in response writers before the response is sent to the client ? What I get is only DocSlice with int values having size equal the docs requested. All this while debugging on the SolrQueryResponse Object. Thanks Sam

Re: Leading Wildcard query strangeness

An update in case someone stumbles upon this... At first I thought you mean the fields I intend to do leading wildcard searches on needed to have ReversedWildcardFilterFactory on them. But that didn't make sense because our prod app isn't using that at all. But our prod app does have the "text_

Re: Is there a way to delete multiple documents using wildcard?

Hi, does /select?q=uid:6-HOST* return any documents? -Sascha bbarani wrote: Hi, Thanks a lot for your reply.. I tried the below query update?commit=true%20-H%20"Content-Type:%20text/xml"%20--data-binary%20'uid:6-HOST*' But even now none of the documents are getting deleted.. Am I forming

Re: Leading Wildcard query strangeness

> I'm going to guess that is what you meant, that the very > presence of the > filter in the schema, whether it is used or not, allows you > to do wildcard > searches. Exactly. > Is that documented anywhere and I just missed it?  I'm > sure it is. I knew it from source code of SolrQueryParser. p

Re: Is there a way to delete multiple documents using wildcard?

Yeah, I am getting the results when I use /select handler. I tried the below query.. /select?q=uid:6-HOST* Got Thanks BB -- View this message in context: http://lucene.472066.n3.nabble.com/Is-there-a-way-to-delete-multiple-documents-using-wildcard-tp933468p933697.html Sent from the Solr - U

Re: Is there a way to delete multiple documents using wildcard?

Hi, You need to use HTTP POST in order to send those parameters I believe. Try with curl: curl http://localhost:8983/solr/update?commit=true -H "Content-Type: text/xml" --data-binary "uid:6-HOST*" -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Training in Europe - w

Wiki Documentation of facet.sort

Hi there, in the wiki, on http://wiki.apache.org/solr/SimpleFacetParameters it says: """ The default is true/count if facet.limit is greater than 0, false/index otherwise. """ I've just migrated to 1.4.1 (reindexed). I can't remember how it was with 1.4.0. When I specify my facet query with fac

Re: Is there a way to delete multiple documents using wildcard?

Hi, take a look inside Solr's log file. Are there any error messages with respect to the update request? Furthermore, you could try the following two commands instead: curl "http://host:port/solr/update"; --form-string stream.body="uid:6-HOST*" curl "http://host:port/solr/update"; --form-s

Disable Solr Response Formatting

By default my SOLR response comes back formatted, like such Is there a way to tell it to return it unformatted? like: -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-Solr-Response-Formatting-tp933785p933785.html Sent from the Solr - User mail

Re: Disable Solr Response Formatting

Oops, let me try that again... By default my SOLR response comes back formatted, like such Is there a way to tell it to return it unformatted? like: -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-Solr-Response-Formatting-tp933785p933793.h

Re: Is there a way to delete multiple documents using wildcard?

Hi, I was able to sucessfully delete multiple documents using the below URL /update?stream.body=uid:6-HOST* Thanks, BB -- View this message in context: http://lucene.472066.n3.nabble.com/Is-there-a-way-to-delete-multiple-documents-using-wildcard-tp933468p933799.html Sent from the Solr - User

RE: OOM on uninvert field request

At and above 4GB we get those GC errors though! Should I switch to something like this? Recommended Options To use i-cms in Java SE 6, use the following command line options: -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode \ -XX:+PrintGCDetails -XX:+PrintGCTimeStamps Caused by: java.lang.Runt

GC tuning - heap size autoranging

Is this a true statement??? This seems to contradict other statements regarding setting the heap size I have seen here... Default Heap Size If not otherwise set on the command line, the initial and maximum heap sizes are calculated based on the amount of memory on the machine. The proportion o

RE: Re: Disable Solr Response Formatting

Hi,   My client makes a mess out of your example but if you mean formatting as in indenting, then send indent=false, but it's already false by default. Check your requestHandler settings.   Cheers,   -Original message- From: JohnRodey Sent: Wed 30-06-2010 18:39 To: solr-user@lucene.a

Re: Is there a way to delete multiple documents using wildcard?

Hmm, nice one - I was not aware of that trick. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Training in Europe - www.solrtraining.com On 30. juni 2010, at 18.41, bbarani wrote: > > Hi, > > I was able to sucessfully delete multiple documents using the below URL >

RE: Re: Disable Solr Response Formatting

Thanks! I was looking for things to change in the solrconfig.xml file. indent=off -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-Solr-Response-Formatting-tp933785p933966.html Sent from the Solr - User mailing list archive at Nabble.com.

Bizarre Terms revisited

Hi, I really think there is something "not quite right" going on here after much study. Here is my findings. Using MLT, I get terms that appear to be long concatenations of words that are space delimited in the original text. I can't think of any reason for these sentence-like terms to exist (s

RE: OOM on uninvert field request

Hey so after adding those GC options, I was able to incrementally push my max (and min) memory settings up and when we got to max=min=12GB we started looking much better! One slave handles all the load with no OOMs at all! I'm watching the live tomcat log using 'tail'. Next I will convert tha

Multiple Solr servers and a shared index vs master+slaves

I'm a newbie looking at setting up an intranet search service using Solr, so I'm having a hard time understanding why I should forego the high availability and clustering mechanisms we already have available, and use Solr's implementations instead. I'm hoping some experienced Solr architects co

Re: OOM on uninvert field request

On Tue, Jun 29, 2010 at 7:32 PM, Robert Petersen wrote: > Hello I am trying to find the right max and min settings for Java 1.6 on 20GB > index with 8 million docs, running 1.6_018 JVM with solr 1.4, and am > currently have java set to an even 4GB (export JAVA_OPTS="-Xmx4096m > -Xms4096m") for

Re: Unbuffered Exception while setting permissions

Other problems with this error have been solved by doing pre-emptive authentication. On Wed, Jun 30, 2010 at 4:26 AM, Rakhi Khatwani wrote: > This error usually occurs when i do a server.add(inpDoc). > > Behind the logs: > > 192.168.0.106 - - [30/Jun/2010:11:30:38 +] "GET > /solr/GPTWPI/updat

Re: REST calls

The stream.file/stream.url/stream.body parameters allow a GET to alter the index. The core management operations are also useable from GET. This allows one to bookmark and mail around a link that changes or blows up the index. Apparently this is not ReStFuL It is IMVHO insane. On Wed, Jun 30, 201

Re: REST calls

On Wed, Jun 30, 2010 at 4:55 PM, Lance Norskog wrote: > Apparently this is not ReStFuL It is IMVHO insane. Patches welcome... -Yonik http://www.lucidimagination.com

Re: Multiple Solr servers and a shared index vs master+slaves

Yes, the Java replication system is not designed for your case. Using the LockFactory system with one writer is not how Solr is generally QA'd, but it should work if the locking system is perfect. But, is it possible to use hard links? Each Solr would have its own data/index directory. Every index

Re: OOM on uninvert field request

On Wed, Jun 30, 2010 at 1:38 PM, Yonik Seeley wrote: > On Tue, Jun 29, 2010 at 7:32 PM, Robert Petersen wrote: >> Hello I am trying to find the right max and min settings for Java 1.6 on >> 20GB index with 8 million docs, running 1.6_018 JVM with solr 1.4, and am >> currently have java set to a

Re: REST calls

I've looked at the problem. It's fairly involved. It probably would take several iterations. (But not as many as field collapsing :) On Wed, Jun 30, 2010 at 2:11 PM, Yonik Seeley wrote: > On Wed, Jun 30, 2010 at 4:55 PM, Lance Norskog wrote: >>  Apparently this is not ReStFuL It is IMVHO insane.

tomcat solr logs

Sorry if this is at all off topic. Our solr log files need grooming and we would also like to analyze them, perhaps pulling various data points into a DB table, is there a preferred app for doing log file analysis and/or an easy way to delete the old log files?

Re: REST calls

If there is a real desire/need to make things "restful" in the official sense, it is worth looking at using a REST framework as the controller rather then the current solution. perhaps: http://www.restlet.org/ https://jersey.dev.java.net/ These would be cool since they encapsulate lots of the re

RE: OOM on uninvert field request

Most of these hundreds of facet fields have tens of values but a couple have thousands, is thousands of different values too many to do enum or is that still ok? If so I could apply it carte blanche to the whole field... -Original Message- From: ysee...@gmail.com [mailto:ysee...@gmail.c

Re: Very basic questions: Faceted front-end?

Wow, thanks Lance - it's really fast now! The last piece of the puzzle is setting up a nice front-end. Are there any pre-built front-ends available, that mimic Google (for example), with facets? -Peter On Jun 29, 2010, at 9:04 PM, Lance Norskog wrote: > To highlight a field, Solr needs some

Disk usage per-field

Is it possible for Solr (or Luke/Lucene) to tell me exactly how much of the total index disk space is used by each field? It would also be very nice to know, for each field, how much is used by the index and how much is used for stored data.

RE: REST calls

Using Accept headers is a pretty standard practice and so are conditional GETs. Quite easy to test with curl: curl  -X GET -H "Accept:application/xml" http://solr.com/search curl -X GET -H "Accept:application/json" http://solr.com/search Jason -Original Message- From: Don W

RE: REST calls

In that case, being able to use Accept headers and conditional GET's would make them more powerful and easier to use. The Accept header could be used, if present, otherwise use the query parameter. Or, vice versa. Also, conditional GET's are a big win when you know the data and results are not c

RE: REST calls

Two more jaxrs solutions: http://www.jboss.org/resteasy http://cxf.apache.org/docs/jax-rs.html However, I am not suggesting changing the core implementation. Just want to make it more powerful by utilizing headers. I can accept the other issues that have been mentioned as not RESTful. Al

Re: Very basic questions: Faceted front-end?

Ah, I found this: https://issues.apache.org/jira/browse/SOLR-634 ... aka "solr-ui". Is there anything else along these lines? Thanks! -Peter On Jun 30, 2010, at 3:59 PM, Peter Spam wrote: > Wow, thanks Lance - it's really fast now! > > The last piece of the puzzle is setting up a n

Re: OOM on uninvert field request

On Wed, Jun 30, 2010 at 6:19 PM, Robert Petersen wrote: > Most of these hundreds of facet fields have tens of values but a couple have > thousands, is thousands of different values too many to do enum or is that > still ok?  If so I could apply it carte blanche to the whole field... enum can st

Re: Wiki Documentation of facet.sort

(10/07/01 1:12), Chantal Ackermann wrote: Hi there, in the wiki, on http://wiki.apache.org/solr/SimpleFacetParameters it says: """ The default is true/count if facet.limit is greater than 0, false/index otherwise. """ I've just migrated to 1.4.1 (reindexed). I can't remember how it was with 1.

Re: REST calls

Solr has 304 support with the last-modified and etag headers. Erik On Jun 30, 2010, at 7:52 PM, Jason Chaffee wrote: In that case, being able to use Accept headers and conditional GET's would make them more powerful and easier to use. The Accept header could be used, if present, other

Dilemma - Very Frequent Synonym updates for Huge Index

Hello, Hoping some solr guru can help me out here. We are a news organization trying to migrate 10 million documents from FAST to solr. The plan is to have our Editorial team add/modify synonyms multiple times during a day as they deem appropriate. Hence we plan on using query time synonyms

Re: Unbuffered Exception while setting permissions

Hi Lance, Thankyou so much. It worked with pre-emptive authentication On Thu, Jul 1, 2010 at 2:15 AM, Lance Norskog wrote: > Other problems with this error have been solved by doing pre-emptive > authentication. > > On Wed, Jun 30, 2010 at 4:26 AM, Rakhi Khatwani > wrote: > > Thi