Re: how to get total hits for the request?

2008-04-18 Thread Shalin Shekhar Mangar
the returned XML contains numFound which gives you the number of documents: If you're using SolrJ client, SolrDocumentList.getNumFound() will return the total number of results. On Sat, Apr 19, 2008 at 11:07 AM, surfer10 <[EMAIL PROTECTED]> wrote: > > i've explained my goal not clearly enougth

Re: indexing text containing xml tags

2008-04-18 Thread Shalin Shekhar Mangar
CC'ing the solr-user mailing list because that is the right list for usage questions. You'll need to XML encode your title field. Basically you need to replace '<' with < etc, then you will be able to index them. On Sat, Apr 19, 2008 at 10:54 AM, Saurabh Kataria <[EMAIL PROTECTED]> wrote: > > Hi

Re: how to get total hits for the request?

2008-04-18 Thread surfer10
i've explained my goal not clearly enougth. I want to get TOTAL NUMBER of hits. Hits by themselves is not nessecary - i know that i can control them by start & num parameters. But how can i get the number of document matched by query? Erik Hatcher wrote: > > > On Apr 18, 2008, at 2:04 AM, sur

Re: possible highlighter limits?

2008-04-18 Thread Mike Klaas
On 17-Apr-08, at 11:09 PM, Martijn Dekkers wrote: Mike, you are a saint! thanks - we actually had this defined, but somewhat wrongly: typo (hangs head in shame) It is quite a common problem. I wonder if Solr couldn't provide a mode that warned loudly of unknown parameters (seems tricky,

Re: Highlighted field gets truncated

2008-04-18 Thread Mike Klaas
On 18-Apr-08, at 2:47 AM, Christian Wittern wrote: Martijn Dekkers wrote: Did you look at the hl.fragsize parameter? the default for that is 100. try: http://localhost:8983/solr/select/?q=%E8%99%9B%E5%A4%9A&fl=variants,content,cdata,id%2Cdoctitle%2Chead%2Ccitekey%2Cseqnum%2Cjuan&hl=true&f.con

Re: Problrm Highlighting

2008-04-18 Thread Mike Klaas
[moving to solr-user. Questions about how to use Solr belong there] On 15-Apr-08, at 2:37 AM, khirb7 wrote: hello every body Here is my problem : when using highlighting solr return only the best fragment (the most relevant section of the document) like this "Nicolas "Sarkozy" naƮt le 28

Re: Got parseException when search keyword AND on a text field

2008-04-18 Thread Otis Gospodnetic
Xuesong, AND has a special meaning - it is a boolean AND when capitalized. That is why you are getting an error - the query parser doesn't know what to do with just "AND" for a query. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Xuesong

Got parseException when search keyword AND on a text field

2008-04-18 Thread Xuesong Luo
Hi, I got the following error when search keyword AND on a text field. I checked stopwords.txt, it has an entry for word and.(case insensitive), but it seems not work for word AND. Does any one know how to fix this problem? Thanks Xuesong http://localhost/search/select/?q=firstName%3AAND&version

Re: Tomcat JNDI and CWD Configuration problem with multiple solrs

2008-04-18 Thread Chris Hostetter
: The apps seem to work fine, only for some reason, when I start tomcat it : creates a solr dir in the cwd. So naturally, depending on where i do the Solr does not ever attempt to create a directory named "solr" (the only directories Solr tries to create if they don't already exist are inside o

Re: operator in Dismax??

2008-04-18 Thread Chris Hostetter
: I had a doubt regarding using operator in dismax handler that if i could : use OR, AND, NOT operators in dismax, as they are used in standard : handler. : : I tried using OR operator as used in standard handler but got unexpected results. Dismax is deisned with the assumption that most quer

Re: reusing docset to limit new query

2008-04-18 Thread Chris Hostetter
: 2. The sorting is different. In this case I need to do the query again (I : think, please let me know if there's a better option), by using : SolrIndexSearcher.getDocList(...). : : I'm looking for a way to tell the SolrIndexSearcher that it can limit it's : query (including sorting) to the do

Re: How to troubleshoot this HTTP ERROR: 500 (NULL) error?

2008-04-18 Thread Chris Hostetter
: java.lang.NullPointerException : : at : org.apache.solr.search.SolrQueryParser.getFieldQuery(SolrQueryParser.java:73 : ) I'm guessing this is one of the following issues... http://issues.apache.org/jira/browse/SOLR-525 http://issues.apache.org/jira/browse/SOLR-529 ...both have been cha

Re: How to troubleshoot this HTTP ERROR: 500 (NULL) error?

2008-04-18 Thread Otis Gospodnetic
Hung, Look at the bottom of that error: RequestURI=/solr/select/ It looks like all the parameters are missing, that's all. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Hung Huynh <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: F

Re: Count of facet count

2008-04-18 Thread Chris Hostetter
: how I can get count of distinct facet_fields ? : : like numFacetFound in this example: There's currently no way to do that. -Hoss

How to troubleshoot this HTTP ERROR: 500 (NULL) error?

2008-04-18 Thread Hung Huynh
I loaded about 20,000 docs. When I tried to do any search, I received the following error. What should I do to fix this? Thanks. -- HTTP ERROR: 500 null java.lang.NullPointerException at org.apache.solr.search.SolrQueryParser.getFieldQuery(SolrQueryParser.java:73 ) at org.ap

Re: XSLT transform before update?

2008-04-18 Thread Shalin Shekhar Mangar
Also, concatenation of values is also quite common. We should have a way of doing this without forcing everybody to write code. I think we should add a ConcatenateTransformer in DataImportHandler itself which can take care of basic use-cases. A syntax like this may be good enough: What do you th

Re: XSLT transform before update?

2008-04-18 Thread Shalin Shekhar Mangar
Hi David, Actually you can concatenate values, however you'll have to write a bit of code. You can write this in javascript (if you're using Java 6) or in Java. Basically, you need to write a Transformer to do it. Look at http://wiki.apache.org/solr/DataImportHandler#head-a6916b30b5d7605a990fb03c4

Re: XSLT transform before update?

2008-04-18 Thread David Smiley @MITRE.org
I'm in the same situation as you Daniel. The DataImportHandler is pretty awesome but I'd also prefer it had the power of XSLT. The XPath support in it doesn't suffice for me. And I can't do very basic things like concatenate one value with another, say a constant even. It's too bad there isn't

Re: CorruptIndexException

2008-04-18 Thread Michael McCandless
Hmmm, not good. One other thing to try would be -Xint, which turns off hotspot compilation entirely. On that last case that also prevented the issue. Did you cleanly rebuild your index when you retested? And you're really certain your JRE is running with -Xbatch? (You should be able t

Re: CorruptIndexException

2008-04-18 Thread Robert Haschart
Mike, You are right it does sound exactly like that situation. The java version is: java version "1.6.0_05" Java(TM) SE Runtime Environment (build 1.6.0_05-b13) Java HotSpot(TM) Server VM (build 10.0-b19, mixed mode) Which seems to be the same as the one giving the other poster problems. I

Re: how to get total hits for the request?

2008-04-18 Thread Erik Hatcher
On Apr 18, 2008, at 2:04 AM, surfer10 wrote: I'm using solr and unable to manage total number of document returned by search? how can i do this? &rows=37

Re: config for very frequent solr updates

2008-04-18 Thread Jonathan Ariel
Ok. So it is there, in the admin page you can see: openedAt : Fri Apr 18 10:30:02 EDT 2008 registeredAt : Fri Apr 18 10:30:31 EDT 2008 That means that the warmup took around 29 seconds. Thanks! On Fri, Apr 18, 2008 at 11:17 AM, Geoffrey Young <[EMAIL PROTECTED]> wrote: > > > Otis Gospodnetic wr

Re: Updating in Solr.SOLR-139

2008-04-18 Thread Koji Sekiguchi
You don't need any additional attributes in schema.xml, but the field should be stored. You can overwrite the existing field value of the doc AAA w/ the following XML: AAA German and post the following URL: http://localhost:8389/solr/update?mode=tags:overwrite&commit=true If the tags fie

Re: config for very frequent solr updates

2008-04-18 Thread Geoffrey Young
Otis Gospodnetic wrote: Geoff, There was just another thread where the person said he was doing updates every 2 minutes. ok, I see that now. unfortunately, the data is sparse there :) Like you said, with the way Solr warms searchers, this could be too frequent for instances with large c

Re: config for very frequent solr updates

2008-04-18 Thread Otis Gospodnetic
Jonathan - probably similarly to how SOLR-303 does it. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Jonathan Ariel <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Friday, April 18, 2008 7:29:28 AM Subject: Re: config for very frequ

Re: config for very frequent solr updates

2008-04-18 Thread Otis Gospodnetic
Watch your Solr admin page and you'll spot multiple searchers there while the new searcher is warming up. Once it's done, it should go away. There may also be something in the logs, but I haven't checked. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message

Re: config for very frequent solr updates

2008-04-18 Thread Jonathan Ariel
Is there any way to measure how long it takes to warmup? On Fri, Apr 18, 2008 at 8:29 AM, Jonathan Ariel <[EMAIL PROTECTED]> wrote: > And how would you combine the results from the different indexes? > > > On Fri, Apr 18, 2008 at 12:40 AM, Otis Gospodnetic < > [EMAIL PROTECTED]> wrote: > > > Geof

Re: config for very frequent solr updates

2008-04-18 Thread Jonathan Ariel
And how would you combine the results from the different indexes? On Fri, Apr 18, 2008 at 12:40 AM, Otis Gospodnetic < [EMAIL PROTECTED]> wrote: > Geoff, > > There was just another thread where the person said he was doing updates > every 2 minutes. Like you said, with the way Solr warms searche

Re: Highlighted field gets truncated

2008-04-18 Thread Christian Wittern
Martijn Dekkers wrote: Did you look at the hl.fragsize parameter? the default for that is 100. try: http://localhost:8983/solr/select/?q=%E8%99%9B%E5%A4%9A&fl=variants,content,cdata,id%2Cdoctitle%2Chead%2Ccitekey%2Cseqnum%2Cjuan&hl=true&f.contents.hl.snippets=20&hl.fl=content,variants&wt=xml&tr=

Re: Highlighted field gets truncated

2008-04-18 Thread Martijn Dekkers
Hey Christian, Did you look at the hl.fragsize parameter? the default for that is 100. try: http://localhost:8983/solr/select/?q=%E8%99%9B%E5%A4%9A&fl=variants,content,cdata,id%2Cdoctitle%2Chead%2Ccitekey%2Cseqnum%2Cjuan&hl=true&f.contents.hl.snippets=20&hl.fl=content,variants&wt=xml&tr=solr-tei.

Re: Highlighted field gets truncated

2008-04-18 Thread Thomas Arni
Have a look at http://wiki.apache.org/solr/HighlightingParameters?highlight=%28highlighting%29#head-dbf0474b5b2c0db08f3a464ff3525225a9c71fbc and set hl.fragsize=0 Hope this helps. Christian Wittern said the following on 18/04/2008 09:59: > Dear Solr users, > > Here I am having a problem with hi

Highlighted field gets truncated

2008-04-18 Thread Christian Wittern
Dear Solr users, Here I am having a problem with hightlighting which is slightly different from the one reported by Martijn. The field that contains the match is rather short, in this case less than 300 characters altogether. Nevertheless, the field is only returned truncated. Since I also return