Feature idea - delete and commit from web interface ?

2008-06-18 Thread JLIST
It seems that the web interface only supports select but not delete. Is it possible to do delete from the browser? It would be nice to be able to do delete and commit, and even post (put XML in an html form) from the admin web interface :) Also, does delete have to be a POST? A GET should do.

Default result rows

2008-06-18 Thread Mihails Agafonovs
Hi! Where can I define, how many rows must be returned in the result? Default is 10, and specifying other value each time through URL or advanced interface isn't comfortable. Ar cieņu, Mihails

Deleting Solr index

2008-06-18 Thread Mihails Agafonovs
How can I clear the whole Solr index? Ar cieņu, Mihails

Re: Deleting Solr index

2008-06-18 Thread j . L
just rm -r SOLR_DIR/data/index. 2008/6/18 Mihails Agafonovs <[EMAIL PROTECTED]>: > How can I clear the whole Solr index? > Ar cieņu, Mihails -- regards j.L

Re: Default result rows

2008-06-18 Thread Shalin Shekhar Mangar
You can configure this in solrconfig.xml under the "defaults" section for StandardRequestHandler explicit 30 * 2.1 2008/6/18 Mihails Agafonovs <[EMAIL PROTECTED]>: > Hi! > > Where can I define, how many rows must be returned in the result? > Defau

Re: Deleting Solr index

2008-06-18 Thread Shalin Shekhar Mangar
You can delete by query *:* (which matches all documents) http://wiki.apache.org/solr/UpdateXmlMessages 2008/6/18 Mihails Agafonovs <[EMAIL PROTECTED]>: > How can I clear the whole Solr index? > Ar cieņu, Mihails -- Regards, Shalin Shekhar Mangar.

Re: Default result rows

2008-06-18 Thread Mihails Agafonovs
Doesn't work :(. None of the parameters in the "defaults" section is being read. Solr still uses the predefined default parameters. P.S. In "defaults" section I should be able specify also what stylesheet to use, right? Quoting Shalin Shekhar Mangar : You can configure this in solrconfig.xml unde

SOLR-236 patch works

2008-06-18 Thread JLIST
I had the patch problem but I manually created that file and solr nightly builds fine. After replacing solr.war with apache-solr-solrj-1.3-dev.jar, in solrconfig.xml, I added this: Then added this to the standard and dismax handler handler collapse I added &collapse.field=&collaps

Re: "Did you mean" functionality

2008-06-18 Thread Lucas F. A. Teixeira
Yeah, i read it. Thanks a lot, I`m waiting for it! []s, Lucas Lucas Frare A. Teixeira [EMAIL PROTECTED] Tel: +55 11 3660.1622 - R3018 Grant Ingersoll escreveu: Also see http://wiki.apache.org/solr/SpellCheckComponent I expect to commit fairly soon. On Jun 17, 20

Re: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Koji Sekiguchi
A patch for this had been posted before, though I don't know it can delete. It can add documents and commit from admin gui. https://issues.apache.org/jira/browse/SOLR-85 Koji JLIST wrote: It seems that the web interface only supports select but not delete. Is it possible to do delete from the

Solr/bin/commit problem - fails to commit correctly and render response

2008-06-18 Thread McBride, John
Hello, I am using the solr/bin/commit file to commit index changes after index distribution in the collection distribution operations model. The commit script is printed at the end of the email. When I run the script as is, I get the following error: commit request to Solr at port 8080 failed

RE: Solr/bin/commit problem - fails to commit correctly and render response

2008-06-18 Thread McBride, John
Ok I checked out the nightly builds and the two changes have been made. I will use the SOLR 1.3 version of solr/bin/commit. Thanks, John -Original Message- From: McBride, John [mailto:[EMAIL PROTECTED] Sent: 18 June 2008 11:48 To: solr-user@lucene.apache.org Subject: Solr/bin/commit p

never desallocate RAM...during search

2008-06-18 Thread Roberto Nieto
Hi users, Somedays ago I made a question about RAM use during searchs but I didn't solve my problem with the ideas that some expert users told me. After making somes test I can make a more specific question hoping someone can help me. My problem is that i need highlighting and i have quite big do

Re: Default result rows

2008-06-18 Thread Otis Gospodnetic
Use &rows=NNN in the URL. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Mihails Agafonovs <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Wednesday, June 18, 2008 4:30:53 AM > Subject: Default result rows > > Hi! > > Where

Re: SOLR-236 patch works

2008-06-18 Thread Otis Gospodnetic
That looks right. CollapseComponent replaces QueryComponent. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: JLIST <[EMAIL PROTECTED]> > To: Otis Gospodnetic > Sent: Wednesday, June 18, 2008 5:24:25 AM > Subject: SOLR-236 patch works > >

Re: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Otis Gospodnetic
As for POST vs. GET - don't let REST purists hear you. :) Actually, isn't there a DELETE HTTP method that REST purists would say should be used in case of doc deletion? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: JLIST <[EMAIL PROTECTED]

Re: never desallocate RAM...during search

2008-06-18 Thread Otis Gospodnetic
Hi, I don't have the answer about why cache still shows "true", but as far as memory usage goes, based on your description I'd guess the memory is allocated and used by the JVM which typically tries not to run GC unless it needs to. So if you want to get rid of that used memory, you need to ta

Re: Default result rows

2008-06-18 Thread Yonik Seeley
2008/6/18 Mihails Agafonovs <[EMAIL PROTECTED]>: > Doesn't work :(. None of the parameters in the "defaults" section is > being read. Everyone uses this functionality, so it's a bug in your request or config somewhere. - Make sure you restarted Solr after changing solrconfig.xml - Make sure you ch

RE: never desallocate RAM...during search

2008-06-18 Thread r.nieto
Hi Otis, Thank you for your attention. I've read for days the mail list of lucene and solr and no-one have problems with anything similar that’s why it's seem a bit strange for me this behaviour. I can try what you comment about the "gc", but what I'm telling is a normal behaviour? I must confi

Re: Default result rows

2008-06-18 Thread Mihails Agafonovs
The "problem" was in the search query submit form, where rows value was defined as 10. Quoting Yonik Seeley : 2008/6/18 Mihails Agafonovs <[EMAIL PROTECTED]>: > Doesn't work :(. None of the parameters in the "defaults" section is > being read. Everyone uses this functionality, so it's a bug in

Re: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess delete over REST is not so evil. Let us do it. Don't we delete mails over HTTP GET? --Noble On Wed, Jun 18, 2008 at 6:20 PM, Otis Gospodnetic <[EMAIL PROTECTED]> wrote: > As for POST vs. GET - don't let REST purists hear you. :) > Actually, isn't there a DELETE HTTP method that REST purist

Re: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Walter Underwood
Only if each document in Solr has a URI. Add/replace would use PUT. Never, never delete with a GET. The Ultraseek spider deleted 20K docments on an intranet once because they gave it admin perms and it followed the "delete this page" link on every page. wunder On 6/18/08 5:50 AM, "Otis Gospodnet

missing document count?

2008-06-18 Thread Geoffrey Young
hi all :) maybe I'm just missing it, but I don't see a way to consistently (and easily) know the number of returned documents without a lot of acrobatics. numFound represents the entire number of matching documents if numFound <= rows then numFound is the number of documents in the respo

Slight issue with classloading and DataImportHandler

2008-06-18 Thread Brendan Grainger
Hi, I set up the new DataimportHandler last night to replace some custom import code I'd written and so far I'm loving it thank you. I had one issue you might want to know about it. I have some solr extensions I've written and packaged in a jar which I place in: solr-home/lib as per: ht

Re[2]: SOLR-236 patch works

2008-06-18 Thread JLIST
> That looks right. CollapseComponent replaces QueryComponent. Does it mean that if collapse parameters show up in the URL, CollapseComponent will be used automatically, and if not, QueryComponent will be used? Or is it always going to be CollapseComponent, which defaults to QueryComponent's beh

Re: missing document count?

2008-06-18 Thread Walter Underwood
Parse the results into a list and do something like this: Math.min(results.size(), numFound) // Java min(len(results), numFound) # Python Doesn't seem all that hard, and not worth duplicating the info. I don't ever remember needing to know the number of hits returned in a page. Eith

Re: missing document count?

2008-06-18 Thread Geoffrey Young
Walter Underwood wrote: Parse the results into a list and do something like this: Math.min(results.size(), numFound) // Java min(len(results), numFound) # Python we're using json, but sure, I can calculate it :) Doesn't seem all that hard, and not worth duplicating the info.

Re: missing document count?

2008-06-18 Thread Chris Hostetter
: not hard, but useful information to have handy without additional : manipulations on my part. : our pages are the results of multiple queries. so, given a max number of : records per page (or total), the rows asked of query2 is max - query1, of in the common case, counting the number of "doc"

Re: missing document count?

2008-06-18 Thread Geoffrey Young
Chris Hostetter wrote: : not hard, but useful information to have handy without additional : manipulations on my part. : our pages are the results of multiple queries. so, given a max number of : records per page (or total), the rows asked of query2 is max - query1, of in the common case, co

Re[2]: Feature idea - delete and commit from web interface ?

2008-06-18 Thread JLIST
GET makes it possible to delete from a browser address bar, which you can not do with DELETE :) > As for POST vs. GET - don't let REST purists hear you. :) > Actually, isn't there a DELETE HTTP method that REST purists > would say should be used in case of doc deletion?

Re[2]: Feature idea - delete and commit from web interface ?

2008-06-18 Thread JLIST
Sounds like web designer's fault. No permission check and no confirmation for deletion? > Never, never delete with a GET. The Ultraseek spider deleted 20K > docments on an intranet once because they gave it admin perms and > it followed the "delete this page" link on every page.

Re: Re[2]: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Walter Underwood
The spider was given an admin login so it could access all content. Reasonable decision if the pages had been designed well. Even with a confirmation, never delete with a GET. Use POST. If the spider ever discovers the URL that the confirmation uses, it will still delete the content. Luckily, the

Re: Re[2]: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Craig McClanahan
On Wed, Jun 18, 2008 at 1:55 PM, JLIST <[EMAIL PROTECTED]> wrote: > > Sounds like web designer's fault. No permission check and no > confirmation for deletion? > Nope ... application designer's fault for misusing the web. Allowing deletes on a GET violates HTTP/1.1 requirements (not just RESTful

Re: scaling / sharding questions

2008-06-18 Thread Phillip Farber
This may be slightly off topic, for which I apologize, but is related to the question of searching several indexes as Lance describes below, quoting: "We also found that searching a few smaller indexes via the Solr 1.3 Distributed Search feature is actually faster than searching one large ind

Re: scaling / sharding questions

2008-06-18 Thread Yonik Seeley
On Wed, Jun 18, 2008 at 5:53 PM, Phillip Farber <[EMAIL PROTECTED]> wrote: > Does this mean that the Lucene scoring algorithm is computed without the idf > factor, i.e. we just get term frequency scoring? No, it means that the idf calculation is done locally on a single shard. With a big index tha

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Jon Baer
Thanks. Yeah took me a while to figure out I needed to do something like transformer="com.mycompany.solr.MyTransformer" on the entity before it would work ... - Jon On Jun 18, 2008, at 1:51 PM, Brendan Grainger wrote: Hi, I set up the new DataimportHandler last night to replace some cust

Seeking suggestions - keyword related site promotion

2008-06-18 Thread JLIST
Hi all, This is what I'm trying to do: since some sources (say, some web sites) are more authoritative than other sources on certain subjects, I'd like to promote those sites when the query contains certain keywords. I'm not sure what is the best way to implement this. I suppose I can index the ke

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
hi, DIH does not load class using the SolrResourceLoader. It tries a Class.forName() with the name you provide if it fails it prepends "org.apache.solr.handler.dataimport." and retries. This is true for not just transformers but also for Entityprocessor, DataSource and Evaluator The reason for do

Re: Re[2]: Feature idea - delete and commit from web interface ?

2008-06-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
The implementation may provide a form where user can type in a doc id to delete or a lucene query if it is a POST so be it. But let us have the functionality --Noble On Thu, Jun 19, 2008 at 2:40 AM, Craig McClanahan <[EMAIL PROTECTED]> wrote: > On Wed, Jun 18, 2008 at 1:55 PM, JLIST <[EMAIL

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Brendan Grainger
Hi, I am actually providing the fully qualified classname in the configuration and I was still getting a ClassNotFoundException. If you look at the code in SolrResourceLoader they actually explicitly add the jars in solr-home/lib to the classloader: static ClassLoader createClassLoader(Fi

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
aah!. We always assumed that people put the custom jars in the WEB-INF/lib folder of solr webapp and hence they are automatically in the classpath we shall make the necessary changes . --Noble On Thu, Jun 19, 2008 at 10:06 AM, Brendan Grainger <[EMAIL PROTECTED]> wrote: > Hi, > > I am actually pr

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Brendan Grainger
Awesome thank you very much and thanks for the very useful contribution. Brendan On Jun 19, 2008, at 12:52 AM, Noble Paul നോബിള്‍ नोब्ळ् wrote: aah!. We always assumed that people put the custom jars in the WEB-INF/lib folder of solr webapp and hence they are automatically in the classpath

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Chris Hostetter
: aah!. We always assumed that people put the custom jars in the : WEB-INF/lib folder of solr webapp and hence they are automatically in : the classpath we shall make the necessary changes . It would be better to use the classloader from the SolrResourceLoader ... that should be safe for anyone

Re: Seeking suggestions - keyword related site promotion

2008-06-18 Thread Stephen Weiss
Is there a fixed set of keywords? If so, I suppose you could simply index these keywords into a field for each site (either through some kind of automatic parser or manually - from personal experience I would recommend manually unless you have tens of thousands of these things), and then s

Re: Slight issue with classloading and DataImportHandler

2008-06-18 Thread Noble Paul നോബിള്‍ नोब्ळ्
We plan to use SolrResourceLoader (in the next patch) . That is the best way to go. But we still prefer the usage of DIH package classes without any prefix. type="HttpDataSource" instead of type="solr.HttpDataSource" But users must be able to load their classes using the "solr." format --Noble