RE: Solr PHP client

2007-11-19 Thread SDIS M. Beauchamp
I use the php and php serialized writer to query Solr from php It's very easy to use But it's not so easy to update solr from php ( that's why my crawlers are not written in php ) Florent BEAUCHAMP -Message d'origine- De : Jonathan Ariel [mailto:[EMAIL PROTECTED] Envoyé : mardi 20 n

Solr on Windows / Linux

2007-11-19 Thread Eswar K
All, Is there any difference in the way any of the Solr's features work on Windows/Linux. Ideally it should not as its a java implementation. I was looking at CollectionsDistribution and its documentation ( http://wiki.apache.org/solr/CollectionDistribution). It appeared that it uses rsync which i

Re: Performance of Solr on different Platforms

2007-11-19 Thread Eswar K
In our case, the load is kind of distributed. On an average, the QPS could be much less than that. 1000 qps could be the peak load ever expected could ever reach. However the number of documents going to be in the range of 2 - 20 million documents. We would possibly distribute the indexes to diffe

Re: Performance of Solr on different Platforms

2007-11-19 Thread Walter Underwood
1000 qps is a lot of load, at least 30M queries/day. We are running dual CPU Power P5 machines and getting about 80 qps with worst case response times of 5 seconds. 90% of responses are under 70 msec. Our expected peak load is 300 qps on our back-end Solr farm. We execute multiple back-end querie

Re: Performance of Solr on different Platforms

2007-11-19 Thread Eswar K
Its not going to hit 1000 all the time, its the expected peak value. I guess for distributing the load we should be using collections and I was looking at the collections documentation ( http://wiki.apache.org/solr/CollectionDistribution) . - Eswar On Nov 20, 2007 12:07 AM, Matthew Runo <[EMAIL P

Re: Finding all possible synonyms for a word

2007-11-19 Thread Walter Underwood
How many synonym sets do you have? I'm using about 600 sets with no problem. --wunder On 11/19/07 8:23 PM, "climbingrose" <[EMAIL PROTECTED]> wrote: > Correction for last message: you need to modify or extend > SynonymFilterFactory instead of SynonymFilter. SynonmFilterFactory is > responsible f

Re: Finding all possible synonyms for a word

2007-11-19 Thread climbingrose
Correction for last message: you need to modify or extend SynonymFilterFactory instead of SynonymFilter. SynonmFilterFactory is responsible for initialising SynonymFilter and populating the list of synonyms. Have a look at the source code. I think it's pretty easy to understand. What you probably n

Re: Finding all possible synonyms for a word

2007-11-19 Thread climbingrose
One approach is to extend SynonymFilter so that it reads synonyms from database instead of a file. SynonymFilter is just a Java class so you can do whatever you want with it :D. From what I remember, the filter initialises a list of all input synonyms and store them in memory. Therefore, you need t

Re: Invalid value 'explicit' for echoParams parameter

2007-11-19 Thread Ryan McKinley
AHMET ARSLAN wrote: I am a newbie at solr. I have done everything in the solr tutorial section. I am using the latest versions of both JDK(1.6.03) and Solr(2.2). I can see the solr admin page http://localhost:8983/solr/admin/ But when I hit the search button I receive an http error: HTTP ERRO

Re: SolrJ - where can I have it

2007-11-19 Thread zx zhang
You can get it from svn (http://svn.apache.org/repos/asf/lucene/solr/trunk) or solr nightly-built version( http://people.apache.org/builds/lucene/solr/nightly/). Before using svn server, you maybe need to install a svn client in Windows, such as tortoiseSVN. If you are using a linux system, make s

Re: Solr PHP client

2007-11-19 Thread Mike Klaas
On 19-Nov-07, at 5:48 PM, Jonathan Ariel wrote: Hi! I'm wondering if someone is using a PHP client for solr. Actually I'm not sure if there is one out there. Would you be interested in having a SolrJ port for PHP? see http://wiki.apache.org/solr/SolPHP cheers, -Mike

SolrJ - where can I have it

2007-11-19 Thread zqzuk
Hi, I have been seeing tutorials and messages discussing solrj the magic client package which eases tasks for building solr powered applications... but I have been searching around without success, could you please give me some directions? Many thanks! -- View this message in context: http://ww

Solr PHP client

2007-11-19 Thread Jonathan Ariel
Hi! I'm wondering if someone is using a PHP client for solr. Actually I'm not sure if there is one out there. Would you be interested in having a SolrJ port for PHP? Thanks, Jonathan Leibiusky

Re: Pagination with Solr

2007-11-19 Thread climbingrose
Hi David, Do you use one of Solr client available http://wiki.apache.org/solr/IntegratingSolr? These clients should probably have done all the XML parsing jobs for you. I speak from Solrj experience. IMO, your approach is probably most commonly used when it comes to pagination. Solr caching mecha

Pagination with Solr

2007-11-19 Thread Dave C .
Hello again, I'm trying to accomplish very basic pagination with my Solr search results. What I'm trying is to parse the response for "numFound:" and if this number is greater than the "rows" parameter, I send another search request to Solr with a new "start" parameter. Is there a better way to

Re: Any tips for indexing large amounts of data?

2007-11-19 Thread Mike Klaas
There should be some slowdown in larger indices as occasionally large segment merge operations must occur. However, this shouldn't really affect overall speed too much. You haven't really given us enough data to tell you anything useful. I would recommend trying to do the indexing via a w

Re: I18N with SOLR?

2007-11-19 Thread Mike Klaas
On 18-Nov-07, at 9:59 PM, Dilip.TS wrote: Hello, Does SOLR supports searching for a keyword which has a combination of more than 1 language within the same search page? Sure: Solr is totally language-agnostic. -Mike

Re: Any tips for indexing large amounts of data?

2007-11-19 Thread Brendan Grainger
Hi, Thanks for answering this question a while back. I have made some of the suggestions you mentioned. ie not committing until I've finished indexing. What I am seeing though, is as the index get larger (around 1Gb), indexing is taking a lot longer. In fact it slows down to a crawl. Have

Re: How to use solr api for searching but without using web app

2007-11-19 Thread zqzuk
Thanks for your tips Chris, I really appreciate! hossman wrote: > > > : Hi, I have played with the solr example web app, it works well. I wonder > how > : do I do the same searching, or faceted searching without relying on the > web > : application, i.e., sending request by urls etc. In other

Re: How to use solr api for searching but without using web app

2007-11-19 Thread Chris Hostetter
: Hi, I have played with the solr example web app, it works well. I wonder how : do I do the same searching, or faceted searching without relying on the web : application, i.e., sending request by urls etc. In other words, essentially : how does the search and faceting work? Could you please point

Re: Tomcat install Connector help.

2007-11-19 Thread Chris Hostetter
: Hi, I am trying to install solr on tomcat and am wondering which connector to : best to use in the server.xml? it depends a lot more on your use cases then on any thing specific to solr ... how ong do you want your commection timeouts to be? how big do you want the max POST size to be? do you

Re: snapshot files

2007-11-19 Thread Chris Hostetter
: I have successfully built generated the snalshot files but have a question. : Does each snapshot file has all files in the index directory? : I have changed the snapshooter script because the bash in solaris do not : have cp -l option. you answered your own question: the scripts use hardlinks,

Re: Solr/bin script - Solaris bash version?

2007-11-19 Thread Chris Hostetter
: Is there Solaris bash based script available? The couple of command is not : working, and wondering any available scripts I can use before I update it. : : For ex. snapshooter, snappuller, snapinstaller which version of Solr are you using, there have been a couple of solaris related script

Re: Set result limit to MAX_VALUE causes NullPointerException

2007-11-19 Thread Chris Hostetter
: I now set a high value like 1 as result limit, which is always enough for : my needs, but I nevertheless wanted to point at this error. For the record: while Yonik has fixed solr so that it *can* accept MAX_VALUE, doesn't mean you *should* use MAX_VALUE. even if you want *all* the results

Re: Payloads in Solr

2007-11-19 Thread Tricia Williams
Yonik Seeley wrote: http://www.nabble.com/Payload-API-tf4828837.html#a13815548 http://www.nabble.com/new-Token-API-tf4828894.html#a13815702 Thanks for these links. I didn't even realize you had started these conversations. Thank you! Tricia

Re: Performance of Solr on different Platforms

2007-11-19 Thread Matthew Runo
I'd think that any platform that can run Java would be fine to run SOLR on. Maybe this is more a question of preferred platforms for Java deployments? That is quite the load for SOLR though, you may find that you want more than one server. Do you mean that you're expecting about 1000 QPS ov

Invalid value 'explicit' for echoParams parameter

2007-11-19 Thread AHMET ARSLAN
I am a newbie at solr. I have done everything in the solr tutorial section. I am using the latest versions of both JDK(1.6.03) and Solr(2.2). I can see the solr admin page http://localhost:8983/solr/admin/ But when I hit the search button I receive an http error: HTTP ERROR: 400 Invalid value

Re: Problems with Basic Install (newbie question)

2007-11-19 Thread Paul21
Daniel Naber-10 wrote: > > Are you sure you have installed the JDK, not just the JRE? > Daniel, As far as I know, I do have a full JDK. I'm on OS X and it should come with a full JDK: http://developer.apple.com/java/ Best, Paul -- View this message in context: http://www.nabble.com/Proble

Re: Indexing documents

2007-11-19 Thread zqzuk
Thanks! Can I have more details on SolrJ please, I have googled abit without success... what is it and where can I find it please, many thanks! Grant Ingersoll-6 wrote: > > Have a look at the tutorial on the website or some of the articles > written about Solr (http://wiki.apache.org/solr/So

Re: Get TF-IDF from index?

2007-11-19 Thread Grant Ingersoll
Have a look at the LukeRequestHandler (I think it is only on trunk). -Grant On Nov 19, 2007, at 5:50 AM, Jack wrote: I have only used the basic functionality of solr - post and query, which works great. I wonder if it's possible to get more information from the index. For example, I'd like to

RE: Get TF-IDF from index?

2007-11-19 Thread DAVIGNON Andre - CETE NP/DIODé/PANDOC
Hi, > I wonder if it's possible to get more information from the index. For > example, I'd like to get the TF-IDF score of a given term, or get a > list of terms sorted by TF-IDF, not from a given document, but from > the whole corpus, or, simply to enumerate all indexed terms. > Maybe solor does

Re: Payloads in Solr

2007-11-19 Thread Grant Ingersoll
On Nov 18, 2007, at 11:09 PM, Yonik Seeley wrote: I'm also wondering how others have accomplished this. Grant Ingersoll noted that one of the original use cases was XPath queries so I'm particularly interested in finding out if anyone has implemented that, and how. Me too. Any clarif

RE: Finding all possible synonyms for a word

2007-11-19 Thread Kishore AVK. Veleti
Hi Eswar, Thanks for the update. I have gone through the below link provided by you and what I understood from it is, we need to have all possible synonyms in a text file. This file need to be given as input for "SynonymFilterFactory" to work. If my understanding is right then the approach may

Re: Indexing documents

2007-11-19 Thread Grant Ingersoll
Have a look at the tutorial on the website or some of the articles written about Solr (http://wiki.apache.org/solr/SolrResources). Also, you may be interested in the SolrJ client (if you are using Java) which uses Apache HTTPClient to send requests (both indexing and query) to Solr. To ge

Re: Performance of Solr on different Platforms

2007-11-19 Thread Eswar K
All, Can you give some information on this or atleast let me know where I can find this information if its already listed out anywhere. Regards, Eswar On Nov 18, 2007 9:45 PM, Eswar K <[EMAIL PROTECTED]> wrote: > Hi, > > I understand that Solr can be used on different Linux flavors. Is there >

Re: multiple delete by id in one delete command?

2007-11-19 Thread Yonik Seeley
On Nov 19, 2007 12:18 AM, Norberto Meijome <[EMAIL PROTECTED]> wrote: > I'm trying to issue, via curl to SOLR (testing at the moment), 3 deletes by > id. > I tried sending : > > 123 > > and solr didn't like it at all. This is relatively new syntax in Solr... older versions won't like it. -Yonik

RE: I18N with SOLR?

2007-11-19 Thread SDIS M. Beauchamp
You can have only one default search field But you can use the dismax request handler to search across several fields http://wiki.apache.org/solr/DisMaxRequestHandler Then you can use query field boosting to make one field more significant : Exact_text^3 text_fr^2 text_en^2 stemmed_text^1.5 -

Get TF-IDF from index?

2007-11-19 Thread Jack
I have only used the basic functionality of solr - post and query, which works great. I wonder if it's possible to get more information from the index. For example, I'd like to get the TF-IDF score of a given term, or get a list of terms sorted by TF-IDF, not from a given document, but from the wh