Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Dennis Gearon
So, if my other filter/selection criteria get some set of the whole index that goes say from 50% relevance to 60% relevance, the set still gets ordered by relevance and then each item in the returned set is still based on its relevance relative to the set, right? That would only be a problem if

Re: scheduling imports and heartbeats

2010-11-09 Thread Ranveer Kumar
You should use cron for that.. On 10 Nov 2010 08:47, "Tri Nguyen" wrote: Hi, Can I configure solr to schedule imports at a specified time (say once a day, once an hour, etc)? Also, does solr have some sort of heartbeat mechanism? Thanks, Tri

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Lance Norskog
Relevance is TF/DF, meaning the term frequency in the index. DF is the number of times the term appears in the document. There is no quick calculation for "total frequency for terms only in these documents". Facets do this, and they're very very slow. On Tue, Nov 9, 2010 at 7:50 PM, Dennis Gearon

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Dennis Gearon
hm, relevance is before filtering, probably during indexing?  Dennis Gearon Signature Warning It is always a good idea to learn from your own mistakes. It is usually a better idea to learn from others’ mistakes, so you do not have to make them yourself. from 'http://blogs

scheduling imports and heartbeats

2010-11-09 Thread Tri Nguyen
Hi,   Can I configure solr to schedule imports at a specified time (say once a day, once an hour, etc)?   Also, does solr have some sort of heartbeat mechanism?   Thanks,   Tri

Re: Highlighter - multiple instances of term being combined

2010-11-09 Thread Lance Norskog
Have you looked at solr/admin/analysis.jsp? This is 'Analysis' link off the main solr admin page. It will show you how text is broken up for both the indexing and query processes. You might get some insight about how these words are torn apart and assigned positions. Trying the different Analyzers

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Lance Norskog
There is a standard problem with this: relevance is determined from all of the words in a field of all documents, not just the documents that match the query. That is, when user A searches for 'monkeys' and one of his feeds has a document with this word, but someone else is a zoophile, 'monkeys' wi

Re: dynamically create unique key

2010-11-09 Thread Lance Norskog
Here is an exausting and exhaustive discursion about picking a unique key: http://wiki.apache.org/solr/UniqueKey On Tue, Nov 9, 2010 at 4:20 PM, Dennis Gearon wrote: > Seems to me, it would be a good idea to put into the Solr Code, a unique ID > per > instance or installation or both, access

Re: returning message to sender

2010-11-09 Thread Lance Norskog
David Smiley and Eric Pugh wrote a wonderful book on Solr: http://www.lucidimagination.com/blog/2010/01/11/book-review-solr-packt-book/ Reading through this book and trying the examples will address all of your questions. On Tue, Nov 9, 2010 at 3:23 PM, Erick Erickson wrote: > Hmmm, this is a l

Re: solr init.d script

2010-11-09 Thread Lance Norskog
As many solrs as you want can open an index for read-only queries. If you have a shared disk with a global file system, this could work very well. A note: Solr sessions are stateless. There is no reason to run JBoss Solr in fail-over mode with session replication. On Tue, Nov 9, 2010 at 12:25 PM,

Highlighter - multiple instances of term being combined

2010-11-09 Thread Sasank Mudunuri
I'm finding that if a keyword appears in a field multiple times very close together, it will get highlighted as a phrase even though there are other terms between the two instances. So this search: http://localhost:8983/solr/select/? hl=true& hl.snippets=1& q=residue& hl.fragsize=0& mergeContiguo

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Adam Estrada
Thanks a lot for all the tips, guys! I think that we may explore both options just to see what happens. I'm sure that scalability will be a huge mess with the core-per-user scenario. I like the idea of creating a user ID field and agree that it's probably the best approach. We'll see...I will be su

RE: Using Multiple Cores for Multiple Users

2010-11-09 Thread Jonathan Rochkind
If storing in a single index (possibly sharded if you need it), you can simply include a solr field that specifies the user ID of the saved thing. On the client side, in your application, simply ensure that there is an fq parameter limiting to the current user, if you want to limit to the curren

Re: dynamically create unique key

2010-11-09 Thread Dennis Gearon
Seems to me, it would be a good idea to put into the Solr Code, a unique ID per instance or installation or both, accessible either with JAVA or a query. Kind of like all the browsers do for their SSL connections. Then, it's automatically easy to implement what is described below. Maybe it shou

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Dennis Gearon
I'm willing to bet a lot that the standard approach is to use a Server Side Langauge to customize the queries for the user . . . on the same core/set of cores. The only reasons that my limited experience suggests for a 'core per user' is privacy/performance. Unless you have a very small set of

Re: Using Multiple Cores for Multiple Users

2010-11-09 Thread Markus Jelsma
Hi, > All, > > I have a web application that requires the user to register and then login > to gain access to the site. Pretty standard stuff...Now I would like to > know what the best approach would be to implement a "customized" search > experience for each user. Would this mean creating a sepa

Re: returning message to sender

2010-11-09 Thread Erick Erickson
Hmmm, this is a little murky I'm inferring that you believe that DIH somehow queries the data source at #query# time, and this is not true. DIH is an #index time# concept. DIH is used to add data to an index. Once that index is created, all searches against are unaware that there were differe

Using Multiple Cores for Multiple Users

2010-11-09 Thread Adam Estrada
All, I have a web application that requires the user to register and then login to gain access to the site. Pretty standard stuff...Now I would like to know what the best approach would be to implement a "customized" search experience for each user. Would this mean creating a separate core per use

RE: returning message to sender

2010-11-09 Thread Teki, Prasad
--=_Part_27114_30663314.1289327581322 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hi guys, I have been exploring Solr since last few weeks. Our main intension is to expose the data, as WS, across various data sources by linking them using some scenario. I have

Re: solr init.d script

2010-11-09 Thread Nikola Garafolic
On 11/09/2010 07:00 PM, Israel Ekpo wrote: Yes. I recommend running Solr via a servlet container. It is much easier to manage compared to running it by itself. On Tue, Nov 9, 2010 at 10:03 AM, Nikola Garafolic wrote: But in my case, that would make things more complex as I see it. Two jboss

Re: dynamically create unique key

2010-11-09 Thread Christopher Gross
Thanks Hoss, I'll look into that! -- Chris On Tue, Nov 9, 2010 at 1:43 PM, Chris Hostetter wrote: > > : one large index. I need to create a unique key for the Solr index that > will > : be unique per document. If I have 3 systems, and they all have a > document > : with id=1, then I need to c

Re: spell check vs terms component

2010-11-09 Thread Ken Stanley
On Tue, Nov 9, 2010 at 1:02 PM, Shalin Shekhar Mangar wrote: > On Tue, Nov 9, 2010 at 8:20 AM, bbarani wrote: > >> >> Hi, >> >> We are trying to implement auto suggest feature in our application. >> >> I would like to know the difference between terms vs spell check component. >> >> Both the hand

Solr highlighter question

2010-11-09 Thread Moazzam Khan
Hey guys, I have 3 fields: FirstName, LastName, Biography. They are all string fields. In schema, I copy them to the default search field which is "text". Is there any way to get Solr to highlight all the fields when someone searches the default search field but when someone searches for FirstNam

Re: dynamically create unique key

2010-11-09 Thread Chris Hostetter
: one large index. I need to create a unique key for the Solr index that will : be unique per document. If I have 3 systems, and they all have a document : with id=1, then I need to create a "uniqueId" field in my schema that : contains both the system name and that id, along the lines of: "sysa

Re: How to Facet on a price range

2010-11-09 Thread Geert-Jan Brits
@ http://www.mysecondhome.co.uk/search.htm --> when you drag the sliders , an update of how many results would match is immediately shown. I really like this. How did you do this? IS this out-of-the-box available with the suggested Facet_by_range patch?

Re: spell check vs terms component

2010-11-09 Thread Shalin Shekhar Mangar
On Tue, Nov 9, 2010 at 8:20 AM, bbarani wrote: > > Hi, > > We are trying to implement auto suggest feature in our application. > > I would like to know the difference between terms vs spell check component. > > Both the handlers seems to display almost the same output, can anyone let > me > know

Re: solr init.d script

2010-11-09 Thread Israel Ekpo
Yes. I recommend running Solr via a servlet container. It is much easier to manage compared to running it by itself. On Tue, Nov 9, 2010 at 10:03 AM, Nikola Garafolic wrote: > I have two nodes running one jboss server each and using one (single) solr > instance, thats how I run it for now. > >

Is there a way to embed terms handler in search handler?

2010-11-09 Thread bbarani
Hi, I am trying to figure out if there is a way to embed terms handler as part of default search handler and access using URL something lilke below http://localhost:8990/solr/db/select?q=*:*&terms.prefix=a&terms.fl=name Couple of other questions, I would like to know if its possible to mentio

spell check vs terms component

2010-11-09 Thread bbarani
Hi, We are trying to implement auto suggest feature in our application. I would like to know the difference between terms vs spell check component. Both the handlers seems to display almost the same output, can anyone let me know the difference and also I would like to know when to go for spell

Re: How to Facet on a price range

2010-11-09 Thread gwk
Hi, Instead of all the facet queries, you can also make use of range facets (http://wiki.apache.org/solr/SimpleFacetParameters#Facet_by_Range), which is in trunk afaik, it should also be patchable into older versions of Solr, although that should not be necessary. We make use of it (http://w

Re: dynamically create unique key

2010-11-09 Thread Ken Stanley
On Tue, Nov 9, 2010 at 10:53 AM, Christopher Gross wrote: > Thanks Ken. > > I'm using a script with Java/SolrJ to copy documents from their original > locations into the Solr Index. > > I wasn't sure if the copyField would help me, but from your answers it seems > that I'll have to handle it on my

Re: dynamically create unique key

2010-11-09 Thread Christopher Gross
Thanks Ken. I'm using a script with Java/SolrJ to copy documents from their original locations into the Solr Index. I wasn't sure if the copyField would help me, but from your answers it seems that I'll have to handle it on my own. That's fine -- it is definitely not hard to pass a new field mys

Re: dynamically create unique key

2010-11-09 Thread Ken Stanley
On Tue, Nov 9, 2010 at 10:39 AM, Christopher Gross wrote: > I'm trying to use Solr to store information from a few different sources in > one large index.  I need to create a unique key for the Solr index that will > be unique per document.  If I have 3 systems, and they all have a document > with

dynamically create unique key

2010-11-09 Thread Christopher Gross
I'm trying to use Solr to store information from a few different sources in one large index. I need to create a unique key for the Solr index that will be unique per document. If I have 3 systems, and they all have a document with id=1, then I need to create a "uniqueId" field in my schema that c

Re: Replication and ignored fields

2010-11-09 Thread Jan Høydahl / Cominvent
Cool, thanks for the clarification, Shalin. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com On 9. nov. 2010, at 15.12, Shalin Shekhar Mangar wrote: > On Tue, Nov 9, 2010 at 12:33 AM, Jan Høydahl / Cominvent > wrote: >> Not sure about that. I have read that the replica

Re: How to Facet on a price range

2010-11-09 Thread Geert-Jan Brits
Just to add to this, if you want to allow the user more choice in his option to select ranges, perhaps by using a 2-sided javasacript slider for the pricerange (ala kayak.com) it may be very worthwhile to discretize the allowed values for the slider (e.g: steps of 5 dolllar) Most js-slider implemen

Re: Replication and ignored fields

2010-11-09 Thread Shalin Shekhar Mangar
On Tue, Nov 9, 2010 at 12:33 AM, Jan Høydahl / Cominvent wrote: > Not sure about that. I have read that the replication handler actually issues > a commit() on itself once the index is downloaded. That was true with the old replication scripts. The Java based replication just re-opens the IndexR

Re: How to Facet on a price range

2010-11-09 Thread jayant
That was very well thought of and a clever solution. Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-Facet-on-a-price-range-tp1846392p1869201.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr init.d script

2010-11-09 Thread Israel Ekpo
I think it would be a better idea to load solr via a servlet container like Tomcat and then create the init.d script for tomcat instead. http://wiki.apache.org/solr/SolrTomcat#Installing_Tomcat_6 On Tue, Nov 9, 2010 at 2:47 AM, Eric Martin wrote: > Er, what flavor? > > RHEL / CentOS > > #!/bin/

Re: solr init.d script

2010-11-09 Thread Nikola Garafolic
I have two nodes running one jboss server each and using one (single) solr instance, thats how I run it for now. Do you recommend running jboss with solr via servlet? Two jboss run in load-balancing for high availability purpose. For now it seems to be ok. On 11/09/2010 03:17 PM, Israel Ekp

RE: Tomcat special character problem

2010-11-09 Thread Em
The problem was firstly the wrong URIEncoding of tomcat itself. The second problem came from the application's side: The params were wrongly encoded, so it was not possible to show the desired results. If you need to convert from different encodings to utf8, I can give you the following piece of

solr dynamic core creation

2010-11-09 Thread nizan
Hi, I’m not sure this is the right place, hopefully you can help. Anyway, I also sent mail to solr-user@lucene.apache.org I’m using solr – one master with 17 slaves in the server and using solrj as the java client Currently there’s only one core in all of them (master and slaves) – only the cpa

Re: Replication and ignored fields

2010-11-09 Thread Jan Høydahl / Cominvent
Not sure about that. I have read that the replication handler actually issues a commit() on itself once the index is downloaded. But probably a better way for Markus' case is to hook the prune job on the master, writing to another core (myIndexPruned). Then you replicate from that core instead,

Re: solr init.d script

2010-11-09 Thread Nikola Garafolic
Sorry, forgot to mention, Centos. Thanks. I have very similar script to this Centos one and I am missing status portion of the script. On 11/09/2010 08:47 AM, Eric Martin wrote: Er, what flavor? RHEL / CentOS #!/bin/sh # Starts, stops, and restarts Apache Solr. # # chkconfig: 35 92 08 # de