Re: How apache solr stores indexes

2013-05-28 Thread Kamal Palei
al Palei > Sent: Tuesday, May 28, 2013 10:54 PM > To: solr-user@lucene.apache.org > Subject: Re: How apache solr stores indexes > > > Thanks Alex. > > I am in dilemma how do I store the skill sets with solr index as a string > token or as an integer. To give little background

Re: How apache solr stores indexes

2013-05-28 Thread Jack Krupansky
query client's will be most comfortable with. -- Jack Krupansky -Original Message- From: Kamal Palei Sent: Tuesday, May 28, 2013 10:54 PM To: solr-user@lucene.apache.org Subject: Re: How apache solr stores indexes Thanks Alex. I am in dilemma how do I store the skill sets with

Re: How apache solr stores indexes

2013-05-28 Thread Alexandre Rafalovitch
Store them as a string token in multivalued fields. Solr/Lucene will do the necessary mapping and lookups. That's what you are paying it for. :-) That way you can easily facet and so on. You may need to change some parts of your architecture later, but you seem to be over-thinking it too early in

Re: How apache solr stores indexes

2013-05-28 Thread Kamal Palei
Thanks Alex. I am in dilemma how do I store the skill sets with solr index as a string token or as an integer. To give little background - As of today, each skill I assign a unique id (take as auto increment field in mysql table), and the store them against user id in a separate table. That's how

Re: How apache solr stores indexes

2013-05-28 Thread Shashi Kant
Better still start here: http://en.wikipedia.org/wiki/Inverted_index http://nlp.stanford.edu/IR-book/html/htmledition/a-first-take-at-building-an-inverted-index-1.html And there are several books on search engines and related algorithms. On Tue, May 28, 2013 at 10:41 PM, Alexandre Rafalovitch

Re: How apache solr stores indexes

2013-05-28 Thread Alexandre Rafalovitch
And you need to know this why? If you are really trying to understand how this all works under the covers, you need to look at Lucene's inverted index as a start. Start here: http://lucene.apache.org/core/4_3_0/core/org/apache/lucene/codecs/lucene42/package-summary.html#package_description Might

How apache solr stores indexes

2013-05-28 Thread Kamal Palei
Dear All I have a basic doubt how the data is stored in apache solr indexes. Say I have thousand registered users in my site. Lets say I want to store skills of each users as a multivalued string index. Say user 1 has skill set - Java, MySql, PHP user 2 has skill set - C++, MySql, PHP user 3 has