Re: Disk usage per-field

2010-11-02 Thread Muneeb Ali
? - Muneeb -- View this message in context: http://lucene.472066.n3.nabble.com/Disk-usage-per-field-tp934765p1827739.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Searching for words with accented characters.

2010-08-27 Thread Muneeb Ali
Hey Robert, Just wondering if you ever got to solve this problem? We are facing a similar issue with our catalog search :( look forward to hearing from you. -Thanks, Muneeb -- View this message in context: http://lucene.472066.n3.nabble.com/Searching-for-words-with-accented-characters

Re: improving search response time

2010-08-19 Thread Muneeb Ali
/DRAM storage... Is anyone using SSDs for solr application? What would be a better route to take? more memory or flash based SSD hard drive? Thanks, -Muneeb -- View this message in context: http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p1226372.html Sent from the Solr

Re: improving search response time

2010-08-18 Thread Muneeb Ali
=161.46207100162033) 2.0 = boost 8.5721357E-4 = queryNorm DisMaxQParser − − sum(readerScore)^2 sum(yearScore)^1.1 − 5468.0 − 1.0 − 1.0 − 0.0 − 0.0 − 0.0 − 0.0 − 0.0 − 0.0 − 5467.0 − 4734.0 − 0.0 − 0.0 − 231.0 − 0.0 − 0.0 − 501.0 = Thanks for your help. -Muneeb -- View this message in context: http://lucene.472066.n3.nabble.com/improving-search-response-time-tp1204491p1207596.html Sent from the Solr - User mailing list archive at Nabble.com.

improving search response time

2010-08-18 Thread Muneeb Ali
, minimizing number of stored fields, apart from hardware suggestions. I would appreciate if anyone with similar background could shed some light on upgrading hardware in our situation. Or if any other configuration tweak that is not on the above list. Thanks, -Muneeb -- View this message in

Re: slave index is bigger than master index

2010-07-29 Thread Muneeb Ali
Where do these lines go in solr config? 5000 1 Thanks, -Mueeb -- View this message in context: http://lucene.472066.n3.nabble.com/slave-index-is-bigger-than-master-index-tp996329p1003903.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: slave index is bigger than master index

2010-07-29 Thread Muneeb Ali
Well I do have disk limitations too, and thats why I think slave nodes died, when replicating data from master node. (as it was just adding on top of existing index files). What do you mean here? Optimizing is too CPU expensive? What I meant by avoid playing around with slave nodes is that doing

Re: slave index is bigger than master index

2010-07-28 Thread Muneeb Ali
>> In solrconfig.xml, these two lines control that. Maybe they need to be increased. >> 5000 >> 1 Where do I add those in solrconfig? These lines doesn't seem to be present in the example solrconfig file... -- View this message in context: http://lucene.472066.n3.nabble.com/slave-i

Re: slave index is bigger than master index

2010-07-28 Thread Muneeb Ali
Well I do have disk limitations too, and thats why I think slave nodes died, when replicating data from master node. (as it was just adding on top of existing index files). :: What do you mean here? Optimizing is too CPU expensive? What I meant by avoid playing around with slave nodes is that d

Re: slave index is bigger than master index

2010-07-27 Thread Muneeb Ali
We have three dedicated servers for solr, two for slaves and one for master, all with linux/debian packages installed. I understand that replication does always copies over the index in an exact form as in master index directory (or it is supposed to do that at least), and if the master index wa

Re: slave index is bigger than master index

2010-07-26 Thread Muneeb Ali
dex, which somehow resulted in normal index size at slaves. I still don't get what exactly happened there, and will be investigating into this. If I do find anything interesting, will update on this mailing list. Thanks for all your input anyways, -Muneeb -- View this message in context:

Re: slave index is bigger than master index

2010-07-26 Thread Muneeb Ali
I just checked my config file, and I do have exact same values for deletionPolicy tag, as you attached in your email, so I dont really think it could be this. -- View this message in context: http://lucene.472066.n3.nabble.com/slave-index-is-bigger-than-master-index-tp996329p996373.html Sent fr

Re: AW: slave index is bigger than master index

2010-07-26 Thread Muneeb Ali
Yes I always run an optimize whenever I index on master. In fact I just ran an optimize command an hour ago, but it didn't make any difference. -- View this message in context: http://lucene.472066.n3.nabble.com/slave-index-is-bigger-than-master-index-tp996329p996364.html Sent from the Solr - Us

slave index is bigger than master index

2010-07-26 Thread Muneeb Ali
nodes is much bigger (336GB) than the master node index (i.e. only 86GB). I am guessing that its not removing previous indices at slave nodes when replicating? Has anyone faced similar issues? Any help would be highly appreciated. Thanks very much. -Muneeb -- View this message in context: http

Re: anyone use hadoop+solr?

2010-06-22 Thread Muneeb Ali
Hi Blargy, Nice to hear that I am not alone ;) Well we have been using Hadoop for other data-intensive services, those that can be done in parallel. We have multiple nodes, which are used by Hadoop for all our MapReduce jobs. I personally don't have much experience with its use and hence wouldn

Switching cores dynamically

2010-03-19 Thread muneeb
Hi, I have indexed almost 7 million articles on two separate cores, each with their own conf/ and data/ folder, i.e. they have their individual index. What I normally do is, use core0 for querying and core1 for any updates and once updates are finished i copy the index of core1 to core0's data f

Custom Score for Solr

2010-03-15 Thread muneeb
Hi, I have added a few extra fields to my solr document, which I want to effect the default scoring algorithm. Could anyone guide me on how to start customizing the solr scoring algorithm? My Scenario: As an example: my each indexed article has a field 'readerCount' which holds the number of pe

Re: issue with delete index

2010-03-12 Thread muneeb
ting to be different and hence concluded that delete index didn't work!! -M Yonik Seeley-2 wrote: > > On Thu, Mar 11, 2010 at 12:22 PM, muneeb wrote: >> I have made some changes to my schema, including setting of omitNorms to >> false for a few fields. I am using Solr1.4 w

Re: field length normalization

2010-03-12 Thread muneeb
hat's why, in your example, the lengthNorm for 3 and 4 is the same. > > -Jay > http://www.lucidimagination.com > > > > > > On Thu, Mar 11, 2010 at 9:50 AM, muneeb wrote: > >> >> >> : >> : Did you reindex after setting omitNorms to false? I'm not sur

Re: field length normalization

2010-03-11 Thread muneeb
: : Did you reindex after setting omitNorms to false? I'm not sure whether or : not it is needed, but it makes sense. Yes i deleted the old index and reindexed it. Just to add another fact, that the titlles length is less than 10. I am not sure if solr has pre-set values for length normalizatio

issue with delete index

2010-03-11 Thread muneeb
Hi, I have made some changes to my schema, including setting of omitNorms to false for a few fields. I am using Solr1.4 with SolrJ client. I deleted my index using the client: solrserver.deleteByQuery("*:*"); solrserver.optimize(); But after reindexing and running the queries i don't see any di

field length normalization

2010-03-11 Thread muneeb
Hi, In my schema, the document title field has "omitNorms=false", which, if I am not wrong, causes length of titles to be counted in the scoring. But when I query with: "word1 word2 word3" I dont know why still the top two documents title have these words and other words, where as the document

indexing key/value field type

2010-03-09 Thread muneeb
Hi, I have built an index of several million documents with all primitive type fields, either String, text or int. I have another multivalued field to index now for each document which is a list of tags as a hashmap, so: tags , where key is String and value is Int. key is a given tag and value i

Re: need help with Solr Cores

2010-03-03 Thread muneeb
Figured it out !! I actually created two folders in solr.home/data folder, each holding the index for a given core. So for core0 and core1 i had indexes as: solr.home/data/core0/index solr.home/data/core1/index Feeling a little stupid now, having figured out a simple issue :s muneeb wrote

need help with Solr Cores

2010-03-03 Thread muneeb
Hi Everyone, I am new to Solr, and still trying to get my hands on it. I have indexed over 6 million documents and currently have a single large index. I update my index using SolrJ client due to the format I store my documents (i.e. JSON blobs) in database. I need to find a way to have multiple

Removing duplicate values from multivalued fields

2010-02-25 Thread muneeb
Hi, Is there a way to remove duplicate values from the multivalued fields? I am using Solrj client with solr 1.4 version. Thanks in advance, -Ali -- View this message in context: http://old.nabble.com/Removing-duplicate-values-from-multivalued-fields-tp27714441p27714441.html Sent from the So

SolrJ Beginner (NEED HELP URGENT)

2010-02-15 Thread muneeb
Hey All, I have gone through the tutorial and ran Solrj example code. It worked fine. I want to now implement my own full text search engine for my documents. I am not sure how should i start about doing this, since in example code I ran start.jar and post.jar? do I have to run start.jar even