RE: CommonGrams

2017-04-11 Thread Markus Jelsma
Hi - i cannot think of any real drawback right away. But you probably can expect a slightly different ordered MLT response. It should not be a problem if you select enough terms for MLT lookup. Regards, Markus -Original message- > From:David Hastings > Sent: Tuesday 11th April 2017

Re: commongrams

2017-02-11 Thread Shawn Heisey
On 2/10/2017 2:55 PM, David Hastings wrote: > of right now has 22 million documents and sits around 360 gb. at this > rate, it would be around a TB index size. is there a common > hardware/software configuration to handle TB size indexes? Memory is the secret to Solr performance. Lots and lots of

RE: CommonGrams indexing very slow!

2011-04-27 Thread Burton-West, Tom
- From: Salman Akram [mailto:salman.ak...@northbaysolutions.net] Sent: Wednesday, April 27, 2011 1:43 PM To: solr-user@lucene.apache.org Subject: Re: CommonGrams indexing very slow! Thanks for the response. We got it resolved! . We made small indexes in bulk using SOLR with Standard File Forma

Re: CommonGrams indexing very slow!

2011-04-27 Thread Salman Akram
Thanks for the response. We got it resolved! . We made small indexes in bulk using SOLR with Standard File Format and then merged it with a Lucene app which for some reason made it CFS. Now when we started adding real time documents using SOLR (with Compound File Format set to false) it was mergin

RE: CommonGrams indexing very slow!

2011-04-27 Thread Burton-West, Tom
Hi Salman, Sounds like somehow you are triggering merges or optimizes. What is your mergeFactor? Have you turned on the IndexWriter log? In solrconfig.xml true In our case we feed the directory name as a Java property in our java startup script , but you can also hard code where you want

Re: CommonGrams indexing very slow!

2011-04-27 Thread Salman Akram
No way. It just does this while committing. Also before this when we merged multiple small indexes without optimization - as it was done in past it again took around 12 hours and made around 20 CFS files (it never happened before) On Wed, Apr 27, 2011 at 8:21 PM, Erick Erickson wrote: > Are you

Re: CommonGrams indexing very slow!

2011-04-27 Thread Erick Erickson
Are you by any chance optimizing? Best Erick On Wed, Apr 27, 2011 at 11:04 AM, Salman Akram wrote: > All, > > We have created index with CommonGrams and the final size is around 370GB. > Everything is working fine but now when we add more documents into index it > takes forever (almost 12 hours)

Re: CommonGrams and SOLR - 1604

2011-01-18 Thread Salman Akram
Anyone? On Mon, Jan 17, 2011 at 7:48 PM, Salman Akram < salman.ak...@northbaysolutions.net> wrote: > Hi, > > I am trying to use CommonGrams with SOLR - 1604 patch but doesn't seem to > work. > > If I don't add {!complexphrase} it uses CommonGramsQueryFilterFactory and > proper bi-grams are made

Re: CommonGrams phrase query

2011-01-17 Thread Salman Akram
Ok sorry it was my fault. I wasn't using CommonGramsQueryFilter for query, just had Filter for indexing. The query seems fine now. On Mon, Jan 17, 2011 at 1:44 PM, Salman Akram < salman.ak...@northbaysolutions.net> wrote: > Hi, > > I have made an index using CommonGrams. Now when I query "a b" a