I think people on this list would be more interested in your approach to scaling 2 billion documents than modifying solr/lucene scoring (which is already top notch). So given that, can you share any references or otherwise substantiate good performance with 2 billion documents?
Thanks. On Sun, 2012-05-27 at 08:29 -0700, Nagendra Nagarajayya wrote: > Actually, RankingAlgorithm 1.4.2 has been scaled to more than 2 billion > docs. With RankingAlgorithm 1.4.3, using the parameters > age=latest&docs=number feature, you can retrieve the NRT inserted > documents in milliseconds from such a huge index improving query and > faceting performance and using very little resources ... > > Currently, RankingAlgorithm 1.4.3 is only available with Solr 4.0, and > the NRT insert performance with Solr 4.0 is about 70,000 docs / sec. > RankingAlgorithm 1.4.3 should become available with Solr 3.6 soon. > > Regards, > > Nagendra Nagarajayya > http://solr-ra.tgels.org > http://rankingalgorithm.tgels.org > > > > On 5/27/2012 7:32 AM, Darren Govoni wrote: > > Hi, > > Have you tested this with a billion documents? > > > > Darren > > > > On Sun, 2012-05-27 at 07:24 -0700, Nagendra Nagarajayya wrote: > >> Hi! > >> > >> I am very excited to announce the availability of Solr 3.6 with > >> RankingAlgorithm 1.4.2. > >> > >> This NRT supports now works with both RankingAlgorithm and Lucene. The > >> insert/update performance should be about 5000 docs in about 490 ms with > >> the MbArtists Index. > >> > >> RankingAlgorithm 1.4.2 has multiple algorithms, improved performance > >> over the earlier releases, supports the entire Lucene Query Syntax, ± > >> and/or boolean queries and can scale to more than a billion documents. > >> > >> You can get more information about NRT performance from here: > >> http://solr-ra.tgels.org/wiki/en/Near_Real_Time_Search_ver_3.x > >> > >> You can download Solr 3.6 with RankingAlgorithm 1.4.2 from here: > >> http://solr-ra.tgels.org > >> > >> Please download and give the new version a try. > >> > >> Regards, > >> > >> Nagendra Nagarajayya > >> http://solr-ra.tgels.org > >> http://rankingalgorithm.tgels.org > >> > >> ps. MbArtists index is the example index used in the Solr 1.4 Enterprise > >> Book > >> > > > > > > >
