Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-08-01 Thread Yonik Seeley
On Fri, Jul 31, 2009 at 3:19 PM, Yao Ge wrote: > Having a large number of fields is not the same as having a large number of > facets. To facets are something you would display to users as aid for query > refinement or navigation. There is no way for a user to use 3700 facets at > the same time. I

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Yao Ge
Having a large number of fields is not the same as having a large number of facets. To facets are something you would display to users as aid for query refinement or navigation. There is no way for a user to use 3700 facets at the same time. So it more of question on how to determine what facets t

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
We are using 1.3.0. Thanks for the suggestion. Will see if I can try one of the ngihtly builds. On Fri, Jul 31, 2009 at 7:49 PM, Erik Hatcher wrote: > What version of Solr? Try a nightly build if you're at Solr 1.3 or > earlier and you'll be amazed at the difference. > >Erik > > > On Ju

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Erik Hatcher
What version of Solr? Try a nightly build if you're at Solr 1.3 or earlier and you'll be amazed at the difference. Erik On Jul 31, 2009, at 10:00 AM, Rahul R wrote: In a production environment, having the caches enabled makes a lot of sense. And most definitely we will be enabling

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
In a production environment, having the caches enabled makes a lot of sense. And most definitely we will be enabling them. However, the primary idea of this exercise is to verify if limiting the number of facets will actually improve the performance. An update on this. I did verify and looks like

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Erik Hatcher
On Jul 31, 2009, at 7:17 AM, Rahul R wrote: Erik, I understand that caching is going to improve performance. Infact we did a PSR run with caches enabled and we got awesome results. But these wouldn't be really representative because the PSR scripts will be doing the same searches again an

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Rahul R
Erik, I understand that caching is going to improve performance. Infact we did a PSR run with caches enabled and we got awesome results. But these wouldn't be really representative because the PSR scripts will be doing the same searches again and again. These would be cached and there would be virt

Re: Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-31 Thread Erik Hatcher
On Jul 31, 2009, at 2:35 AM, Rahul R wrote: Hello, We are trying to get Solr to work for a really huge parts database. Details of the database - 55 million parts - Totally 3700 properties (facets). But each record will not have value for all properties. - Most of these facets are defined

Limiting facets for huge data - setting indexed=false in schema.xml

2009-07-30 Thread Rahul R
Hello, We are trying to get Solr to work for a really huge parts database. Details of the database - 55 million parts - Totally 3700 properties (facets). But each record will not have value for all properties. - Most of these facets are defined as dynamic fields within the Solr Index We were getti