Re: Using solr to store data

2010-02-04 Thread Tim Underwood
We just switched over to storing our data directly in Solr as compressed JSON fields at http://frugalmechanic.com. So far it's working out great. Our detail pages (e.g.: http://frugalmechanic.com/auto-part/817453-33-2084-kn-high-performance-air-filter) now make a single Solr request to grab the p

Re: Using solr to store data

2010-02-03 Thread Tommy Chheng
Hey AJ, For simplicity sake, I am using Solr to serve as storage and search for http://researchwatch.net. The dataset is 110K NSF grants from 1999 to 2009. The faceting is all dynamic fields and I use a catch all to copy all fields to a default text field. All fields are also stored and used f

Re: Using solr to store data

2010-02-03 Thread Lance Norskog
If you're happy with disk sizes and indexing&search performance, there are still holes: Documents update instead of fields, so when you have a million documents that say "German" and should say "French", you have to reindex a million documents. There are no tools for managing distributed indexes,

Using solr to store data

2010-02-03 Thread AJ Asver
Hi all, I work on search at Scoopler.com, a real-time search engine which uses Solr. We current use solr for indexing but then fetch data from our couchdb cluster using the IDs solr returns. We are now considering storing a larger portion of data in Solr's index itself so we don't have to hit th