Re: how to balance index and search

2007-03-18 Thread James liu
2007/3/19, Chris Hostetter <[EMAIL PROTECTED]>: : I just wana know CNET.com's index and search architecture if it can be : public. : Many people who use solr or wanna use,,they all wanna know and learn. I'm not sure what to tell you: Solr *is* our search arch. Below information that i wann

Re: how to balance index and search

2007-03-18 Thread James liu
2007/3/19, Chris Hostetter <[EMAIL PROTECTED]>: : I think it have problem that we use win2003 and i remember replication The scripts thta come with Solr don't work on windows becaues they rely on hardlinks to efficinelty copy only things that have changed -- but the principle of indexing on on

Re: how to balance index and search

2007-03-18 Thread Chris Hostetter
: I just wana know CNET.com's index and search architecture if it can be : public. : Many people who use solr or wanna use,,they all wanna know and learn. I'm not sure what to tell you: Solr *is* our search arch. We have a dozen or so Solr, indexes, all of them use hte master/slave model -- but

Re: how to balance index and search

2007-03-18 Thread Chris Hostetter
: I think it have problem that we use win2003 and i remember replication The scripts thta come with Solr don't work on windows becaues they rely on hardlinks to efficinelty copy only things that have changed -- but the principle of indexing on one server, creating "snapshots" (which could be true

Re: how to balance index and search

2007-03-18 Thread James liu
2007/3/17, Chris Hostetter <[EMAIL PROTECTED]>: : Can people from cnet tell how to use solr in CNET.COM ? I really don't understand your question, here's some links to CNET.com that use Solr... http://www.cnet.com/4244-5_1-0.html?query=ipod http://search.news.com/search?q=apple http://reviews

Re: how to balance index and search

2007-03-18 Thread James liu
HTML on the client side before sending it to Solr. Spider crawl html data into MS sql server. I just get data from SQL Server and curl it to solr. Tomorrow i will test under this option . : I find index html will make tomcat obtain cpu 100% . It make seach become : slow. : : So how to balanc

Re: how to balance index and search

2007-03-16 Thread Chris Hostetter
: Can people from cnet tell how to use solr in CNET.COM ? I really don't understand your question, here's some links to CNET.com that use Solr... http://www.cnet.com/4244-5_1-0.html?query=ipod http://search.news.com/search?q=apple http://reviews.cnet.com/4566-3121-0.html -Hoss

Re: how to balance index and search

2007-03-16 Thread Chris Hostetter
x27;s probably because the HTML Analyzers have to do a lot of compelx stuff to strip out hte HTML ... another option might be to parse that HTML on the client side before sending it to Solr. : I find index html will make tomcat obtain cpu 100% . It make seach become : slow. : : So how to balance inde

Re: how to balance index and search

2007-03-15 Thread James liu
Can people from cnet tell how to use solr in CNET.COM ? 2007/3/16, James liu <[EMAIL PROTECTED]>: I find index html will make tomcat obtain cpu 100% . It make seach become slow. So how to balance index and search. web i use apache+php solr i use tomcat 6+java1.6 Any suguessti

how to balance index and search

2007-03-15 Thread James liu
I find index html will make tomcat obtain cpu 100% . It make seach become slow. So how to balance index and search. web i use apache+php solr i use tomcat 6+java1.6 Any suguesstion i m waiting. -- regards jl