Re: how many shards required to search data

As you suggestedI have indexed 12million sample records in solr on hardware of 8gb ram. Size of index is 3gb. can i extrapolate this to predict actual size of index.? -- View this message in context: http://lucene.472066.n3.nabble.com/how-many-shards-required-to-search-data-tp4118715p4118753.ht

Re: how many shards required to search data

On 2/21/2014 1:39 AM, search engn dev wrote: > As you suggestedI have indexed 12million sample records in solr on hardware > of 8gb ram. Size of index is 3gb. > can i extrapolate this to predict actual size of index.? If the sizes of those records are about the same size as the records in the syst

RE: Grouping performance improvement

Thanks Alexey for giving some really good points. Just to make sure I get it right Are you suggesting 1. do facets on category first lets say I get 10 distinct category 2. do another query where q=search query and fq= facet category values May be im missing something, however Im not sure how to

& in XML Node Getting Error

Hi, I am getting Error if any of the field in the xml file has & as value. How can I fix this issue FYI I changed & to & in the field but still has issues e.g AT&T or AT&T Above both gives error, DO I need to change something in the configuration. Thanks Ravi

ZK connection problems

I’ve been experimenting with SolrCloud configurations in AWS. One issue I’ve been plagued with is that during indexing, occasionally a node decides it can’t talk to ZK, and this disables updates in the pool. The node usually recovers within a second or two. It’s possible this happens when I’m n

Re: & in XML Node Getting Error

Ravi, What's the error you're getting? Thanks, Greg On Feb 21, 2014, at 11:08 AM, "EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions)" wrote: > Hi, I am getting Error if any of the field in the xml file has & as value. > > How can I fix this issue > > FYI I changed & to & in the fie

RE: & in XML Node Getting Error

I am getting something like ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] com.ctc.wstx.exc.WstxParsingException: Undeclared general entity "nbsp" The filed content is " " or "&" -Original Message- From: Greg Walters [mailto:greg.walt...@answers.com] Sent: Fri

RE: & in XML Node Getting Error

: ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] : com.ctc.wstx.exc.WstxParsingException: Undeclared general entity "nbsp" "nbsp" is not a legal XML entity unless you have an enty declaration that defines it. it sounds like you don't have valid xml -- it sounds like you

Re: & in XML Node Getting Error

On 2/21/2014 10:31 AM, EXTERNAL Taminidi Ravi (ETI, Automotive-Service-Solutions) wrote: I am getting something like ERROR org.apache.solr.core.SolrCore [com.ctc.wstx.excwstxLazyEception] com.ctc.wstx.exc.WstxParsingException: Undeclared general entity "nbsp" The filed content is " " or "&"

Best way to get results ordered

Hi all, we are using SolR 4.4.0 and planning to migrate to 4.6.1 very soon. We are looking for a way to get results ordered in a certain way. For example, we are doing query by ids this way : q=id=A OR id =C OR id=B and we want the results to be sorted as A,C,B. Is there a good way to do this

Re: Best way to get results ordered

Hi Metin, How many IDs are you supplying in a single query? You could probably accomplish this easily with boosts if it were few. Michael Della Bitta Applications Developer o: +1 646 532 3062 appinions inc. "The Science of Influence Marketing" 18 East 41st Street New York, NY 10017 t: @app

RE: Best way to get results ordered

Thank you Michael, this applies from 5 to about 60 contents. We have already tried with boosts, but the results were not sorted well every time. Maybe our boost coefficients were not set properly, but I thought that there will be a "correct" way to do this. Metin OSMAN Canal+ || DTD - VOD 01 7

search across cores

If I want to search across cores, can I use (abuse?) the distributed search? My simple experiment seems to confirm this but I'd like to know if there is any drawbacks other than those of distributed search listed here? https://wiki.apache.org/solr/DistributedSearch#Distributed_Searching_Limitatio

hardcommit setting in solrconfig

Hello, We have following hard commit setting in solrconfig.xml. ${solr.ulog.dir:} ${solr.autoCommit.maxTime:60} 10 true Shouldn't we see DirectUpdateHandler2; start commit and DirectUpdateHandler2; end_commit_flush message in our lo

Re: hardcommit setting in solrconfig

: Shouldn't we see DirectUpdateHandler2; start commit and : DirectUpdateHandler2; end_commit_flush message in our log at least every : ten minutes? I understand that if we have more than 100K documents to : commit, hard commit could happen earlier than 10 minutes. But we see : hard commit spac

Re: search across cores

On 2/21/2014 2:15 PM, T. Kuro Kurosaka wrote: If I want to search across cores, can I use (abuse?) the distributed search? My simple experiment seems to confirm this but I'd like to know if there is any drawbacks other than those of distributed search listed here? https://wiki.apache.org/solr/D

Re: hardcommit setting in solrconfig

On 2/21/2014 2:34 PM, Joshi, Shital wrote: ${solr.ulog.dir:} ${solr.autoCommit.maxTime:60} 10 true Shouldn't we see DirectUpdateHandler2; start commit and DirectUpdateHandler2; end_commit_flush message in our log at least e

RE: Solr4 performance

Thanks for your answer. We confirmed that it is not GC issue. The auto warming query looks good too and queries before and after the long running query comes back really quick. The only thing stands out is shard on which query takes long time has couple million more documents than other shar

Re: Solr4 performance

It could be that your query is churning the page cache on that node sometimes, so Solr pauses so the OS can drag those pages off of disk. Have you tried profiling your iowait in top or iostat during these pauses? (assuming you're using linux). Michael Della Bitta Applications Developer o: +1 646

How long do commits take?

In solr 3.6, strictly using log files (catalina.out), how can I determine how long a commit operation takes? I don’t see a QTime to help me out as in optimize… No doubt, it’s staring me in the face but I can’t figure it out. Thanks in advance, Bill

Re: How long do commits take?

On 2/21/2014 4:26 PM, William Tantzen wrote: In solr 3.6, strictly using log files (catalina.out), how can I determine how long a commit operation takes? I don’t see a QTime to help me out as in optimize… No doubt, it’s staring me in the face but I can’t figure it out. Here's a log entry fr

Re: How long do commits take?

On 2/21/2014 5:15 PM, Shawn Heisey wrote: Here's a log entry from Solr 4.6.1: INFO - 2014-02-21 17:09:04.837; org.apache.solr.update.processor.LogUpdateProcessor; [s1live] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=true} {commit=} 0 4698

Fwd: help on edismax_dynamic fields

Hello, I am using edismax parser in my project. I just wanted to confirm whether we can use dynamic fields with edismax or not. When I am using specific dynamic field in qf or pf parameter , it is working. But when iam using dynamic fields with *, like this: explicit 1