Re: SolrCloud - Query performance degrades with multiple servers

2012-12-08 Thread Mark Miller
If that's true, we will fix it for 4.1. I can look closer tomorrow. Mark Sent from my iPhone On Dec 9, 2012, at 2:04 AM, sausarkar wrote: > Spoke too early it seems that SolrCloud is still distributing queries to all > the servers even if numShards=1 We are seeing POST request to all servers

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-08 Thread sausarkar
Spoke too early it seems that SolrCloud is still distributing queries to all the servers even if numShards=1 We are seeing POST request to all servers in the cluster, please let me know what is the solution. Here is an example: (the variable isShard should be false in our case as single shard, plea

Re: Modeling openinghours using multipoints

2012-12-08 Thread britske
Brilliant! Got some great ideas for this. Indeed all sorts of usecases which use multiple temporal ranges could benefit.. Eg: Another Guy on stackoverflow asked me about this some days ago.. He wants to model multiple temporary offers per product (free shopping for christmas, 20% discount for

Re: Modeling openinghours using multipoints

2012-12-08 Thread David Smiley (@MITRE.org)
britske wrote > That's seriously awesome! > > Some change in the query though: > You described: "To query for a business that is open during at least some > part of a given time duration" > I want "To query for a business that is open during at least the entire > given time duration". > > Feels l

Re: Which fields matched?

2012-12-08 Thread Paul Libbrecht
We've used lucene-1999 with some success in ActiveMath to find the language that was matched. paul Le 8 déc. 2012 à 10:09, Mikhail Khludnev a écrit : > Jeff, > explain() algorithm is definitely too slow to be used at search time. There > is an approach which I'm aware of - watch for scorers du

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
No problem! Here is the JIRA issue: https://issues.apache.org/jira/browse/SOLR-4158 - Mark On Sat, Dec 8, 2012 at 6:03 PM, Alain Rogister wrote: > Great, thanks Mark ! I'll test the fix and post my results. > > Alain > > On Saturday, December 8, 2012, Mark Miller wrote: > >> After some more pla

Re: star searches with high page number requests taking long times

2012-12-08 Thread Walter Underwood
I put in a 50 page limit when I was at Netflix. --wunder On Dec 8, 2012, at 2:26 PM, Petersen, Robert wrote: > We have a limit in place to restrict searches to the first ten thousand > pages. I am going to try to get that number reduced! I'm thinking even as > low as page fifty should be the

Re: Is there a way to round data when index, but still able to return original content?

2012-12-08 Thread Erick Erickson
Depends on whether the transformation is before or after the doc gets sent to Solr. If you're changing the data before you give it to Solr, then you'd have to have two fields, probably indexed=true and stored=false for the one you search on, and indexed=false stored=true for the one you return to t

Re: stress testing Solr 4.x

2012-12-08 Thread Alain Rogister
Great, thanks Mark ! I'll test the fix and post my results. Alain On Saturday, December 8, 2012, Mark Miller wrote: > After some more playing around on 5x I have duplicated the issue. I'll > file a JIRA issue for you and fix it shortly. > > - Mark > > On Dec 8, 2012, at 8:43 AM, Mark Miller wro

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
After some more playing around on 5x I have duplicated the issue. I'll file a JIRA issue for you and fix it shortly. - Mark On Dec 8, 2012, at 8:43 AM, Mark Miller wrote: > Hmm…I've tried to replicate what looked like a bug from your report (3 Solr > servers stop/start ), but on 5x it works n

Re: star searches with high page number requests taking long times

2012-12-08 Thread Petersen, Robert
We have a limit in place to restrict searches to the first ten thousand pages. I am going to try to get that number reduced! I'm thinking even as low as page fifty should be the limit. What human (with a wallet) would even go as deep as fifty pages? :) Sent from my iGizmo On Dec 8, 2012, at

Re: Posting html with wget

2012-12-08 Thread Jack Krupansky
The Simple Post Tool that comes with Solr can now do that in Solr 4.0 See: https://issues.apache.org/jira/browse/SOLR-3691 -- Jack Krupansky -Original Message- From: CalinH Sent: Saturday, December 08, 2012 2:40 PM To: solr-user@lucene.apache.org Subject: Posting html with wget How c

Posting html with wget

2012-12-08 Thread CalinH
How can I post html web pages to Solr when downloading with wget? How might I modify the following example so that saving and indexing happen simultaneously? wget -P /var/myserver/archive http://www.somesite/products.html I can't spot an obvious example in the documentation and would be grateful

Re: Modeling openinghours using multipoints

2012-12-08 Thread David Smiley (@MITRE.org)
Hello again Geert-Jan! What you're trying to do is indeed possible with Solr 4 out of the box. Other terminology people use for this is multi-value time duration. This creative solution is a pure application of spatial without the geospatial notion -- we're not using an earth or other sphere mod

Re: star searches with high page number requests taking long times

2012-12-08 Thread Otis Gospodnetic
It is common practise not to allow drilling deep in search results. Otis -- SOLR Performance Monitoring - http://sematext.com/spm On Dec 8, 2012 10:27 AM, "Jack Krupansky" wrote: > What exactly is the common practice - is there a free, downloadable search > component that does that or at least a

Re: Which fields matched?

2012-12-08 Thread Mikhail Khludnev
Jeff, explain() algorithm is definitely too slow to be used at search time. There is an approach which I'm aware of - watch for scorers during the search time. If scorer matches some doc _at some moment_ scorer.docID()==docNum. My team successfully implemented such Match Spotting algorithm, it perf

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
Hmm…I've tried to replicate what looked like a bug from your report (3 Solr servers stop/start ), but on 5x it works no problem for me. It shouldn't be any different on 4x, but I'll try that next. In terms of starting up Solr without a working ZooKeeper ensemble - it won't work currently. Cores

Re: Attention Solr 4.0 SolrCloud users

2012-12-08 Thread Jamie Johnson
Yes, been off the radar for some time, a testimant to just how well SolrCloud works even in it's alpha state! Glad to hear that it should be soon, we are hoping to move to a stable version of Solr for our next release at the end of February, so anything in January should give us enough time to rea

Modeling openinghours using multipoints

2012-12-08 Thread britske
Hi all, Over a year ago I posted a usecase to, the in this context familiar, issue SOLR-2155 of modelling openinghours using multivalued points. https://issues.apache.org/jira/browse/SOLR-2155?focusedCommentId=13114839&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#commen

Re: star searches with high page number requests taking long times

2012-12-08 Thread Jack Krupansky
What exactly is the common practice - is there a free, downloadable search component that does that or at least a "blueprint" for "recommended best practice"? What limit is common? (I know Google limits you to the top 1,000 results.) -- Jack Krupansky -Original Message- From: Otis Go

Re: Attention Solr 4.0 SolrCloud users

2012-12-08 Thread Mark Miller
Hey Jamie - long time, no see. On Dec 8, 2012, at 5:19 AM, Jamie Johnson wrote: > thanks for the info. we were looking to move to a stable release soon (we > are on an old nightly build from April!). Has this issue existed since > then? It was introduced shortly before 4.0 was released, so

Re: Attention Solr 4.0 SolrCloud users

2012-12-08 Thread Jamie Johnson
thanks for the info. we were looking to move to a stable release soon (we are on an old nightly build from April!). Has this issue existed since then? Do we have an idea when solr 4.1 will be made available? I am just trying to get an idea if we should wait or not. On Thu, Dec 6, 2012 at 9:11