Re: Solr vs ElasticSearch

2011-07-26 Thread Peter
Have a look: http://stackoverflow.com/questions/2271600/elasticsearch-sphinx-lucene-solr-xapian-which-fits-for-which-usage http://karussell.wordpress.com/2011/05/12/elasticsearch-vs-solr-lucene/ Regards, Peter. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-vs

Fundamental questions of how to build up solr for huge portals

2010-01-16 Thread Peter
ays (performace, accesibility, way of good programming, using the whole features of lucene - like tagging, facetting and so on...) We are thankful of every suggestions :) Thanks, Peter

Re: Solr High Availability

2015-12-16 Thread Peter Tan
, correct? On Tue, Dec 15, 2015 at 10:09 PM, Jack Krupansky wrote: > There is no HA with a single replica for each shard. Replication factor > must be at least 2 for HA. > > -- Jack Krupansky > > On Wed, Dec 16, 2015 at 12:38 AM, Peter Tan wrote: > > > Hi Jack, What hap

Re: Solr High Availability

2015-12-16 Thread Peter Tan
ookeeper nodes, then yes, you should > have HA. > > Upayavira > > On Wed, Dec 16, 2015, at 05:48 PM, Peter Tan wrote: > > Hi Jack, > > > > Appreciate you helping me to clear this up. > > > > For replicationFactor = 1, that means only keeping one copy of

Solr Timeouts during query aggregation

2015-12-23 Thread Peter Lee
int, since I have not seen any documentation nor configuration settings for this feature, I am ready to take it as truth that Solr does NOT include this functionality. However, I thought I should ask the mailing list to see if I've missed something. Thank you! Peter S. Lee, Software Enginee

File based spell check with weights

2016-04-08 Thread Peter Lee
first time Apache makes the slightest change to the structure of the spell check index. If anyone has any insights to offer I'd appreciate it. Thanks. Peter S. Lee

Re: Basic auth

2015-07-22 Thread Peter Sturge
izing Solr to receive credentials and use them for authentication to remote instances - SOLR-1861 is an old implementation for a previous release, and there has been some significant refactoring of SearchHandler since then, but the concept works well for distributed queries. Thanks, Peter On Wed, Ju

Re: Basic auth

2015-07-22 Thread Peter Sturge
Try adding the "start" call in your jetty.xml: Realm Name /etc/realm.properties 5 On Wed, Jul 22, 2015 at 2:53 PM, O. Klein wrote: > Yeah I can't get it to work on Jetty 9 either on Linux. > > Just trying to password protect the admin pages. > >

Re: Basic Auth (again)

2015-07-23 Thread Peter Sturge
nt in webdefault.xml - this tells jetty which apps are using which realms: A web application name /* default-role Your realm.properties should then have user account entries for the role similar to: admin: some-cred, default-role Hope this helps, Peter O

Re: Basic Auth (again)

2015-07-23 Thread Peter Sturge
ies file as described in: http://www.eclipse.org/jetty/documentation/9.2.7.v20150116/configuring-logging.html . A 404 would suggest that Solr hasn't loaded, possibly due to missing mappings in the xml. You can run netstat -a on your Windows box to see if Solr is listening on port 8983. Thanks, P

Collapsing Query Parser returns one record per shard...was not expecting this...

2015-08-03 Thread Peter Lee
>From my reading of the solr docs (e.g. >https://cwiki.apache.org/confluence/display/solr/Collapse+and+Expand+Results >and https://cwiki.apache.org/confluence/display/solr/Result+Grouping), I've >been under the impression that these two methods (result grouping and >collapsing query parser) can

RE: Collapsing Query Parser returns one record per shard...was not expecting this...

2015-08-04 Thread Peter Lee
he same shard. The typical approach for this is to use > composite Id routing to ensure that documents with the same collapse > field land on the same shard. > > We should make this clear in the documentation. > > Joel Bernstein > http://joelsolr.blogspot.com/ > > On Mon,

Grouping facets: Possible to get facet results for each Group?

2015-10-11 Thread Peter Sturge
e values for 'users' are in which group. If the number of doc hits is very large (can easily be in the 100's of thousands) it's not practical to iterate through the docs looking for unique values. This Use Case necessitates the unique values within each group, rather than the total doc hits. Is this possible with grouping, or inconjunction with another module? Many thanks, +Peter

Fwd: Grouping facets: Possible to get facet results for each Group?

2015-10-12 Thread Peter Sturge
e values for 'users' are in which group. If the number of doc hits is very large (can easily be in the 100's of thousands) it's not practical to iterate through the docs looking for unique values. This Use Case necessitates the unique values within each group, rather than the total doc hits. Is this possible with grouping, or inconjunction with another module? Many thanks, +Peter

Re: Grouping facets: Possible to get facet results for each Group?

2015-10-13 Thread Peter Sturge
Hi, Thanks for your response. I did have a look at pivots, and they could work in a way. We're still on Solr 4.3, so I'll have to wait for sub-facets - but they sure look pretty cool! Peter On Tue, Oct 13, 2015 at 12:30 PM, Alessandro Benedetti < benedetti.ale...@gmail.com> w

Re: Grouping facets: Possible to get facet results for each Group?

2015-10-14 Thread Peter Sturge
ould be an impediment to nested facets, but I don't know enough about them to know for sure. Thanks, Peter On Wed, Oct 14, 2015 at 9:44 AM, Alessandro Benedetti < benedetti.ale...@gmail.com> wrote: > mmm let's say that nested facets are a subset of Pivot Facets. > if pivot face

Re: Grouping facets: Possible to get facet results for each Group?

2015-10-15 Thread Peter Sturge
Great - can't wait to try this out! Many thanks for your help on pointing me towards this new faceting feature. Thanks, Peter On Thu, Oct 15, 2015 at 10:04 AM, Alessandro Benedetti < benedetti.ale...@gmail.com> wrote: > It will not be an impediment, if you have a flat docume

Re: Solr High Availability

2015-12-15 Thread Peter Tan
Hi Jack, What happens when there is only one replica setup? On Tue, Dec 15, 2015 at 9:32 PM, Jack Krupansky wrote: > Solr Cloud provides HA when you configure at least two replicas for each > shard and have at least 3 zookeepers. That's it. No deck or detail document > is needed. > > > > -- Jack

File paths in Zookeeper managed config files

2015-06-10 Thread Peter Scholze
eads obviously to Invalid path string \"/configs/newspapers//netapp/dokubase/seeval/dicts/stopwords/stopwords_de.txt\" caused by empty node name specified @20" Is there any way to prevent Zookeeper from doing so? Thanks in advance, best regards Peter

Streaming Expressions (/stream) StreamHandler java.lang.NullPointerException

2016-06-25 Thread Peter Sh
I've got an exception below running curl --data-urlencode 'expr=search(EventsAndDCF,q="*:*",fl="AccessPath",sort="AccessPath asc",qt="/export")' "http://localhost:8983/solr/EventsAndDCF/stream"; Solr responce: {"result-set":{"docs":[ {"EXCEPTION":null,"EOF":true}]}} My collection EventsAndDCF exi

DIH problem with multiple (types of) resources

2016-11-14 Thread Peter Blokland
seems solr tries to use the datasource named "web" (the BinURLDataSource) instead of the configured "db" datasource (the JdbcDataSource). am I doing something wrong, or is this a bug ? -- CUL8R, Peter. www.desk.nl Your excuse is: Communist revolutionaries taking over the ser

Re: DIH problem with multiple (types of) resources

2016-11-15 Thread Peter Blokland
t seem to matter, but now it certainly does. thx :) -- CUL8R, Peter. www.desk.nl Your excuse is: It is a layer 8 problem

Re: Multiple rollups/facets in one streaming aggregation?

2017-07-30 Thread Peter Shmukler
I need to improve user experience on facets calculation. Let’s assume we’ve got a time partitioned collections. Partition1, Partition2, Partition3 ….. AliasAllPartitions unify all partitions together. Running facets on AliasAllPartitions is very heavy synchronous operation, user have to wait a lot

generate field name in query

2017-08-02 Thread Peter Kirk
document has a field "price_owner_float" then use that, otherwise use the field "price_customer_float"). This gives a syntax error: fq=if(exists(price_owner_float),price_owner_float,price_customer_float):[100 TO 200] Thanks, Peter

Re: MongoDb vs Solr

2017-08-05 Thread Peter Sturge
like Solr, it's easier to accidentally 'let it run free'. If you're using Solr for db rather than search, you will need a secure front-end. Joy and good will to all, regardless of what tool you choose! Peter On Sat, Aug 5, 2017 at 5:08 PM, Walter Underwood wrote: > I read t

RE: SolrCloud - leader updates not updating followers

2017-08-08 Thread Peter Lancaster
hen I ingest data I don't see data appearing on the follower in the log. It really seems like the data isn't being sent from the leader. As I said it could easily be something stupid that I've done along the way but I can't see what it is. Thanks again, Peter. -Original

RE: Solr 6 and IDF

2017-08-08 Thread Peter Lancaster
s far as I know you've been able to have different similarities per field in solr for a while now. https://wiki.apache.org/solr/SchemaXml#Similarity Cheers, Peter Lancaster. -Original Message- From: Webster Homer [mailto:webster.ho...@sial.com] Sent: 08 August 2017 20:39 To:

Building Solr index from AEM using and ELB

2017-08-09 Thread Wahlgren Peter
I am looking for lessons learned or problems seen when building a Solr index from AEM using a Solr cluster with content passing through an ELB. Our configuration is AEM 6.1 indexing to a cluster of Solr servers running version 4.7.1. When building an index with a smaller data set - 4 million it

if exists in an fq

2017-09-13 Thread Peter Kirk
quot;field2" then use "field2:[1 TO 100]; but if there is no "field2", then use "field3:[1 TO 100]. Something like: ?q=*:*&fq=if(exists(field1),field1:[1 TO 100],if(exists(field2),field2:[1 TO 100], field3:[1 TO 100])) But is this does not work. Is it even possible? Thanks, Peter

RE: Phrase suggester - field limit and order

2017-11-09 Thread Peter Lancaster
heers, Peter. -Original Message- From: ruby [mailto:rshoss...@gmail.com] Sent: 09 November 2017 19:29 To: solr-user@lucene.apache.org Subject: Phrase suggester - field limit and order I'm using the BlendedInfixLookupFactory to get phrase suggestions. It returns the entire field content.

RE: Search suggester - threshold parameter

2017-11-17 Thread Peter Lancaster
Hi Ruby, The documentation says that threshold is available for the HighFrequencyDictionaryFactory implementation. Since you're using DocumentDictionaryFactory I guess it will be ignored. Cheers, Peter. -Original Message- From: ruby [mailto:rshoss...@gmail.com] Sent: 17 November

Re: Java profiler?

2017-12-06 Thread Peter Sturge
Hi, We'be been using JPRofiler (www.ej-technologies.com) for years now. Without a doubt, the most comprehensive and useful profiler for java. Works very well, supports remote profiling and includes some very neat heap walking/gc profiling. Peter On Tue, Dec 5, 2017 at 3:21 PM, Walter Unde

Query/Field Index Analysis corrected but return no docs in search

2017-02-04 Thread Peter Liu
hi all: I was using solr 3.6 and tried to solve a recall-problem today , but encountered a weird problem. There's doc with field value : 均匀肤色, (just treated that word as a symbol if you don't know it, I just want to describe the problem as exact as possible). And below was the analysis

Re: Configurable collectors for custom ranking

2014-03-07 Thread Peter Keegan
Hi Joel, Although I solved this issue with a custom CollectorFactory, I also have a solution that uses a PostFilter and and optional ValueSource. Could you take a look at SOLR-5831 and see if I've got this right? Thanks, Peter On Mon, Dec 23, 2013 at 6:37 PM, Joel Bernstein wrote: &g

solr-user@lucene.apache.org

2014-04-08 Thread Peter Kirk
D%20\(E%20%26amp%3B%20F\) (where I try to escape the special characters) does not find the products in this category, and actually finds other unrelated categories. What am I doing wrong? Thanks, Peter

solr-user@lucene.apache.org

2014-04-08 Thread Peter Kirk
gs - could be an idea to strip out the "special characters". I'm working on the search side of things. /Peter -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 8. april 2014 16:15 To: solr-user@lucene.apache.org; Ahmet Arslan Subject: Re: Solr sp

Distributed commits in CloudSolrServer

2014-04-15 Thread Peter Keegan
there a way to change this behavior? 2. If instead, the commits were done in parallel by a separate client via a GET to each Solr instance, how would this client get the host/port values for each Solr instance from zookeeper? Are there any downsides to doing commits this way? Thanks, Peter

Re: Distributed commits in CloudSolrServer

2014-04-16 Thread Peter Keegan
Are distributed commits also done in parallel across shards? Peter On Tue, Apr 15, 2014 at 3:50 PM, Mark Miller wrote: > Inline responses below. > -- > Mark Miller > about.me/markrmiller > > On April 15, 2014 at 2:12:31 PM, Peter Keegan (peterlkee...@gmail.com) > wrote: &

Re: Distributed commits in CloudSolrServer

2014-04-16 Thread Peter Keegan
>Are distributed commits also done in parallel across shards? I meant 'sequentially' across shards. On Wed, Apr 16, 2014 at 9:08 AM, Peter Keegan wrote: > Are distributed commits also done in parallel across shards? > > Peter > > > On Tue, Apr 15, 2014 at 3:50 PM,

DataImportHandler atomic updates

2014-05-16 Thread Peter Pišljar
Hello, i am trying to import data from my db into solr. in db i have two tables - orders [order_id, user_id, created_at, store] - order_items [order_id, item_id] (one - to - many relation ) i would like to import this into my solr collection - orders [user_id (unique), item_id (multivalue) ] i s

Autoscaling Solr instances in AWS

2014-05-20 Thread Peter Keegan
se where a timeout value needs to be increased somewhere? If so, which one? Thanks, Peter

Custom QueryComponent to rewrite dismax query

2014-06-10 Thread Peter Keegan
removing the extra ResultContext a reasonable solution to this problem? It just seems a little brittle to me. Thanks, Peter

Question about solrcloud recovery process

2014-07-03 Thread Peter Keegan
the replication begins, while the index files are being copied, I am able to query the index on the replica and see q=*:* find all of the documents. But, from the core admin screen, numDocs = 0, and in the cloud screen the replica is in 'recovering' mode. How can this be? Peter

Re: Question about solrcloud recovery process

2014-07-03 Thread Peter Keegan
index copy, which doesn't seem right. I'll have to figure out why it does this before the replica is really active. Peter On Thu, Jul 3, 2014 at 9:36 AM, Mark Miller wrote: > I don’t know offhand about the num docs issue - are you doing NRT? > > As far as being able to query the

Re: Question about solrcloud recovery process

2014-07-03 Thread Peter Keegan
see if the logical shard is active, not the specific 'this' replica, which is in 'recovering' state. I'll post a patch once I figure out the zookeeper api. Thanks, Peter On Thu, Jul 3, 2014 at 12:03 PM, wrdrvr wrote: > Try querying the recovering core with distrib=false, y

Question about ReRankQuery

2014-07-23 Thread Peter Keegan
teria is 'score desc, myfield asc', I would expect 'myfield' to break score ties from the second pass after rescoring. Is this a bug or the intended behavior? Thanks, Peter

Re: Question about ReRankQuery

2014-07-23 Thread Peter Keegan
n > AND > and using the original sort? > > At the end, you have your original list in it's original order, with > (potentially) some > documents removed that don't satisfy the secondary query. > > Or I'm missing the boat entirely. > > Best, > Erick >

Re: Question about ReRankQuery

2014-07-23 Thread Peter Keegan
oking to reimplement the ScaleScoreQParser PostFilter plugin with RankQuery, and would need to implement the behavior of the DelegateCollector there for handling multiple sort fields. Peter On Wednesday, July 23, 2014, Joel Bernstein wrote: > The ReRankingQParserPlugin uses the Lucene QueryRescorer,

ExternalFileFieldReloader and commit

2014-08-05 Thread Peter Keegan
ticed this? It seems like a bug to me. (yes, I do have firstSearcher and newSearcher event listeners in solrconfig.xml) Peter

Re: ExternalFileFieldReloader and commit

2014-08-06 Thread Peter Keegan
I entered SOLR-6326 <https://issues.apache.org/jira/browse/SOLR-6326> thanks, Peter On Tue, Aug 5, 2014 at 6:50 PM, Koji Sekiguchi wrote: > Hi Peter, > > It seems like a bug to me, too. Please file a JIRA ticket if you can > so that someone can take it. > > Koji > -

Re: ExternalFileFieldReloader and commit

2014-08-06 Thread Peter Keegan
update a dummy document during each commit interval to force a new searcher. Thanks, Peter On Wed, Aug 6, 2014 at 8:43 AM, Mikhail Khludnev wrote: > Peter, > > Providing SOLR-6326 is about a bug in ExternalFileFieldReloader, I'm asking > here: >

Re: Solr 4.4.0 on Ubuntu 10.04 with Jetty 6.1 from package Repository

2013-10-14 Thread Peter Schmidt
> > Guido. > > > On 11/10/13 15:48, Peter Schmidt wrote: > >> no it is 64bit and just a development VM. In production the solr will use >> multicore, also 64bit and some gb ram. >> >> >> 2013/10/11 Guido Medina >> >> If your single core i

Re: Solr 4.4.0 on Ubuntu 10.04 with Jetty 6.1 from package Repository

2013-10-14 Thread Peter Schmidt
It is necessary to configure the update-alternatives for Oracle Java JDK 7. Afterwards i can use the -server flag 2013/10/14 Peter Schmidt > I downloaded the Linux 64bit version jdk-7u40-linux-x64.tar.gz > > > 2013/10/11 Guido Medina > >> Then I think you downloaded th

Re: Solr 4.4.0 on Ubuntu 10.04 with Jetty 6.1 from package Repository

2013-10-14 Thread Peter Schmidt
But the flag is not listed under the Dashboard->Args in Solr Admin Interface. 2013/10/14 Peter Schmidt > It is necessary to configure the update-alternatives for Oracle Java JDK > 7. Afterwards i can use the -server flag > > > 2013/10/14 Peter Schmidt > >> I downloa

Re: Solr 4.4.0 on Ubuntu 10.04 with Jetty 6.1 from package Repository

2013-10-14 Thread Peter Schmidt
But it's used, it's in the JAVA_OPTIONS listet by service jetty check 2013/10/14 Peter Schmidt > But the flag is not listed under the Dashboard->Args in Solr Admin > Interface. > > > 2013/10/14 Peter Schmidt > >> It is necessary to configure the update-

Re: limiting deep pagination

2013-10-17 Thread Peter Keegan
arihinde Michael Sokolov < > msoko...@safaribooksonline.com> adlı kullanıcı şöyle yazdı: > > On 10/8/13 6:51 PM, Peter Keegan wrote: > >> > >> Is there a way to configure Solr 'defaults/appends/invariants' such that > >> the product of the 'st

Re: Solr timeout after reboot

2013-10-21 Thread Peter Keegan
Have you tried this old trick to warm the FS cache? cat ...//data/index/* >/dev/null Peter On Mon, Oct 21, 2013 at 5:31 AM, michael.boom wrote: > Thank you, Otis! > > I've integrated the SPM on my Solr instances and now I have access to > monitoring data. > Could yo

Re: Solr timeout after reboot

2013-10-21 Thread Peter Keegan
I found this warming to be especially necessary after starting an instance of those m3.xlarge servers, else the response times for the first minutes was terrible. Peter On Mon, Oct 21, 2013 at 8:39 AM, François Schiettecatte < fschietteca...@gmail.com> wrote: > To put the file data

fq with { or } in Solr 4.3.1

2013-10-23 Thread Peter Kirk
line 1, column 58. Was expecting one of: "TO" ... ... ... Can I not use { or } in an fq? Thanks, Peter

RE: fq with { or } in Solr 4.3.1

2013-10-23 Thread Peter Kirk
Sorry, that was just a typo. / search?q=*:*&fq=catid:{123} Gives me the error. I think that { and } must be used in ranges for fq, and that's why I can't use them directly like this. /Peter -Original Message- From: Upayavira [mailto:u...@odoko.co.uk] Sent: 23. okto

SV: fq with { or } in Solr 4.3.1

2013-10-23 Thread Peter Kirk
ash or enclose the entire term in quotes: catid:\{123\} catid:"{123}" -- Jack Krupansky -Original Message- From: Peter Kirk Sent: Wednesday, October 23, 2013 4:57 AM To: solr-user@lucene.apache.org Subject: RE: fq with { or } in Solr 4.3.1 Sorry, that was just a typo. / s

How to reinitialize a solrcloud replica

2013-10-25 Thread Peter Keegan
down live:true (repeats every minute) Is it valid to simply delete the 'data' directory, or does a znode have to be modified, too? What's the right way to reinitialize and re-synch a core? Peter

Re: How to get similarity score between 0 and 1 not relative score

2013-11-01 Thread Peter Keegan
using the scale function seems to work, but you have to use fq to eliminate results with score=0. It seems this is somewhat expensive, since the scaling can't be done until all results have been collected to get the max score. Then, are the results resorted? I haven't looked closely, yet.

Re: Data Import Handler

2013-11-06 Thread Peter Keegan
I've done this by adding an attribute to the entity element (e.g. myconfig="myconfig.xml"), and reading it in the 'init' method with context.getResolvedEntityAttribute("myconfig"). Peter On Wed, Nov 6, 2013 at 8:25 AM, Ramesh wrote: > Hi Folks, > >

Function query matching

2013-11-07 Thread Peter Keegan
Why does this function query return docs that don't match the embedded query? select?qq=text:news&q={!func}sum(query($qq),0)

Re: Function query matching

2013-11-07 Thread Peter Keegan
7, 2013, at 7:26 AM, Erik Hatcher wrote: > > > Function queries score (all) documents, but don't filter them. All > documents effectively match a function query. > > > > Erik > > > > On Nov 7, 2013, at 1:48 PM, Peter Keegan wrote: > > > >> Why does this function query return docs that don't match the embedded > >> query? > >> select?qq=text:news&q={!func}sum(query($qq),0) > > > >

Re: Function query matching

2013-11-11 Thread Peter Keegan
func}sum(product(0.75,$scaledQ),product(0.25,field(myfield)))&fq=$qq What is the proper syntax? Thanks, Peter On Thu, Nov 7, 2013 at 2:16 PM, Peter Keegan wrote: > I'm trying to used a normalized score in a query as I described in a > recent thread titled "Re: How to get

Re: Function query matching

2013-11-11 Thread Peter Keegan
Thanks On Mon, Nov 11, 2013 at 11:46 AM, Yonik Seeley wrote: > On Mon, Nov 11, 2013 at 11:39 AM, Peter Keegan > wrote: > > fq=$qq > > > > What is the proper syntax? > > fq={!query v=$qq} > > -Yonik > http://heliosearch.com -- making solr shine >

Re: Function query matching

2013-11-27 Thread Peter Keegan
field(myfield)))&fq={!query v=$qq} Is there any way to speed this up? Would writing a custom function query that compiled all the function queries together be any faster? Thanks, Peter On Mon, Nov 11, 2013 at 1:31 PM, Peter Keegan wrote: > Thanks > > > On Mon, Nov 11, 2013 at

Re: Function query matching

2013-11-27 Thread Peter Keegan
anQuery$BooleanWeight cannot be cast to org.apache.lucene.queries.function.valuesource.ScaleFloatFunction$ScaleInfo thanks, peter On Wed, Nov 27, 2013 at 1:30 PM, Chris Hostetter wrote: > > : So, this query does just what I want, but it's typically 3 times slower > : than the ed

Re: Function query matching

2013-11-29 Thread Peter Keegan
Instead of using a function query, could I use the edismax query (plus some low cost filters not shown in the example) and implement the scale/sum/product computation in a PostFilter? Is the query's maxScore available there? Thanks, Peter On Wed, Nov 27, 2013 at 1:58 PM, Peter Keegan

Re: Function query matching

2013-12-02 Thread Peter Keegan
advice? Thanks, Peter On Fri, Nov 29, 2013 at 9:18 AM, Peter Keegan wrote: > Instead of using a function query, could I use the edismax query (plus > some low cost filters not shown in the example) and implement the > scale/sum/product computation in a PostFilter? Is the query'

Re: Function query matching

2013-12-06 Thread Peter Keegan
ad and > thus the invalid case exception occurs. The NoOp multiplication works > because it puts an "different" ValueSource between the query and the > ScaleFloatFunction such that this.source (in ScaleFloatFunction) != this > (in QueryValueSource). > > This should be

Re: Function query matching

2013-12-06 Thread Peter Keegan
In my previous posting, I said: "Subsequent calls to ScaleFloatFuntion.getValues bypassed 'createScaleInfo and added ~0 time." These subsequent calls are for the remaining segments in the index reader (21 segments). Peter On Fri, Dec 6, 2013 at 2:10 PM, Peter Keegan wr

Configurable collectors for custom ranking

2013-12-06 Thread Peter Keegan
this patch is no longer in dev. Is there any other dev. being done on adding custom sorting (after collection) via a plugin? Thanks, Peter

Re: Function query matching

2013-12-07 Thread Peter Keegan
>But for your specific goal Peter: Yes, if the whole point of a function >you have is to wrap generated a "scaled" score of your base $qq, ... Thanks for the confirmation, Chris. So, to do this efficiently, I think I need to implement a custom Collector that performs the sc

Re: Configurable collectors for custom ranking

2013-12-10 Thread Peter Keegan
g the main dismax query. As you mention, it is a slightly intrusive design and requires that I manage my own PriorityQueue (and a local duplicate of HitQueue), but should work. I think a better design would hide the PQ from the plugin. Thanks, Peter On Sun, Dec 8, 2013 at 5:32 PM, Joel Bernstein wr

Re: Configurable collectors for custom ranking

2013-12-10 Thread Peter Keegan
Quick question: In the context of a custom collector, how does one get the values of a field of type 'ExternalFileField'? Thanks, Peter On Tue, Dec 10, 2013 at 1:18 PM, Peter Keegan wrote: > Hi Joel, > > This is related to another thread on function query matching ( > h

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
x27; needs a QParser, which isn't available. And I can't create a QParser without a SolrQueryRequest, which isn't available. Thanks, Peter On Wed, Dec 11, 2013 at 1:48 PM, Joel Bernstein wrote: > Peter, > > It sounds like you could achieve what you want to do in a PostFi

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
ield eff = (ExternalFileField)field.getType(); fieldValues = eff.getFileFloatSource(field, dataDir); And then read the values in 'setNextReader' Peter On Wed, Dec 11, 2013 at 2:05 PM, Peter Keegan wrote: > Hi Joel, > > I thought about using a PostFilter, but the problem is that the 'scal

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
This is what I was looking for, but the DelegatingCollector 'finish' method doesn't exist in 4.3.0 :( Can this be patched in and are there any other PostFilter dependencies on 4.5? Thanks, Peter On Wed, Dec 11, 2013 at 3:16 PM, Joel Bernstein wrote: > Here is one ap

Re: Configurable collectors for custom ranking

2013-12-11 Thread Peter Keegan
Thanks very much for the guidance. I'd be happy to donate a working solution. Peter On Wed, Dec 11, 2013 at 3:53 PM, Joel Bernstein wrote: > SOLR-5020 has the commit info, it's mainly changes to SolrIndexSearcher I > believe. They might apply to 4.3. > I think as long

Re: Configurable collectors for custom ranking

2013-12-12 Thread Peter Keegan
Regarding my original goal, which is to perform a math function using the scaled score and a field value, and sort on the result, how does this fit in? Must I implement another custom PostFilter with a higher cost than the scale PostFilter? Thanks, Peter On Wed, Dec 11, 2013 at 4:01 PM, Peter

Re: Configurable collectors for custom ranking

2013-12-12 Thread Peter Keegan
es is excellent (will have to see how it compares to your outlined solution). Thanks, Peter On Thu, Dec 12, 2013 at 11:13 AM, Joel Bernstein wrote: > The sorting is going to happen in the lower level collectors. You need a > value source that returns the score of the document being collecte

Re: Configurable collectors for custom ranking

2013-12-19 Thread Peter Keegan
ay to get this precomputed value or do I have to duplicate the logic from SolrIndexSearcher? Thanks, Peter On Thu, Dec 12, 2013 at 1:53 PM, Joel Bernstein wrote: > Thanks, I agree this powerful stuff. One of the reasons that I haven't > gotten back to pluggable collectors is that

Re: Configurable collectors for custom ranking

2013-12-19 Thread Peter Keegan
, Peter On Thu, Dec 19, 2013 at 9:51 AM, Peter Keegan wrote: > In order to size the PriorityQueue, the result window size for the query > is needed. This has been computed in the SolrIndexSearcher and available > in: QueryCommand.getSupersetMaxDoc(), but doesn't seem to be avail

Re: Configurable collectors for custom ranking

2013-12-23 Thread Peter Keegan
es",Map ? Also, what is the reason for passing score=0 for documents that aren't in the PriorityQueue? Will these docs get filtered out before a normal sort by score? Thanks, Peter On Thu, Dec 12, 2013 at 11:13 AM, Joel Bernstein wrote: > The sorting is going to happen in the lowe

Re: Configurable collectors for custom ranking

2013-12-26 Thread Peter Keegan
In my case, the final function call looks something like this: sum(product($k1,score()),product($k2,field(x))) This means that all the scores would have to scaled and passed down, not just the top N because even a low score could be offset by a high value in 'field(x)'. Thanks, Pete

how to include result ordinal in response

2014-01-03 Thread Peter Keegan
Is there a simple way to output the result number (ordinal) with each returned document using the 'fl' parameter? This would be useful when visually comparing the results from 2 queries. Thanks, Peter

Re: how to include result ordinal in response

2014-01-04 Thread Peter Keegan
returned in the same order as specified in the 'fl' parameter. Can the order be overridden? Thanks, Peter On Fri, Jan 3, 2014 at 6:58 PM, Jack Krupansky wrote: > Or just use the internal document ID: fl=*,[docid] > > Granted, the docID may change if a segment merge

Re: Function query matching

2014-01-06 Thread Peter Keegan
: The bottom line for Peter is still the same: using scale() wrapped arround : a function/query does involve a computing hte results for every document, : and that is going to scale linearly as the size of hte index grows -- but : it it is *only* because of the scale function. Another problem

Re: Zookeeper as Service

2014-01-09 Thread Peter Keegan
There's also: http://www.tanukisoftware.com/ On Thu, Jan 9, 2014 at 11:18 AM, Nazik Huq wrote: > > > From your email I gather your main concern is starting zookeeper on server > startups. > > You may want to look at these non-native service oriented options too: > Create a script( cmd or bat)

leading wildcard characters

2014-01-10 Thread Peter Keegan
How do you disable leading wildcards in 4.X? The setAllowLeadingWildcard method is there in the parser, but nothing references the getter. Also, the Edismax parser always enables it and provides no way to override. Thanks, Peter

Re: leading wildcard characters

2014-01-10 Thread Peter Keegan
Removing ReversedWildcardFilterFactory had no effect. On Fri, Jan 10, 2014 at 10:48 AM, Ahmet Arslan wrote: > Hi Peter, > > Can you remove any occurrence of ReversedWildcardFilterFactory in > schema.xml? (even if you don't use it) > > Ahmet > > > > On Frid

How to override rollback behavior in DIH

2014-01-14 Thread Peter Keegan
e the default behavior. Is there a way to override the IndexWriter rollback? Thanks, Peter

Re: leading wildcard characters

2014-01-14 Thread Peter Keegan
I created SOLR-5630. Although WildcardQuery is much much faster now with AutomatonQuery, it can still result in slow queries when used in multiple keywords. From my testing, I think I will need to disable all WildcardQuerys and only allow PrefixQuery. Peter On Sat, Jan 11, 2014 at 4:17 AM

Re: How to override rollback behavior in DIH

2014-01-17 Thread Peter Keegan
it a bit harder to detect the failure via the admin interface. Thanks, Peter On Tue, Jan 14, 2014 at 11:12 AM, Peter Keegan wrote: > I have a custom data import handler that creates an ExternalFileField from > a source that is different from the main index. If the import fails (in m

Re: How to override rollback behavior in DIH

2014-01-17 Thread Peter Keegan
also occur in the 'init' call, so exceptions have to be caught there, too. Thanks, Peter On Fri, Jan 17, 2014 at 10:19 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Can you try using onError=skip on your entities which use this data source? > > It'

Re: How to override rollback behavior in DIH

2014-01-17 Thread Peter Keegan
Hmm, this does get a bit complicated, and I'm not even doing any writes with the DIH SolrWriter. In retrospect, using a DIH to create only EFFs doesn't buy much except for the integration into the Solr Admin UI. Thanks for the pointer to 3671, James. Peter On Fri, Jan 17, 2014 a

Getting index schema in SolrCloud mode

2014-02-03 Thread Peter Keegan
I'm indexing data with a SolrJ client via SolrServer. Currently, I parse the schema returned from a HttpGet on: localhost:8983/solr/collection/schema/fields What is the recommended way to read the schema with CloudSolrServer? Can it be done with a single HttpGet to a ZK server? Thanks, Peter

  1   2   3   4   5   6   7   8   9   >