Re: solr payloads performance

2020-05-11 Thread Erik Hatcher
Wei - Here's some details on the various payload capabilities and short-comings: https://lucidworks.com/post/solr-payloads/ SOLR-10541 is the main functional constraint (range faceting over functions). Erik > On May 8, 2020, at 7:26 PM, Wei wrote: > > Hi everyon

Re: solr payloads performance

2020-05-11 Thread Emir Arnautović
tems and > 1000 stores. > > Option 1: use solr payloads, each document have > store_prices_payload:store1|price1 store2|price2 . > store1000|price1000 > > Option 2: use dynamic fields and have 1000 fields in each document, i.e. > field1: store1_pri

solr payloads performance

2020-05-08 Thread Wei
Hi everyone, Have a question regarding typical e-commerce scenario: each item may have different price in different store. suppose there are 10 million items and 1000 stores. Option 1: use solr payloads, each document have store_prices_payload:store1|price1 store2|price2 . store1000

Payloads

2020-04-21 Thread Vincenzo D'Amore
Hi All, still struggling with payloads. Trying to understand better my problem I've created a minimal reproducible example. Basically I have a multivalued field with payloads with this schema configuration: That are popu

mapping and tuning payloads in Solr 8

2020-02-12 Thread Burgmans, Tom
Hi all, In our Solr 6 setup we use string payloads to boost certain tokens (URIs). These strings are mapped to floats via a schema parameter "PayloadMapping", which can be read out in our custom WKSimilarity class (extending TFIDF

Solr Payloads

2019-09-20 Thread John Davis
We are using solr payload field and noticed the values extracted using payload() sometimes don't match the value stored in the field. Is there a lossy encoding for the payload value? fq=payload_field:*, fl=payload_field,payload(payload_field, 573131) "payload_field": "573131|*1568263581*"

Re: Use payloads in facet sorting

2018-05-24 Thread Mikhail Khludnev
s for this query?“. > The keywords should be sorted by the summed score of each keyword in a doc. > > To do this, I’ve tried to use the JSON Facet API to sort by the sum of all > keyword payloads. But I couldn’t find a way to use the payload function > within the facet sorting. > &

Use payloads in facet sorting

2018-05-24 Thread Tobias Kässmann
t;Which are the most relevant keywords for this query?“. The keywords should be sorted by the summed score of each keyword in a doc. To do this, I’ve tried to use the JSON Facet API to sort by the sum of all keyword payloads. But I couldn’t find a way to use the payload function within the facet

String payloads...

2017-11-06 Thread Petersen, Robert (Contr)
Hi Guys, I was playing with payloads example as I had a possible use case of alternate product titles for a product. https://lucidworks.com/2017/09/14/solr-payloads/ bin/solr start bin/solr create -c payloads bin/post -c payloads -type text/csv -out yes -d $'id,vals_dpf\n1,one|1.0 tw

Problem retrieving payloads from a specific term in a boosting function

2016-05-18 Thread Félix Sanjuán
Hi all, I have added a new field to my schema that is of the following type: As a quick example, the value of this field would have values like the following: people: "userid1|1 userid2|56" Basically, a user id and an integ

Re: Filtering documents using payloads

2015-08-07 Thread Jamie Johnson
Looks like my issue is that my nextDoc call is consuming the first position, and then on the call to nextPosition it's moving past where I want it to be. I believe that I have this working properly now by checking if the current position should or shouldn't be incremented. On Thu, Aug 6, 2015 at

Filtering documents using payloads

2015-08-06 Thread Jamie Johnson
I am attempting to put together a DocsAndPositionsEnum that can hide terms given the payload on the term. The idea is that if a term has a particular access control and the user does not I don't want it to be visible. I have based this off of https://github.com/roshanp/lucure-core/blob/master/sr

Re: Scoring, payloads and phrase queries

2015-07-25 Thread Jamie Johnson
sq[i] = new SpanTermQuery(internalTerms[i]); } topLevelSpans[j]= new SpanOrQuery(sq); } PayloadNearQuery pnq = new PayloadNearQuery(topLevelSpans, phrase.getSlop(), true, new PF()); pnq.setBoost(phrase.getBoost()); It looks like to support Payloads in all the query types I would like to supp

Re: Scoring, payloads and phrase queries

2015-07-25 Thread Mikhail Khludnev
Does PayloadNearQuery suite for it? On Fri, Jul 24, 2015 at 5:41 PM, Jamie Johnson wrote: > Is there a way to consider payloads for scoring in phrase queries like > exists in PayloadTermQuery? > -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynami

Re: Scoring, payloads and phrase queries

2015-07-24 Thread Jamie Johnson
to consider payloads for scoring in phrase queries like > exists in PayloadTermQuery? >

Scoring, payloads and phrase queries

2015-07-24 Thread Jamie Johnson
Is there a way to consider payloads for scoring in phrase queries like exists in PayloadTermQuery?

Re: Using payloads and user provided data in score

2015-07-23 Thread Jamie Johnson
Well you've at least confirmed what I was thinking :). I am using payloads now for this and I think I have something very basic working. The results don't get dropped out when the scores are 0 so I had to also write a custom collector that could be plugged into the AnalyticQueryAPI (m

Re: Using payloads and user provided data in score

2015-07-23 Thread Erick Erickson
bq: Your "ugly problem" is my situation I think ;) No, your problem is much worse ;( The _contents_ of fields are restricted, which is horrible. OK, here's another idea out of waaay left field: Payloads. It hinges on there being an OK number of possible combinations which

Re: Using payloads and user provided data in score

2015-07-23 Thread Jamie Johnson
as a value of foo and name_B_txt has a value of foo and the user has authorizations A and B) and possibly bumping up against the maximum clause limit as we expand the query. These reasons were why I thought it best to use payloads to make terms with authorizations a user can't see not impa

Re: Using payloads and user provided data in score

2015-07-22 Thread Erick Erickson
; 2> If you have some kind of date field say that you want to facet >>>> over, you'd have >>>> to control that. >>>> 3> if you have a "bag of words" where you use copyField to add a bunch >>>> of field's >>>> da

Re: Using payloads and user provided data in score

2015-07-22 Thread Jamie Johnson
>>> data to an uber-field then the user can infer some things from that >>> info, so you probably >>> don't want to be careful about what copyFields you use. >>> >>> Best, >>> Erick >>> >>> On Wed, Jul 22, 2015 at 12:21 PM,

Re: Using payloads and user provided data in score

2015-07-22 Thread Jamie Johnson
you use. >> >> Best, >> Erick >> >> On Wed, Jul 22, 2015 at 12:21 PM, Jamie Johnson >> wrote: >> > I am looking for a way to prevent fields that users shouldn't be able to >> > know exist from contributing to the score. The goal is

Re: Using payloads and user provided data in score

2015-07-22 Thread Jamie Johnson
areful about what copyFields you use. > > Best, > Erick > > On Wed, Jul 22, 2015 at 12:21 PM, Jamie Johnson wrote: > > I am looking for a way to prevent fields that users shouldn't be able to > > know exist from contributing to the score. The goal is to provide a w

Re: Using payloads and user provided data in score

2015-07-22 Thread Erick Erickson
ided on the query. I have managed to make terms that users shouldn't > be able to see not impact the score by implementing a custom Similarity > class that looks at the terms payloads and returns 0 for the score if they > shouldn't know the field exists. The issue however is

Using payloads and user provided data in score

2015-07-22 Thread Jamie Johnson
't be able to see not impact the score by implementing a custom Similarity class that looks at the terms payloads and returns 0 for the score if they shouldn't know the field exists. The issue however is that I don't have access to the request at this point so getting the users acc

RE: Delimited payloads input issue

2015-03-11 Thread Markus Jelsma
Thanks David for sharing! The custom attribute approach sounds interesting indeed. Markus -Original message- > From:david.w.smi...@gmail.com > Sent: Tuesday 10th March 2015 16:53 > To: solr-user@lucene.apache.org > Subject: Re: Delimited payloads input issue &g

RE: Delimited payloads input issue

2015-03-06 Thread Markus Jelsma
st be modified to carry the original PayloadAttribute to its descendants. Markus -Original message- > From:Markus Jelsma > Sent: Friday 27th February 2015 17:28 > To: solr-user > Subject: Delimited payloads input issue > > Hi - we attempt to use payloads to iden

Delimited payloads input issue

2015-02-27 Thread Markus Jelsma
Hi - we attempt to use payloads to identify different parts of extracted HTML pages and use the DelimitedPayloadTokenFilter to assign the correct payload to the tokens. However, we are having issues for some language analyzers and issues with some types of content for most regular analyzers

Re: Is there a Field/FieldType property to enable storing of term vector payloads?

2014-03-21 Thread Daniel Jamrog
On Fri, Mar 21, 2014 at 11:18 AM, Doug Turnbull < dturnb...@opensourceconnections.com> wrote: > Daniel, I had a similar issue. The option is not in the normal FieldType, > so I had to create my own FieldType in a Solr plugin that enabled payloads > in term vectors. This mostly invo

Re: Is there a Field/FieldType property to enable storing of term vector payloads?

2014-03-21 Thread Doug Turnbull
Daniel, I had a similar issue. The option is not in the normal FieldType, so I had to create my own FieldType in a Solr plugin that enabled payloads in term vectors. This mostly involved extending TextField, copy pasting "createField" from FieldType (TextField's parent class) and

Is there a Field/FieldType property to enable storing of term vector payloads?

2014-03-21 Thread Daniel Jamrog
I see properties to enable term vectors, positions and offsets, but didn't find one for payloads? Did I just miss it? If not, is this something that may be added in the future? Thanks

Indexing useful N-grams and adding payloads

2014-03-10 Thread Manuel Le Normand
Hi, I have a performance and scoring problem for phrase queries 1. Performance - phrase queries involving frequent terms are very slow due to the reading of large positions posting list. 2. Scoring - I want to control the boost of phrase and entity (in gazetteers) matches Indexing all

Using payloads for expanded query terms

2014-02-18 Thread Manuel Le Normand
arser}Cities_France OR Cities_England => q=max(Paris^0.5 Lyon^0.4 "La Defense"^0.3) OR max(London^0.5, Oxford^4) Implementations possibilities I thought about: 1. An adapted synonym filter, where query term boosts are encoded as payloads. 2. Query parser that handles the term expan

Re: Simple payloads example not working

2014-01-14 Thread michael.boom
Hi Ahmet, Yes, I did, also tried various scenarios with the same outcome. I used the stock example, with minimum customization ( custom similarity and query parser ). - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Simple-payloads-example-not-working

Re: Simple payloads example not working

2014-01-14 Thread Ahmet Arslan
Hi Michael   Did you re-index after you register your custom similarity? Ahmet On Tuesday, January 14, 2014 4:36 PM, michael.boom wrote: Hi Markus, Do you have any example/tutorials of your payloads in custom filter implementation ? I really want to get payloads working, in any way

RE: Simple payloads example not working

2014-01-14 Thread michael.boom
Hi Markus, Do you have any example/tutorials of your payloads in custom filter implementation ? I really want to get payloads working, in any way. Thanks! - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Simple-payloads-example-not-working

RE: Simple payloads example not working

2014-01-14 Thread michael.boom
weird, and can't explain it. - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Simple-payloads-example-not-working-tp4110998p4111219.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Simple payloads example not working

2014-01-14 Thread Markus Jelsma
Strange, is it really floats you are inserting as payload? We use payloads too but write them via PayloadAttribute in custom token filters as float. -Original message- > From:michael.boom > Sent: Tuesday 14th January 2014 11:59 > To: solr-user@lucene.apache.org > Subject

RE: Simple payloads example not working

2014-01-14 Thread michael.boom
0 0 0], payload bytes: [B@1cad357, decoded value is 10.4 payload : [42 4a cc cd], payload bytes: [B@f922cf, decoded value is 10.4 payload : [42 c6 0 0], payload bytes: [B@5c4dc4, decoded value is 10.4 Something doesn't seem right here. Any idea why this behaviour? Is anyone using payloads using

RE: Simple payloads example not working

2014-01-13 Thread michael.boom
= AveragePayloadFunction.docScore()\n", "3":"\n5.0 = (MATCH) btq(includeSpanScore=false), result of:\n 5.0 = AveragePayloadFunction.docScore()\n", "4":"\n5.0 = (MATCH) btq(includeSpanScore=false), result of:\n 5.0 = AveragePayloadFunction.docSco

Re: Simple payloads example not working

2014-01-13 Thread michael.boom
oadFunction(), false), Occur.MUST); } else { q.add(new PayloadTermQuery(new Term(nv[0], nv[1]), new AveragePayloadFunction(), false), Occur.SHOULD); } } return q; } } - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Si

Re: Simple payloads example not working

2014-01-13 Thread Erik Hatcher
tf(freq=1.0), with freq of:\n 1.0 = termFreq=1.0\n > 0.7768564 = idf(docFreq=4, maxDocs=4)\n0.3125 = fieldNorm(doc=2)\n" >}, > > No payload seems to be considered in score calculation - do i need to use a > special query handler? > > > > - > Thanks

RE: Simple payloads example not working

2014-01-13 Thread michael.boom
with score: 10.4 payload is: [42 4a cc cd] with score: 10.4 payload is: [42 c6 0 0] with score: 10.4 Any idea why is it always the same ? - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Simple-payloads-example-not-working-tp4110998p4111045.html

RE: Simple payloads example not working

2014-01-13 Thread Markus Jelsma
1.0f; } -Original message- > From:michael.boom > Sent: Monday 13th January 2014 14:49 > To: solr-user@lucene.apache.org > Subject: Re: Simple payloads example not working > > Thanks iorixxx, > > Actually I've just tried it and I hit a small wall, t

Re: Simple payloads example not working

2014-01-13 Thread michael.boom
(byte [] bytes, int offset) in DefaultSimilarity: public float scorePayload(int doc, int start, int end, BytesRef payload) So it's BytesRef vs byte[]. How should i proceed in this scenario? - Thanks, Michael -- View this message in context: http://lucene.472066.n3.nabble.com/Simple-payloa

Re: Simple payloads example not working

2014-01-13 Thread Ahmet Arslan
Hi Michael, To make payloads to be considered in score calculation you need two more things: 1) A custom similarity  2) A query parser that produces Payload*Query family. This blog post can be a good start point.  http://digitalpebble.blogspot.com/2010/08/using-payloads-with-dismaxqparser

Re: Simple payloads example not working

2014-01-13 Thread michael.boom
n 1.0 = termFreq=1.0\n 0.7768564 = idf(docFreq=4, maxDocs=4)\n0.3125 = fieldNorm(doc=2)\n" }, No payload seems to be considered in score calculation - do i need to use a special query handler? - Thanks, Michael -- View this message in context: http://lucene.472066.n3

Simple payloads example not working

2014-01-13 Thread michael.boom
Hi, I'm trying to test payloads in Solr Using solr 4.6.0 and the example configuration, i posted 3 docs to solr: 1 Doc one testone|100 testtwo|30 testthree|5 I testone, you testtwo, they testthree 2 Doc two testone|30 testtwo|200 testthree|5 I te

Boosting documents at index time, based on payloads

2014-01-10 Thread michael.boom
Hi, I'm not really sure how/if payloads work (I tried out Rafal Kuc's payload example in Apache Solr 4 Cookbook and did not do what i was expecting - see below what i was expecting to do and please correct me if i was looking for the the wrong droid) What I am trying to achieve is simi

Re: Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-05 Thread Furkan KAMACI
; > a > > > keyword I will calculate usual document score for given fields and > also I > > > will make a search on payloaded field and I will multiply the total > score > > > with that payload. > > > > > > I followed that example: > > >

Re: Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-04 Thread Joel Bernstein
o my schema. This > > field holds keyword and probability as payload. When a user searches for > a > > keyword I will calculate usual document score for given fields and also I > > will make a search on payloaded field and I will multiply the total score > > with that pay

Re: Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-03 Thread Furkan KAMACI
t payload. > > I followed that example: > http://sujitpal.blogspot.com/2013/07/porting-payloads-to-solr4.html#! owever > that example extends Qparser directly but I want to use capabilities of > edismax. > > So I found that example: > http://digitalpebble.blogspot.com/2010/08/using-payloads-wit

Using Payloads as a Coefficient For Score At a Custom QParser That extends ExtendedDismaxQParser

2013-12-01 Thread Furkan KAMACI
://sujitpal.blogspot.com/2013/07/porting-payloads-to-solr4.html#! owever that example extends Qparser directly but I want to use capabilities of edismax. So I found that example: http://digitalpebble.blogspot.com/2010/08/using-payloads-with-dismaxqparser-in.html his one exteds dismax and but I could not

Custom Relevancy Using Field Payloads

2013-11-27 Thread Furkan KAMACI
or custom function query? I've followed here: http://sujitpal.blogspot.com/2013/07/porting-payloads-to-solr4.html#! but decodeNormValue if a final method anymore. How about that: http://www.solrtutorial.com/custom-solr-functionquery.html Any ideas about my aim?

Re: Did something change with Payloads?

2013-05-06 Thread hariistou
Hi, I realized that there was no mistake with the way Lucene writes postings/payloads. Rather, there is no flaw there. The problem may be with the way the scorePayload() is implemented. We need to use both payload.bytes, and payload.offset to compute the score. So, please ignore my previous

Re: Did something change with Payloads?

2013-04-25 Thread hariistou
Hi Jim, I faced almost the same issue with payloads recently, and thought I would rather write about it. Please see the link below (my blog). I hope it helps. http://hnagtech.wordpress.com/2013/04/19/using-payloads-with-solr-4-x/ <http://hnagtech.wordpress.com/2013/04/19/using-payloads-with-s

Re: Did something change with Payloads?

2013-03-23 Thread jimtronic
":"2","foo_ap":"bar|75"}] > > > > It actually stores the same payload value "50" for both docs. > > > > That seems like a bug, no? > > > > There was a core change in 4.1 to how payloads were stored. I'm > wonde

Re: Did something change with Payloads?

2013-03-22 Thread Mark Miller
oo_ap":"bar|75"}] > > It actually stores the same payload value "50" for both docs. > > That seems like a bug, no? > > There was a core change in 4.1 to how payloads were stored. I'm wondering if > solr is not handling them properly? This could be

Re: Did something change with Payloads?

2013-03-22 Thread jimtronic
50" for both docs. That seems like a bug, no? There was a core change in 4.1 to how payloads were stored. I'm wondering if solr is not handling them properly? Jim -- View this message in context: http://lucene.472066.n3.nabble.com/Did-something-change-with-Payloads-tp4049561p4050599.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Did something change with Payloads?

2013-03-21 Thread jimtronic
"id":"1", "foo_ap":["bing|9 bing|7","badda|9 bing|7"], "score":7.665}, { "id":"3", "foo_ap":["bing|9","bing|7"], "score":8.0} ] Thanks for any input. -- View this message in context: http://lucene.472066.n3.nabble.com/Did-something-change-with-Payloads-tp4049561p4049957.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Did something change with Payloads?

2013-03-21 Thread jimtronic
gin. These are stored fields, so I can see clearly what the payload value should be. Is there any way to see what the payload value is at a very low level? Thanks! Jim -- View this message in context: http://lucene.472066.n3.nabble.com/Did-something-change-with-Payloads-tp4049561p4049813.html Sen

Re: Did something change with Payloads?

2013-03-21 Thread Ahmet Arslan
Did you recompile your plugins using sold 4.2.0 dependency? May be method signatures (that you override) have changed ? --- On Thu, 3/21/13, jimtronic wrote: > From: jimtronic > Subject: Re: Did something change with Payloads? > To: solr-user@lucene.apache.org > Date: Thursd

Re: Did something change with Payloads?

2013-03-20 Thread jimtronic
Actually, this is more like the code I've got in place: http://sujitpal.blogspot.com/2011/01/payloads-with-solr.html Jim -- View this message in context: http://lucene.472066.n3.nabble.com/Did-something-change-with-Payloads-tp4049561p4049566.html Sent from the Solr - User mailing

Did something change with Payloads?

2013-03-20 Thread jimtronic
I've been using Payloads through several versions of Solr including 4.0, but now they are no longer working correctly on 4.2 I had originally followed Grant's article here: http://searchhub.org/2009/08/05/getting-started-with-payloads/ I have a custom query plugin {!payload} that will

Re: What does SOLR actually do with Payloads?

2012-12-28 Thread Jack Krupansky
I agree with the sentiment you expressed. You can find some examples by googling for "Solr payloads", but although there is a schema field type for indexing specialized terms with payloads, there is no other support unless you add custom code, such as a custom Similarity an

Re: What does SOLR actually do with Payloads?

2012-12-28 Thread Ahmet Arslan
Hi Alexandre, They can be used to store arbitrary data, to tweak scoring. e.g. you can give higher boost to adjectives may be. example schema.xml has http://searchhub.org/2009/08/05/getting-started-with-payloads/ http://digitalpebble.blogspot.com/2010/08/using-payloads-with-dismaxqparser

Re: Atomic Updates, Payloads, Non-stored data

2012-12-02 Thread Erick Erickson
Solr Project about this issue? > > Thanks > > > > - > Best regards > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Atomic-Updates-Payloads-Non-stored-data-tp4006678p4023789.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: Atomic Updates, Payloads, Non-stored data

2012-12-02 Thread yriveiro
Hi, Exists some issue open in the Solr Project about this issue? Thanks - Best regards -- View this message in context: http://lucene.472066.n3.nabble.com/Atomic-Updates-Payloads-Non-stored-data-tp4006678p4023789.html Sent from the Solr - User mailing list archive at Nabble.com.

Using payloads to encode part-of-speech in Solr 4.0.0

2012-11-21 Thread Martí Quixal
Dear list members, I am trying to figure out how to configure schema.xml in solr 4.0.0 so that it takes into account part-of-speech (PoS) tags to index documents and filter queries, all of it by using payloads. The schema.xml file includes a payloads field in Solr 4.0.0. From the comments I have

Re: Atomic Updates, Payloads, Non-stored data

2012-09-14 Thread Erick Erickson
You can't. This is the whole "stacked segment" discussion But you might consider external file fields, sometimes they can work out... Best Erick On Mon, Sep 10, 2012 at 1:19 PM, jimtronic wrote: > Hi, > > I'm using payloads to tie a value to an attribute fo

Atomic Updates, Payloads, Non-stored data

2012-09-10 Thread jimtronic
Hi, I'm using payloads to tie a value to an attribute for a document -- eg a user's rating for a document. I do not store this data, but I index it and access the value through function queries. I was really excited about atomic updates, but they do not work for me because they are b

Re: Replacing payloads for per-document-per-keyword scores

2012-06-01 Thread Chris Hostetter
: > Hoss guessed that we could override Term Frequency with PreAnalyzedField[1] : > for the per-keyword scores, since keywords (tags) always have a Term : > Frequency of 1 and the TF calculation is very fast. However it turns out : > that you can't[2] specify TF in the PreAnalyzedField. Yeah ... s

Re: Replacing payloads for per-document-per-keyword scores

2012-05-15 Thread Mikhail Khludnev
m during indexing internally. The second consideration is - have you considered Click Scoring Tools from lucidworks as a relevant approach? Regards On Wed, May 16, 2012 at 12:02 AM, Neil Hooey wrote: > Hello Hoss and the list, > > We are currently using Lucene payloads to store per-document

Replacing payloads for per-document-per-keyword scores

2012-05-15 Thread Neil Hooey
Hello Hoss and the list, We are currently using Lucene payloads to store per-document-per-keyword scores for our dataset. Our dataset consists of photos with keywords assigned (only once each) to them. The index is about 90 GB, running on 24-core machines with dedicated 10k SAS drives, and 16/32

Re: Getting payloads for matching term in search result

2012-05-14 Thread s . hermann
Hello, On 05/14/2012 10:33 PM, Mikhail Khludnev wrote: It's not really out-of-the-box, but not a big deal http://www.lucidimagination.com/blog/2010/04/18/refresh-getting-started-with-payloads/ yeah I know, but I do not know where to put/plugin the code on solrs server side. For te

Re: Getting payloads for matching term in search result

2012-05-14 Thread Mikhail Khludnev
It's not really out-of-the-box, but not a big deal http://www.lucidimagination.com/blog/2010/04/18/refresh-getting-started-with-payloads/ On Mon, May 14, 2012 at 5:13 PM, wrote: > Good day > > currently I have a field defined as can be seen below: > > c

Re: Getting payloads for matching term in search result

2012-05-14 Thread Jack Krupansky
t I don’t see a Jira for returning the payload(s) for matched terms. -- Jack Krupansky -Original Message- From: s.herm...@uni-jena.de Sent: Monday, May 14, 2012 9:13 AM To: solr-user@lucene.apache.org Subject: Getting payloads for matching term in search result Good day currently

Getting payloads for matching term in search result

2012-05-14 Thread s . hermann
Good day currently I have a field defined as can be seen below: Basically the content for that field has the following form: "Wiedersehn|x1062y1755 macht|x1340y1758 Freude|x1502y1758" where the stuff after the pipe is the payload data (some coordinates). What I want i

Payloads slowing down add/delete doc

2012-03-02 Thread Gary Yang
Hi, there In order to keep a DocID vs UID map, we added payload to a solr core. The search on UID is very fast but we get a problem with adding/deleting docs. Every time we commit an adding/deleting action, solr/lucene will take up to 30 seconds to complete. Without payload, a same action can

Re: payloads - Inconsistency between the document score and the explain score

2011-09-27 Thread Robert Muir
corporated into the score. On Tue, Sep 27, 2011 at 12:33 PM, Jean-Claude Dauphin wrote: > Hello, > > > > I have implemented payloads at the index and query levels using  specific > PayloadSimilarity  and  PayloadQparserPlugin classes. > > Now I wish to check that the payload

payloads - Inconsistency between the document score and the explain score

2011-09-27 Thread Jean-Claude Dauphin
Hello, I have implemented payloads at the index and query levels using specific PayloadSimilarity and PayloadQparserPlugin classes. Now I wish to check that the payloads processing is correct and thus I inserted the following code to check the document scores of a Solr request

Re: Getting payloads in Highlighter

2011-06-03 Thread lboutros
x27;t think your solution can be applied, but if I'm wrong, could you please explain me how ? Thanks, Ludovic. - Jouve France. -- View this message in context: http://lucene.472066.n3.nabble.com/Getting-payloads-in-Highlighter-tp3020885p3021383.html Sent from the Solr - User mailing list

Re: Getting payloads in Highlighter

2011-06-03 Thread Ahmet Arslan
> I need to highlight searched words in the original text > (xml) of a document. Why don't you remove xml tags in an analyzer? You can highlight xml by doing so.

Re: Getting payloads in Highlighter

2011-06-03 Thread lboutros
enumerator, is there a way to get a TermPositions directly positioned on a document, a field and a term ? Ludovic. - Jouve France. -- View this message in context: http://lucene.472066.n3.nabble.com/Getting-payloads-in-Highlighter-tp3020885p3020922.html Sent from the Solr - User mailing list archive

Getting payloads in Highlighter

2011-06-03 Thread lboutros
ghted parts into them. I'm using an additional field for the field offsets for each field in each document. To store the offsets (and perhaps other infos) I'm using the payloads. (I cannot wait for the future DocValues). now my question, what is the fastest way to retrieve payloads (TermPos

Re: Solr Payloads retrieval

2011-02-28 Thread Sujit Pal
Yes, check out the field type "payloads" in the schema.xml file. If you set up one or more of your fields as type payloads (you would use the DelimitedPayloadTokenFilterFactory during indexing in your analyzer chain), you can then use the PayloadTermQuery to query it with, scoring can be

Solr Payloads retrieval

2011-02-28 Thread Fabiano Nunes
Hi! I'm studying a migration from "pure" Lucene to Solr, but I need a crucial feature: Is it posible to retrieve payloads from Solr? I'm storing the coordinates from each term in its payload to highlight images in client-side. Thank you,

Re: Solr 1.4 - Image-Highlighting and Payloads

2010-06-24 Thread MitchK
this preprocessed string to a field with TermVectors. If your query hits the page, you will get all the coordinates you want to get. Unfortunately, highlighting must be done on the client side. Hope this helps - Mitch -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-1-4-Image-Highlighting-and-Payloads-tp919266p919342.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to use Payloads with Solr?

2010-03-29 Thread Grant Ingersoll
On Mar 27, 2010, at 5:31 AM, MitchK wrote: > > Hello community, > > since I have searched for a solution to get TermPositions in Solr, I became > more aware of the "payload"-features. So I decided to learn more about > payloads. > In the wiki, there is not much

How to use Payloads with Solr?

2010-03-27 Thread MitchK
Hello community, since I have searched for a solution to get TermPositions in Solr, I became more aware of the "payload"-features. So I decided to learn more about payloads. In the wiki, there is not much said about them, so I will ask here at the mailing-list. It seems like Pa

Re: Payloads with Phrase queries

2009-12-15 Thread Bill Au
Lucene 2.9.1 comes with a PayloadTermQuery: http://lucene.apache.org/java/2_9_1/api/all/org/apache/lucene/search/payloads/PayloadTermQuery.html I have been using that to use the payload as part of the score without any problem. Bill On Tue, Dec 15, 2009 at 6:31 AM, Raghuveer Kancherla

Re: Payloads with Phrase queries

2009-12-15 Thread Raghuveer Kancherla
huveer.kanche...@aplopio.com> wrote: > Hi, > Thanks everyone for the responses, I am now able to get both phrase queries > and term queries to use payloads. > > However the the score value for each document (and consequently, the > ordering of documents) are coming out wron

Re: Payloads with Phrase queries

2009-12-14 Thread Raghuveer Kancherla
Hi, Thanks everyone for the responses, I am now able to get both phrase queries and term queries to use payloads. However the the score value for each document (and consequently, the ordering of documents) are coming out wrong. In the solr output appended below, document 4 has a score higher

Re: Payloads with Phrase queries

2009-12-10 Thread AHMET ARSLAN
> I was looking through some lucene > source codes and found the following class > org.apache.lucene.search.payloads.PayloadSpanUtil > > There is a function named queryToSpanQuery in this class. > Is this the > preferred way to convert a PhraseQuery to > PayloadNearQuery? queryToSpanQuery method

Re: Payloads with Phrase queries

2009-12-10 Thread Grant Ingersoll
wer, but likely not that much slower. That being said, I haven't benchmarked it. Then again, PNQ does stuff that PQ doesn't, so it's an apples and oranges debate. > > Thanks, > Raghu > > > > On Thu, Dec 10, 2009 at 4:40 PM, AHMET ARSLAN wrote: &

Re: Payloads with Phrase queries

2009-12-10 Thread Raghuveer Kancherla
considerations while using a PayloadNearQuery instead of a PhraseQuery? Thanks, Raghu On Thu, Dec 10, 2009 at 4:40 PM, AHMET ARSLAN wrote: > > Hi, > > I am looking for a way to use payloads in my search > > application. Indexing > > data with payloads into Solr is pretty stra

Re: Payloads with Phrase queries

2009-12-10 Thread AHMET ARSLAN
> Hi, > I am looking for a way to use payloads in my search > application. Indexing > data with payloads into Solr is pretty straightforward. > However using the > payloads during search time is a bit confusing. Can anyone > point me in the > right direction to enable pa

Payloads with Phrase queries

2009-12-10 Thread Raghuveer Kancherla
Hi, I am looking for a way to use payloads in my search application. Indexing data with payloads into Solr is pretty straightforward. However using the payloads during search time is a bit confusing. Can anyone point me in the right direction to enable payloads on a *PhraseQuery*. I looked at the

Re: Index time boosts, payloads, and long query strings

2009-11-23 Thread Erick Erickson
t; > HTH > > > > Erick > > > > > > > > > > > > On Sat, Nov 21, 2009 at 2:13 AM, Girish Redekar > > > > wrote: > > > > > > > > > Hi , > > > > > > > > > > I'm relatively new to S

Re: Index time boosts, payloads, and long query strings

2009-11-23 Thread Girish Redekar
rimarily because I can use it without writing java code > > (rest > > > of > > > > my project is python coded). > > > > > > > > My application has the following requirements: > > > > (a) ability to search over multiple fields, each with

  1   2   >