"//result/doc[position()=2]/str[.='1']",
"//result/doc[position()=10]/str[.='8']");
}
On Wed, Sep 4, 2019 at 8:28 PM Adam Taylor wrote:
> Hi All,
>
> We're running Solr 3.4 (I know, I know - we have another project to
Hi All,
We're running Solr 3.4 (I know, I know - we have another project to upgrade
this) and we have a fieldtype defined with an externalFileField as:
(Actually, I have tried this with both `stored="true"` and
`stored="false"`).
The field using thi
chance they works
with eff).
On Wed, May 9, 2018 at 1:36 PM, Michal Danilák
wrote:
> Is it possible to facet over ExternalFileField values?
>
> If I have this in my schema.xml:
>
> keyField="id" defVal="0" stored="false" indexed="false"
Is it possible to facet over ExternalFileField values?
If I have this in my schema.xml:
And request the following facet:
facet={
"age": {
"field": "eff_age",
"type": "terms",
"limit": 10
}
}
It r
We put a cron job on each host. That fetches the file from Amazon S3, then puts
it in the data directories matching the collection name.
The file will be loaded on the next commit, as far as I can tell.
wunder
Walter Underwood
wun...@wunderwood.org
http://observer.wunderwood.org/ (my blog)
> O
Is there a recommended way of managing external files with SolrCloud. At first
glance it appears that I would need to manually manage the placement of the
external_.txt file in each shard's data directory. Is there a better
way of managing this (Solr API, interface, etc?)
This message and any
Thanks a lot,
for now I've written a listener to read from redis instead.
But might not scale well since the map is kept in memory.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Is-there-any-particular-reason-why-ExternalFileField-is-read-from-data-dire
Hi,
ExternalFileField was introduced via SOLR-351.
https://issues.apache.org/jira/browse/SOLR-351
The author thought values could optionally be updated often...
I think it describes why it is read from not config, but datadir.
Koji
On 2017/06/29 17:17, apoorvqwerty wrote:
Hi,
As per the
at up.
Frankly, though, ExternalFileField is a blunt instrument, if you're
putting single numeric values in there consider updateable docValues
instead.
Best,
Erick
On Thu, Jun 29, 2017 at 1:17 AM, apoorvqwerty wrote:
> Hi,
> As per the documentation for ExternalFileField we need to put ext
Hi,
As per the documentation for ExternalFileField we need to put external_field
with the map in parallel with the data directory on all the shards.
Is it possible to read the file from a central location or zookeeper?
--
View this message in context:
http://lucene.472066.n3.nabble.com/Is
knocked up what I think could be a really cool function query -
> > > it allows you to retrieve a value from another core (much like a pseudo
> > > join) and use that value during scoring (much like an
> > > ExternalFileField).
> > >
> > > Examples:
> &
Fri, Jul 10, 2015 at 4:54 PM, Upayavira wrote:
> >
> > > All,
> > >
> > > I have knocked up what I think could be a really cool function query -
> > > it allows you to retrieve a value from another core (much like a pseudo
> > > join) and use t
o the bigger slow
> moving one
>
> On Fri, Jul 10, 2015 at 4:54 PM, Upayavira wrote:
>
> > All,
> >
> > I have knocked up what I think could be a really cool function query -
> > it allows you to retrieve a value from another core (much like a pseudo
>
gt;> On Fri, Jul 10, 2015 at 4:54 PM, Upayavira wrote:
> >>
> >> > All,
> >> >
> >> > I have knocked up what I think could be a really cool function query -
> >> > it allows you to retrieve a value from another core (much like a pseudo
>
ing scores from fast moving core to the bigger slow
>> moving one
>>
>> On Fri, Jul 10, 2015 at 4:54 PM, Upayavira wrote:
>>
>> > All,
>> >
>> > I have knocked up what I think could be a really cool function query -
>> > it allows you to retr
uch like a pseudo
> > join) and use that value during scoring (much like an
> > ExternalFileField).
> >
> > Examples:
> > * Selective boosting of documents based upon a category based value
> > * boost on aggregated popularity values
> > * boost on fast moving da
function query -
> it allows you to retrieve a value from another core (much like a pseudo
> join) and use that value during scoring (much like an
> ExternalFileField).
>
> Examples:
> * Selective boosting of documents based upon a category based value
> * boost on aggregated p
All,
I have knocked up what I think could be a really cool function query -
it allows you to retrieve a value from another core (much like a pseudo
join) and use that value during scoring (much like an
ExternalFileField).
Examples:
* Selective boosting of documents based upon a category based
Hi I have two server(Physical) that run my application and solr. I use
external file field to do some search result ranking.
According to the wiki page, external file field data need to resident in
{solr}\data directory. Because EFF data is generated by my application. How
can I push this file to
does not seem to work. An additional requirement I have, is to
boost on specific range for the ExternalFileField and the map function
helps achieve this.
Any help is greatly appreciated.
Regards,
Parnit
Message-
From: Sudhakar Maddineni [mailto:maddineni...@gmail.com]
Sent: Friday, September 19, 2014 2:10 PM
To: solr-user@lucene.apache.org
Subject: Result grouping using externalfilefield
Hi,
Just trying to understand grouping feature with solrcloud 4.2 and I have 4
node/2 shard cluster setup.I
48
> > To: solr-user@lucene.apache.org
> > Subject: NullPointerException for ExternalFileField when key field has
> no terms
> >
> > Hi,
> >
> > I use various ID fields as the keys for various ExternalFileField fields,
> > and I have noticed that I will
> Subject: NullPointerException for ExternalFileField when key field has no
> terms
>
> Hi,
>
> I use various ID fields as the keys for various ExternalFileField fields,
> and I have noticed that I will sometimes get the following error:
>
> ERROR org.apach
Hi,
I use various ID fields as the keys for various ExternalFileField fields,
and I have noticed that I will sometimes get the following error:
ERROR org.apache.solr.servlet.SolrDispatchFilter û
null:java.lang.NullPointerException
at
Hi,
Just trying to understand grouping feature with solrcloud 4.2 and I have 4
node/2 shard cluster setup.I am trying to group my search results based on
an externalfilefield that I defined.
Here is my configuration:
core1:
==
schema.xml:
solrconfig.xml:
And, created empty file
:15 PM, Demian Katz
wrote:
I've just been doing some experimentation with the ExternalFileField. I ran
into obstacles due to some apparently incorrect documentation in the wiki:
https://cwiki.apache.org/confluence/display/solr/Working+with+External+Files+and+Processes
It seems that for
I've just been doing some experimentation with the ExternalFileField. I ran
into obstacles due to some apparently incorrect documentation in the wiki:
https://cwiki.apache.org/confluence/display/solr/Working+with+External+Files+and+Processes
It seems that for some reason the and defini
ediff.co.in>Subject: Re: Displaying ExternalFileField values
in CSVResponse - Solr 4.6Hi Sanjeev,Here is the relevant jira
: https://issues.apache.org/jira/browse/SOLR-5423 which has fix versions
4.7.1, 4.8, 5.0.So I recommend to use/download latest 4.8.0 version.AhmetOn
Friday, May 2, 2014 2:46 PM,
our ecommerce product
details. We are using ExternalFileField option to incorporate some ranking
signals. The problem I am facing currently is that the values of
ExternalFileField are not displayed in the CSVResponse of the solr. However I
am able to get the valuesfor other response formats
Hi, We are using Solr4.6 to index and search our ecommerce product
details. We are using ExternalFileField option to incorporate some ranking
signals. The problem I am facing currently is that the values of
ExternalFileField are not displayed in the CSVResponse of the solr. However I
am able
Hi Varun,
SolrCloud only uses zk to store configuration, not data. Each solr instance
will have its own data folder, and you'll need to sync the ExternalFileField
file to each one. I don't think you can do this with anything internal to Solr
at the moment - we've had clients
Hi,
I am trying to use ExternalFileField on Solr 4.6 running on SolrCloud for
the purpose of changing the document score based on a frequently changed
field. According to the documentation, the external file needs to be
present in the "data" folder of the collection.
I am confused ov
Atuldj,
You are right. There is no such out-of-the-box feature in Solr. The most
closet thing which I'm aware of is
Lucidworks.lucidimagination.com/display/lweug/Click+Scoring+Relevance+Framework
But I've never use it.
ExternalFileField is an appropriate building block.
I'm tryin
, Carrie Coy wrote:
(Solr4) I'm getting the following error trying to use
ExternalFileField to maintain an inStock flag. Any idea what I'm
doing wrong?
schema.xml:
indexed="false" class="solr.ExternalFileField" valType="float"/>
-rw-r--r-- 1 tomcat
(Solr4) I'm getting the following error trying to use ExternalFileField
to maintain an inStock flag. Any idea what I'm doing wrong?
schema.xml:
indexed="false" class="solr.ExternalFileField" valType="float"/>
-rw-r--r-- 1 tomcat tomcat 100
t.com/spm/index.html
On Mon, Oct 15, 2012 at 9:37 AM, Alan Woodward
wrote:
> Hi list,
>
> I'm having a go at improving the performance of ExternalFileField (relevant
> to this thread:
> http://lucene.472066.n3.nabble.com/Reloading-ExternalFileField-blocks-Solr-td4012399.html#
using Solr-4.0.0-Beta with a 7M document index running on a single
> > host with 16 shards. We'd like to use an ExternalFileField to hold a
> value
> > that changes often. However, we've discovered that the file is apparently
> > re-read by every shard/core on *every
using Solr-4.0.0-Beta with a 7M document index running on a single
> host with 16 shards. We'd like to use an ExternalFileField to hold a value
> that changes often. However, we've discovered that the file is apparently
> re-read by every shard/core on *every commit*; the index
> > >
> > > We're using Solr-4.0.0-Beta with a 7M document index running on a
> single
> > > host with 16 shards. We'd like to use an ExternalFileField to hold a
> > value
> > > that changes often. However, we've discovered that the
-Beta with a 7M document index running on a single
> > host with 16 shards. We'd like to use an ExternalFileField to hold a
> value
> > that changes often. However, we've discovered that the file is apparently
> > re-read by every shard/core on *every commit*; the ind
s. We'd like to use an ExternalFileField to hold a value
> that changes often. However, we've discovered that the file is apparently
> re-read by every shard/core on *every commit*; the index is unresponsive in
> this period (around 20s on the host we're running on). This is unacceptable
&g
Hi List
We're using Solr-4.0.0-Beta with a 7M document index running on a single
host with 16 shards. We'd like to use an ExternalFileField to hold a value
that changes often. However, we've discovered that the file is apparently
re-read by every shard/core on *every commit
ill Tornroth >wrote:
>
> > I'm using Solr 3.5. Does anyone have a suggestion as to how to end up
> > adding this extra dimension so that I can do per-user relevance? It seems
> > like an oft-asked, rarely-answered question.
> >
>
> Use a function that make u
make use of your externalfilefield and alter the score
so that you can sort on the score ?
I'm trying pretty hard to come up with a solution that lets me sort by
per-user scores that I calculate based on my data. Today, I'm trying to use
a combination of ExternalFileField and dynamic fields, where the
presumption is that each user might have their own file full of scores. I
: unique terms) but I agree with Erik on the ExternalFileField as you can use
: it just inside a function query, for example, for boosting.
with {!frange} it would be trivial to filter based on values in an
ExternalFileField ... whether that would be *faster* then a custom
plugin that worked
Also regarding the Join functionality I remember Yonik pointed out it's O(#
unique terms) but I agree with Erik on the ExternalFileField as you can use
it just inside a function query, for example, for boosting.
Tommaso
2012/3/1 Erick Erickson
> Hmmm. ExternalFileFields can only be floa
Hmmm. ExternalFileFields can only be float values, so I'm not
sure "the necessary data" is straight-forward. Additionally, they
are used in function queries. Does this still work?
I really don't know the performance characteristics if, say, you have
users with access to all documents for SOLR-2272
I am looking at two different options to filter results in Solr, basically
a per-user access control list. Our index is about 2.5 million documents
The first option is to use ExternalFieldField. It seems pretty
straightforward. Just put the necessary data in the files and query against
that data.
@lucene.apache.org
Subject: RE: Replication and ExternalFileField
Probably would have worked on *nix but unfortunately running Windows.
Best regards,
Per
-Original Message-
From: Markus Jelsma [mailto:markus.jel...@openindex.io]
Sent: den 15 september 2011 14:07
To: solr-user
Probably would have worked on *nix but unfortunately running Windows.
Best regards,
Per
-Original Message-
From: Markus Jelsma [mailto:markus.jel...@openindex.io]
Sent: den 15 september 2011 14:07
To: solr-user@lucene.apache.org
Subject: Re: Replication and ExternalFileField
Perhaps a
Perhaps a symlink will do the trick.
On Thursday 15 September 2011 14:04:47 Per Osbeck wrote:
> Hi all,
>
> I'm trying to find some good information regarding replication, especially
> for the ExternalFileField.
>
> As I understand it;
> - the external
Hi all,
I'm trying to find some good information regarding replication, especially for
the ExternalFileField.
As I understand it;
- the external files must be in data dir.
- replication only replicates data/indexes and possibly confFiles from the
conf dir.
Does anyone have suggestio
: Subject: ExternalFileField with whitespaces
...
: I think it is a bug, therefore I opened issue SOLR-2335.
:
: To handle this problem we now have to decide if we implement a
: workaround in our application to replace whitespaces or if we try to
: patch solr to work with whitepaces in
)
org.apache.lucene.queryParser.ParseException: Cannot parse
'val:(experience_foo\ bar)': Expected ',' at position 15 in
'experience_foo bar'
We use following configuration for the externalFileField:
...
...
I think it is a bug, therefore I opened issue SOLR-2335.
lot which I want to use for ranking my
> results. Is the ExternalFileField the way to go and is it supported in the
> latest stable release of SOLR? (Do I have to go for trunk, or should I stick
> with 1.4 - the lucidWorks certified distribution?)
>
> My idea is to generate a fil
Hi
I have an databasefield that changes a lot which I want to use for ranking my
results. Is the ExternalFileField the way to go and is it supported in the
latest stable release of SOLR? (Do I have to go for trunk, or should I stick
with 1.4 - the lucidWorks certified distribution?)
My idea
isn't it the case that bf adds the boost value while {!boost} multiply
> the boost value? In my case I think a multiplication is more appropriate.
>
> So there's no way to use ExternalFileField in {!boost}?
>
> --- On Sat, 8/28/10, Lance Norskog wrote:
>
> > Fro
But isn't it the case that bf adds the boost value while {!boost} multiply the
boost value? In my case I think a multiplication is more appropriate.
So there's no way to use ExternalFileField in {!boost}?
--- On Sat, 8/28/10, Lance Norskog wrote:
> From: Lance Norskog
You want the boost function bf= parameter.
On Sat, Aug 28, 2010 at 5:32 PM, Andy wrote:
> Lance,
>
> Thanks for the response.
>
> Can I use an ExternalFileField as an input to a boost query?
>
> For example, if I put the field "popularity" in an ExternalFileField,
Lance,
Thanks for the response.
Can I use an ExternalFileField as an input to a boost query?
For example, if I put the field "popularity" in an ExternalFileField, can I
still use "popularity" in a boosted query such as:
{!boost b=log(popularity)}foo
The doc says ExternalF
The file is completely reloaded when you commit or optimize. There is
no incremental update available. And, yes, this could be a scaling
problem.
How you update it is completely external to Solr.
On Sat, Aug 28, 2010 at 2:50 AM, Andy wrote:
> I'm interested in using ExternalFileField to
I'm interested in using ExternalFileField to store a field "popularity" that is
being updated frequently.
However ExternalFileField seems to be a pretty obscure feature. Have a few
questions:
1) Can anyone share your experience using it?
2) What is the most efficient wa
I have a field "popularity" that is changing frequently. So I'd like to put it
in an ExternalFileField.
If I do that, can I still use "popularity" in a boosted query such as:
{!boost b=log(popularity)}foo
Thanks.
Most of the other files have rows about 1000-3000 thousand.
What does happen if im writing that file, and then solr tries to read it, is
there somekind of timeout?
Again, if I recall correctly, it loads up the file at startup or after commit
(the later depends on the location of the fi
ng? Or does it wait until i finish? Cause sometimes the
> writing could take some time (especially in the cause
> when 1.5 million lines have to be written).
>
> Last question to the ExternalFileField is, what does happen, if i start
> writing the externalFile while lucene trys to
have to be written).
Last question to the ExternalFileField is, what does happen, if i start writing
the externalFile while lucene trys to
sort by fields? Any exception or is there a softcache?
Thanks for your help,
Julian Hille
Yonik Seeley wrote:
Go ahead and open a bug. One idea is to use a different key for the
weak map (something that changes every commit).
-Yonik
http://www.lucidimagination.com
Yonik,
Thank you. I opend SOLR-1607.
Do you have any ideas for the candidate of the key?
Koji
--
http://www.rond
On Sat, Nov 28, 2009 at 8:24 PM, Koji Sekiguchi wrote:
> Hmm, if I set reopenReaders to false, as SolrIndexReader objects between
> before and after commit are different, ExternalFileField works as expected.
> If I set reopenReaders to true, it doesn't work. ... I don't lik
Hmm, if I set reopenReaders to false, as SolrIndexReader objects between
before and after commit are different, ExternalFileField works as expected.
If I set reopenReaders to true, it doesn't work. ... I don't like this
dependency.
What I don't understand is that if I set reopen
Are you sure?
TestFunctionQuery.testExternalField() has a test for reloading on a commit.
Are you putting the file in the data directory?
-Yonik
http://www.lucidimagination.com
2009/11/28 Koji Sekiguchi :
> It seems that ExternalFileField doesn't work in 1.4.
> In 1.4, I need to r
It seems that ExternalFileField doesn't work in 1.4.
In 1.4, I need to restart Solr to reflect external_[fieldname] file.
Only was needed in 1.3...
Koji
--
http://www.rondhuit.com/en/
tly is possible with ExternalFileField but
> just want to make sure.
>
> if not possible, is it on the roadmap?
You're right, it's not currently possible.
We don't have any official roadmap, but we've thought about updateable
fields (the other way to accomplish this sor
in our design some often changing fields would benefit from being defined as
ExternalFileFields, so we can index them more often than the rest.
However we need to filter and facet on them.
I don't think that this currently is possible with ExternalFileField but
just want to make sure.
i
In general though i wondering if steping back a bit and modifying your
request handler to use a SolrDocumentList where you've already
flattened
the ExternalFileField into each SolrDocument would be an easier
approach
-- then you wouldnt' need to modify the ResponseWri
: I've been trying to return a field of type ExternalFileField in the search
: result. Upon examining XMLWriter class, it seems like Solr can't do this out
: of the box. Therefore, I've tried to hack Solr to enable this behaviour.
: The goal is to call to ExternalFileField
Hi all,
I've been trying to return a field of type ExternalFileField in the search
result. Upon examining XMLWriter class, it seems like Solr can't do this out
of the box. Therefore, I've tried to hack Solr to enable this behaviour.
The goal is to call to ExternalFileField
77 matches
Mail list logo
