Hi Chris,
Chris Hostetter-3 wrote
> ...ExternalFileField is "special" and as noted in it's docs it is not
> searchable -- it doesn't actaully care what the indexed (or "stored")
> properties are ... but the default values of those properties as assigend
> by the schema defaults are still there
Chris Hostetter-3 wrote
> : *
> : class="solr.ExternalFileField" valType="float"/>
> *
> :
> : *
>
> *
> ...
> : I was expecting that for field "fieldA" indexed will be marked as false
> and
> : it will not be part of the index. But Solr admin "SCHEMA page" (we get
> this
> : option after
: **
:
: **
...
: I was expecting that for field "fieldA" indexed will be marked as false and
: it will not be part of the index. But Solr admin "SCHEMA page" (we get this
: option after selecting collection name in the drop-down menu) is showing
: it as an indexed field (green tick mark
Vadim Ivanov wrote
> Hello, Raj
>
> I've just checked my Schema page for external file field
>
> Solr version 8.3.1 gives only such parameters for externalFileField:
>
>
> Field: fff
>
> Field-Type:
>
> org.apache.solr.schema.ExternalFileField
>
Hello, Raj
I've just checked my Schema page for external file field
Solr version 8.3.1 gives only such parameters for externalFileField:
Field: fff
Field-Type:
org.apache.solr.schema.ExternalFileField
Flags:
UnInvertible
Omit Term Frequencies & Positions
Properties
√
√
A
We have following external file field type and field:
**
**
In solr official documentation is it mentioned that :
*"*The ExternalFileField type makes it possible to specify the values for a
field in a file outside the Solr index. *External fields are not
searchable. They can be used onl
017, at 2:48 PM, Chris Hostetter wrote:
>
>
> : Do I need to define a field with when I use an external file
> : field? I see the to define it, but the docs don’t say how
> : to define the field.
>
> you define the field (or dynamicField) just like any other field -- t
: Do I need to define a field with when I use an external file
: field? I see the to define it, but the docs don’t say how
: to define the field.
you define the field (or dynamicField) just like any other field -- the
fieldType is where you specify things like the 'keyField' &am
Do I need to define a field with when I use an external file field? I
see the to define it, but the docs don’t say how to define the
field.
The docs say that the file uses the fieldname as part of the filename, but the
directive defines a type name, not a field name. Right?
wunder
Walter
score and generate a file for
ExternalFileField. So, I need to post this external file into solr
directory. How to do this?
Help me to write values into that external file.
--
View this message in context:
http://lucene.472066.n3.nabble.com/How-to-get-values-of-external-file-field-s-in-
Is there a way to specify a different file location for the external file field
file? I know that the data directory makes the most sense, but for deployment,
it is going to be MUCH easier for us to put it in the config directory.
The original Jira mentioned an absolute path for the file. Is
Is there any API to support upload file for ExternalFileField to /data/
directory or any good practice on this?
My application and Solr Server were physically separated on two place.
Application will calculate a score and generate a file for
ExternalFileField.
Thanks for any input.
Hi ,
I am trying to see how the External File Field functionality works.
In the "solrconfig.xml", I added below listeners.
In the schema.xml i defined field type and field
In my SOLR data directory(example\solr\collection1\data), I created a file
"external_testField
Thanks Kamal.
On Wed, Jul 16, 2014 at 11:43 AM, Kamal Kishore Aggarwal <
kkroyal@gmail.com> wrote:
> Hi Apporva,
>
> This was my master server replication configuration:
>
> core/conf/solrconfig.xml
>
>
> >
> > commit
> > startup
> > ../data/external_eff_views
>
Hi Apporva,
This was my master server replication configuration:
core/conf/solrconfig.xml
>
> commit
> startup
> ../data/external_eff_views
>
>
It is only configuration files that can be replicated. So, when I wrote the
above config. The external files was g
Hey Kamal,
What all config changes have you done to establish replication of external
files and how have you disabled role reloading?
On Wed, Jul 9, 2014 at 11:30 AM, Kamal Kishore Aggarwal <
kkroyal@gmail.com> wrote:
> Hi All,
>
> It was found that external file, which was getting replicate
Hi All,
It was found that external file, which was getting replicated after every
10 minutes was reloading the core as well. This was increasing the query
time.
Thanks
Kamal Kishore
On Thu, Jul 3, 2014 at 12:48 PM, Kamal Kishore Aggarwal <
kkroyal@gmail.com> wrote:
> With the above replic
With the above replication configuration, the eff file is getting
replicated at core/conf/data/external_eff_views (new dir data is being
created in conf dir) location, but it is not getting replicated at
core/data/external_eff_views
on slave.
Please help.
On Thu, Jul 3, 2014 at 12:21 PM, Kamal K
Thanks for your guidance Alexandre Rafalovitch.
I am looking into this seriously.
Another question is that I facing error in replication of eff file
This is master replication configuration:
core/conf/solrconfig.xml
>
> commit
> startup
> ../data/external_eff_view
This might be related:
https://issues.apache.org/jira/browse/SOLR-3514
On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal <
kkroyal@gmail.com> wrote:
> Hi Team,
>
> I have recently implemented EFF in solr. There are about 1.5 lacs(unsorted)
> values in the external file. After this imp
How would we know where the problem is? It's your custom
implementation. And it's your own documents, so we don't know field
sizes/etc. And it's your own metric (ok, Indian metric, but lacs are
fairly unknown outside of India).
Seriously though, have you tried using any memory profilers and
runnin
Any replies ??
On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal <
kkroyal@gmail.com> wrote:
> Hi Team,
>
> I have recently implemented EFF in solr. There are about 1.5
> lacs(unsorted) values in the external file. After this implementation, the
> server has become slow. The solr query
Hi Team,
I have recently implemented EFF in solr. There are about 1.5 lacs(unsorted)
values in the external file. After this implementation, the server has
become slow. The solr query time has also increased.
Can anybody confirm me if these issues are because of this implementation.
Is that memor
>
> >
> > On Monday, December 16, 2013 5:05 PM, Mukundaraman valakumaresan <
> > muk...@8kmiles.com> wrote:
> > Hi
> >
> > Is there a way to find ,whether the External File Fields mentioned in the
> > schema.xml is being used or whether Solr r
<
> muk...@8kmiles.com> wrote:
> Hi
>
> Is there a way to find ,whether the External File Fields mentioned in the
> schema.xml is being used or whether Solr reads the value of those external
> fields.
>
> I am not sure how to use an External field, can I request the value
>
>
>
> On Monday, December 16, 2013 5:05 PM, Mukundaraman valakumaresan <
> muk...@8kmiles.com> wrote:
> Hi
>
> Is there a way to find ,whether the External File Fields mentioned in the
> schema.xml is being used or whether Solr reads the value of those external
>
les.com> wrote:
> Hi
>
> Is there a way to find ,whether the External File Fields mentioned in the
> schema.xml is being used or whether Solr reads the value of those external
> fields.
>
> I am not sure how to use an External field, can I request the value of an
> External File Fie
External File Field in the field list or can I use in my custom function as
shown below:
http://localhost:8983/solr/collection1/select?wt=json&omitHeader=on&indent=true&defType=edismax&fl=id,adjlocality<http://localhost:8983/solr/collection1/select?wt=json&omitHeader=on&
Hi
Is there a way to find ,whether the External File Fields mentioned in the
schema.xml is being used or whether Solr reads the value of those external
fields.
I am not sure how to use an External field, can I request the value of an
External File Field in the field list or can I use in my
that boosting values from files into documents. It might force you
to index more, and/or slightly delay boosting update, but it's the only
easy win here.
On Tue, Nov 19, 2013 at 6:55 PM, adityab wrote:
> Hi,
> I have been using external file field (eff) for holding rank of the
> do
Hi,
I have been using external file field (eff) for holding rank of the document
which gets updated every day based on different stats collected by the
system. Once the rank is computed the new files are pushed to Master which
will eventually replicate to slaves on next commit.
Our eff file has
On Fri, Oct 4, 2013 at 12:24 AM, Peter Keegan wrote:
> But how to get the values for docs that match some arbitrary query?
You can specify eff in fl param. it's implied by
http://docs.lucidworks.com/display/solr/Function+Queries
--
Sincerely yours
Mikhail Khludnev
Principal Engineer,
Grid Dyn
do I retrieve
> > the
> > values for display?
> >
> > If I want to fetch only the values of a single external file field for a
> > set of primary keys, I can do:
> > q=_val_:"EXT_FILE_FIELD"&fq=id:(doc1 doc2 doc3)&fl=id,score
> > For this que
: reference to a few "special" values, such as "id" and "score". Neither
: of them are technically "stored" fields either, but afaik you dont need
: to use "field(id), field(score)" for those. Can you honestly say that
: is consistent?
Nope.
I wasn't defending the quirks of the API, or tryi
Chris, the confusion from my perspective is the general inconsistency and
natural growth of the API which is somewhat expected based upon its history.
Obviously this isnt sql, there is no ansi body defining the query language. I
understand well the difference between stored, indexed etc.
Goin
: Yes that worked, thanks Alan. The consistency of this api is "challenging".
It's important to understand what's happening here.
fl, by default, only returns "stored" fields -- but you can also request
"psuedo-fields" such as the results of functions, or the result of a "Doc
Transformer" ...
_name)
>
> Alan Woodward
> www.flax.co.uk
>
>
> On 14 Jul 2013, at 18:41, Chris Collins wrote:
>
>> Why would I be re-indexing an external file field? The whole purpose is that
>> its brought in at runtime and not part of the index?
>>
>> C
>> On Jul 14,
Hi Chris,
Try wrapping the field name in a field() function in your fl parameter list,
like so:
fl=field(eff_field_name)
Alan Woodward
www.flax.co.uk
On 14 Jul 2013, at 18:41, Chris Collins wrote:
> Why would I be re-indexing an external file field? The whole purpose is that
> its b
Why would I be re-indexing an external file field? The whole purpose is that
its brought in at runtime and not part of the index?
C
On Jul 14, 2013, at 10:13 AM, Shawn Heisey wrote:
> On 7/14/2013 7:05 AM, Chris Collins wrote:
>> Yep I did switch on stored=true in the field type. I
On 7/14/2013 7:05 AM, Chris Collins wrote:
> Yep I did switch on stored=true in the field type. I was able to confirm a
> few ways that there are values for the eff by two methods:
>
> 1) changing desc to asc produced drastically different results.
>
> 2) debugging FileFloatSource the following
Erickson wrote:
> Did you store the field? I.e. set stored="true"? And does the EFF contain
> values for the docs you're returning?
>
> Best
> Erick
>
> On Sun, Jul 14, 2013 at 3:32 AM, Chris Collins wrote:
>> I am playing with external file field f
Did you store the field? I.e. set stored="true"? And does the EFF contain
values for the docs you're returning?
Best
Erick
On Sun, Jul 14, 2013 at 3:32 AM, Chris Collins wrote:
> I am playing with external file field for sorting. I created a dynamic field
> using the E
I am playing with external file field for sorting. I created a dynamic field
using the ExternalFileField type.
I naively assumed that the "fl" argument would allow me to return the value the
external field but doesnt seem to do so.
For instance I have a defined a dynamic field:
rnal file fields:
> > "They can be used only for function queries or display".
> > I understand how to use them in function queries, but how do I retrieve
> the
> > values for display?
> >
> > If I want to fetch only the values of a single external file fiel
in function queries, but how do I retrieve the
> values for display?
>
> If I want to fetch only the values of a single external file field for a
> set of primary keys, I can do:
> q=_val_:"EXT_FILE_FIELD"&fq=id:(doc1 doc2 doc3)&fl=id,score
> For this query, the
to fetch only the values of a single external file field for a
> set of primary keys, I can do:
> q=_val_:"EXT_FILE_FIELD"&fq=id:(doc1 doc2 doc3)&fl=id,score
> For this query, the score is the value of the external file field.
>
> But how to get the values for docs tha
fetch only the values of a single external file field for a
set of primary keys, I can do:
q=_val_:"EXT_FILE_FIELD"&fq=id:(doc1 doc2 doc3)&fl=id,score
For this query, the score is the value of the external file field.
But how to get the values for docs that match some arbitrary qu
Hi,
Are there plans for bringing distributed capabilities for the external file
field? I've not seem any hints for this in the work in distributed indexing,
nor on the wiki or elsewhere.
Will we be able to send a very large file and have it sliced up and have the
values sent to the desig
i found answer to my question ..
basically it works only with complete match..
--
View this message in context:
http://lucene.472066.n3.nabble.com/external-file-field-partial-data-match-in-key-field-tp3368547p3371328.html
Sent from the Solr - User mailing list archive at Nabble.com.
phone"
can i use partial titles in external file field?
here is schema
-
titleFile contains
--
iphone=15
blackberry=13
samsung=12
now when results are obtained for search term like "phone" i would like to
show user phones having title
iphone fir
use case or am I trying to
> fit a square into a circular hole?
Each external file field will take up maxDoc*4 bytes of RAM.
The other consideration is the time to load them (how often the index
needs to change).
-Yonik
http://www.lucidimagination.com
We have around 10million documents that are in our index and about 10%
of them have some extra "statistics" that are calculated on a daily
basis which are then index and used in our function queries. This
reindexing comes at the expense of doing multiple joins in DIH so I am
thinking it may be
: We took a deeper look at what happened, when an "external-file-field"-Request
is sent to SOLR:
:
: * SOLR looks if there is a file for the requested query, e.g. "trousers"
Something smells fishy here.
ExternalFileField is designed to let you load values for a field (f
x27;ve made a good progress in the analysis.
>
> We took a deeper look at what happened, when an "external-file-field"-Request
> is sent to SOLR:
>
> * SOLR looks if there is a file for the requested query, e.g. "trousers"
> * If so, then SOLR loads the
Hi,
I could not provide a stack trace and IMHO it won't provide some useful
information. But we've made a good progress in the analysis.
We took a deeper look at what happened, when an "external-file-field"-Request
is sent to SOLR:
* SOLR looks if there is a file for the
Can you provide a stack trace for the OOM eexception ?
On Tue, Jun 7, 2011 at 4:25 PM, Bohnsack, Sven
wrote:
> Hi all,
>
> we're using solr 1.4 and external file field ([1]) for sorting our
> searchresults. We have about 40.000 Terms, for which we use this sorting
> optio
Hi all,
we're using solr 1.4 and external file field ([1]) for sorting our
searchresults. We have about 40.000 Terms, for which we use this sorting option.
Currently we're running into massive OutOfMemory-Problems and were not pretty
sure, what's the matter. It seems that the ga
Created issue and added simple patch:
https://issues.apache.org/jira/browse/SOLR-2545
On Wednesday 25 May 2011 14:55:34 Markus Jelsma wrote:
> Hi,
>
> It seems i cannot escape the equals-sign in the source file for the
> external file field. Anyone knows another work-around? Ex
Hi,
It seems i cannot escape the equals-sign in the source file for the external
file field. Anyone knows another work-around? Except for not using values with
that character of course ;)
Cheers,
--
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536620 / 06-50258350
59 matches
Mail list logo
