Re: External file field

2017-11-17 Thread Walter Underwood
Thanks. I found this, which is much more clear than the manual. http://www.openjems.com/solr-external-file-fields/ The Solr manual should include the info about how to declare the field. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Nov 17, 2017,

Re: External file field

2017-11-17 Thread Chris Hostetter
: Do I need to define a field with when I use an external file : field? I see the to define it, but the docs don’t say how : to define the field. you define the field (or dynamicField) just like any other field -- the fieldType is where you specify things like the 'keyField' & the 'defVal',

Re: External File Field eating memory

2014-07-15 Thread Apoorva Gaurav
Thanks Kamal. On Wed, Jul 16, 2014 at 11:43 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi Apporva, > > This was my master server replication configuration: > > core/conf/solrconfig.xml > > > > > > commit > > startup > > ../data/external_eff_views >

Re: External File Field eating memory

2014-07-15 Thread Kamal Kishore Aggarwal
Hi Apporva, This was my master server replication configuration: core/conf/solrconfig.xml > > commit > startup > ../data/external_eff_views > > It is only configuration files that can be replicated. So, when I wrote the above config. The external files was g

Re: External File Field eating memory

2014-07-14 Thread Apoorva Gaurav
Hey Kamal, What all config changes have you done to establish replication of external files and how have you disabled role reloading? On Wed, Jul 9, 2014 at 11:30 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi All, > > It was found that external file, which was getting replicate

Re: External File Field eating memory

2014-07-08 Thread Kamal Kishore Aggarwal
Hi All, It was found that external file, which was getting replicated after every 10 minutes was reloading the core as well. This was increasing the query time. Thanks Kamal Kishore On Thu, Jul 3, 2014 at 12:48 PM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > With the above replic

Re: External File Field eating memory

2014-07-03 Thread Kamal Kishore Aggarwal
With the above replication configuration, the eff file is getting replicated at core/conf/data/external_eff_views (new dir data is being created in conf dir) location, but it is not getting replicated at core/data/external_eff_views on slave. Please help. On Thu, Jul 3, 2014 at 12:21 PM, Kamal K

Re: External File Field eating memory

2014-07-02 Thread Kamal Kishore Aggarwal
Thanks for your guidance Alexandre Rafalovitch. I am looking into this seriously. Another question is that I facing error in replication of eff file This is master replication configuration: core/conf/solrconfig.xml > > commit > startup > ../data/external_eff_view

Re: External File Field eating memory

2014-07-02 Thread Shalin Shekhar Mangar
This might be related: https://issues.apache.org/jira/browse/SOLR-3514 On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi Team, > > I have recently implemented EFF in solr. There are about 1.5 lacs(unsorted) > values in the external file. After this imp

Re: External File Field eating memory

2014-07-02 Thread Alexandre Rafalovitch
How would we know where the problem is? It's your custom implementation. And it's your own documents, so we don't know field sizes/etc. And it's your own metric (ok, Indian metric, but lacs are fairly unknown outside of India). Seriously though, have you tried using any memory profilers and runnin

Re: External File Field eating memory

2014-07-02 Thread Kamal Kishore Aggarwal
Any replies ?? On Sat, Jun 28, 2014 at 5:34 PM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi Team, > > I have recently implemented EFF in solr. There are about 1.5 > lacs(unsorted) values in the external file. After this implementation, the > server has become slow. The solr query

Re: External File Field

2013-12-17 Thread Mukundaraman valakumaresan
Hi it works, thanks a lot. Regards Mukund On Tue, Dec 17, 2013 at 5:20 PM, Ahmet Arslan wrote: > Hi, > > I see that you defined fieldType correctly. However you need to a field of > that type too. > > > > > Your file name should be external_adjlocality.txt > > With above configuration everyt

Re: External File Field

2013-12-17 Thread Ahmet Arslan
Hi, I see that you defined fieldType correctly. However you need to a field of that type too. Your file name should be external_adjlocality.txt With above configuration everything should work. Verify it by q=*:*&fl=*,field(adjlocality) On Tuesday, December 17, 2013 9:02 AM, Mukundarama

Re: External File Field

2013-12-17 Thread Ahmet Arslan
Can you send us your schema.xml file? On Tuesday, December 17, 2013 9:02 AM, Mukundaraman valakumaresan wrote: Hi http://localhost:8983/solr/collection1/select?wt=json&omitHeader=on&indent=true&defType=edismax&fl=id,property_price_max,locality,property_price_min,field(adjlocality)&q=*:*

Re: External File Field

2013-12-16 Thread Mukundaraman valakumaresan
Hi http://localhost:8983/solr/collection1/select?wt=json&omitHeader=on&indent=true&defType=edismax&fl=id,property_price_max,locality,property_price_min,field(adjlocality)&q=*:*

Re: External File Field

2013-12-16 Thread Ahmet Arslan
Hi, You can request the value of the that field via fl=*,field(adjlocality) See more about it :  https://cwiki.apache.org/confluence/display/solr/Working+with+External+Files+and+Processes Actually you can search it too with frange query parser. {!frange l=0 u=0}field(adjlocality) On Monday,

Re: External File field Reload option

2013-11-19 Thread Mikhail Khludnev
Aditya, If you commit, docnums are supposed to be changed, hence the file should be reloaded. There might be few alternative approaches to address this problem, but they are really bloody hacks, you know. Hold on, if docs are pushed in few hours, but file is changed daily, can't you mix that b

Re: external file field and fl parameter

2013-07-17 Thread Chris Hostetter
: reference to a few "special" values, such as "id" and "score". Neither : of them are technically "stored" fields either, but afaik you dont need : to use "field(id), field(score)" for those. Can you honestly say that : is consistent? Nope. I wasn't defending the quirks of the API, or tryi

Re: external file field and fl parameter

2013-07-17 Thread Chris Collins
Chris, the confusion from my perspective is the general inconsistency and natural growth of the API which is somewhat expected based upon its history. Obviously this isnt sql, there is no ansi body defining the query language. I understand well the difference between stored, indexed etc. Goin

Re: external file field and fl parameter

2013-07-17 Thread Chris Hostetter
: Yes that worked, thanks Alan. The consistency of this api is "challenging". It's important to understand what's happening here. fl, by default, only returns "stored" fields -- but you can also request "psuedo-fields" such as the results of functions, or the result of a "Doc Transformer" ...

Re: external file field and fl parameter

2013-07-14 Thread Chris Collins
Yes that worked, thanks Alan. The consistency of this api is "challenging". C On Jul 14, 2013, at 11:03 AM, Alan Woodward wrote: > Hi Chris, > > Try wrapping the field name in a field() function in your fl parameter list, > like so: > fl=field(eff_field_name) > > Alan Woodward > www.flax.co.

Re: external file field and fl parameter

2013-07-14 Thread Alan Woodward
Hi Chris, Try wrapping the field name in a field() function in your fl parameter list, like so: fl=field(eff_field_name) Alan Woodward www.flax.co.uk On 14 Jul 2013, at 18:41, Chris Collins wrote: > Why would I be re-indexing an external file field? The whole purpose is that > its brought in

Re: external file field and fl parameter

2013-07-14 Thread Chris Collins
Why would I be re-indexing an external file field? The whole purpose is that its brought in at runtime and not part of the index? C On Jul 14, 2013, at 10:13 AM, Shawn Heisey wrote: > On 7/14/2013 7:05 AM, Chris Collins wrote: >> Yep I did switch on stored=true in the field type. I was able to

Re: external file field and fl parameter

2013-07-14 Thread Shawn Heisey
On 7/14/2013 7:05 AM, Chris Collins wrote: > Yep I did switch on stored=true in the field type. I was able to confirm a > few ways that there are values for the eff by two methods: > > 1) changing desc to asc produced drastically different results. > > 2) debugging FileFloatSource the following

Re: external file field and fl parameter

2013-07-14 Thread Chris Collins
Yep I did switch on stored=true in the field type. I was able to confirm a few ways that there are values for the eff by two methods: 1) changing desc to asc produced drastically different results. 2) debugging FileFloatSource the following was getting triggered filling the vals array:

Re: external file field and fl parameter

2013-07-14 Thread Erick Erickson
Did you store the field? I.e. set stored="true"? And does the EFF contain values for the docs you're returning? Best Erick On Sun, Jul 14, 2013 at 3:32 AM, Chris Collins wrote: > I am playing with external file field for sorting. I created a dynamic field > using the ExternalFileField type. >

Re: external file field partial data match in key field

2011-09-26 Thread abhayd
i found answer to my question .. basically it works only with complete match.. -- View this message in context: http://lucene.472066.n3.nabble.com/external-file-field-partial-data-match-in-key-field-tp3368547p3371328.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: External File Field

2011-08-01 Thread Yonik Seeley
On Mon, Aug 1, 2011 at 11:16 AM, Mark wrote: > We have around 10million documents that are in our index and about 10% of > them have some extra "statistics" that are calculated on a daily basis which > are then index and used in our function queries. This reindexing comes at > the expense of doing