Re: copy field

You are right Eric. But range facet does not have support for limit, offset and sort. Thanks, Anil On 13 July 2018 at 19:32, Erick Erickson wrote: > Consider a range facet where you specify a start date, end date and "gap". > The "date math" bits allow you to specify gaps like +1HOUR, +1DAY etc

Re: copy field

Consider a range facet where you specify a start date, end date and "gap". The "date math" bits allow you to specify gaps like +1HOUR, +1DAY etc. https://lucene.apache.org/solr/guide/7_4/faceting.html Best, Erick On Fri, Jul 13, 2018 at 3:39 AM, Andrea Gazzarini wrote: > You're welcome, > but k

Re: copy field

You're welcome, but keep in mind what Erik said: it seems you don't need that information at "view" level so maybe with range faceting you could get what you need without creating additional (and redundant) fields. Andrea Il ven 13 lug 2018, 07:04 Anil ha scritto: > Thanks Andrea. i will write

Re: copy field

Thanks Andrea. i will write update processor in index pipe line. I feel this is very good feature to support. Thanks, Anil On 12 July 2018 at 22:59, Andrea Gazzarini wrote: > Hi Anil, > The copy Field directive is not what you're looking for because it doesn't > change the stored value of a fi

Re: copy field

HI Eric, i have a schema with a date field (tweetedDate) with 10-23-2017 10:15:00 format. Same schema is used with number of collections. i have to index the date field with different formats in different collections. lets says collections as collection-day, collection-hour, etc if the date fie

Re: copy field

Gus, Perhaps you might try the technique described in the forwarded exchange below.  It has been working very nicely for me. Terry Forwarded Message Subject:Re: Changing Field Assignments Date: Tue, 12 Jun 2018 12:21:16 +0900 From: Yasufumi Mizo

Re: copy field

XY question not withstanding, this is exactly the sort of thing one might want to do in their indexing pipeline. For example: https://github.com/nsoft/jesterj/blob/master/code/ingest/src/main/java/org/jesterj/ingest/processors/SimpleDateTimeReformatter.java On Thu, Jul 12, 2018 at 1:34 PM, Erick

Re: copy field

This seems like an XY problem, you've asked how to do X without explaining _why_ (the Y). If this is just because you want to search the field without having to specify the full string, consider a DateRangeField. Best, Erick On Thu, Jul 12, 2018 at 10:22 AM, Anil wrote: > HI, > > i have a date

Re: copy field

Hi Anil, The copy Field directive is not what you're looking for because it doesn't change the stored value of a field. What you need is an Update Request Processor, which is a kind of interceptor in the indexing chain (i.e. It allows you to change an incoming document before it gets indexed). Unf

Re: Copy field on dynamic fields?

: Have you tried reading existing example schemas? They show various : permutations of copy fields. Hmm... as the example schema's have been simplified/consolidated/purged it seems we have lost the specific examples that are relevant to the users question -- the only instance of a glob'ed copyF

Re: Copy field on dynamic fields?

Have you tried reading existing example schemas? They show various permutations of copy fields. Regards, Alex On Thu, Apr 5, 2018, 2:54 AM jatin roy, wrote: > Any update? > > From: jatin roy > Sent: Tuesday, April 3, 2018 12:37 PM > To: solr-user@lucene.apac

Re: Copy field on dynamic fields?

Any update? From: jatin roy Sent: Tuesday, April 3, 2018 12:37 PM To: solr-user@lucene.apache.org Subject: Copy field on dynamic fields? Hi, Can we create copy field on dynamic fields? If yes then how it decide which field should be copied to which one? For exam

Re: Copy field and regex

On 12/8/2017 1:03 PM, Erick Erickson wrote: Second, grouping works fine in distributed mode with a couple of restrictions, see the reference guide. Collapse/Expand (an alternative to standard grouping) requires that all the members of a group be on the same shard. In 5.x, distributed grouping s

Re: Copy field and regex

Grouping does _not_ require docValues, it's just that the with docValues=false, uninverted structure is built on the heap at run time. When docValues=true, the uninverted structure is written to disk at index time and MMapped into the OS's memory space rather than the Java heap. Second, grouping w

Re: Copy field and regex

Ah, thank you Erick & Shawn. That makes perfect sense. And yes when this goes to prod it will be distributed. Good point about docValues and needing a single shard, thanks! I’m new to result grouping, so I’m still prototyping that it will work for what I need. On 12/8/17, 12:00 PM, "Erick Erick

Re: Copy field and regex

I think you're getting confused by seeing the _stored_ data rather than the indexed data. When you return fields in documents, you get the stored data which is a verbatim copy of the input, no analysis done at all. To see what's in the index (and thus what would be grouped on) look at: adminUI>>an

Re: Copy field and regex

On 12/8/2017 9:56 AM, Bradley Belyeu wrote: > I’m wanting to do a result grouping by the first three characters, period, & > digit(s). For example, docs with the unique keys JHN.3.16 & JHN.3.17 I would > want grouped together. > So my thought was to define another field and then copy the USFM int

Re: Copy field from string to date

My apologies first for posting in the wrong forum as I thought they are internally using Solr and the the process is all same when it comes to filed mapping etc. And really appreciate your patience in assisting me. Thank you once again. -- View this message in context: http://lucene.472066.n3.

Re: Copy field from string to date

It would have been very helpful if you'd mentioned Fusion earlier. Fusion is a Lucidworks product, not something the Solr community can be expected to troubleshoot. I suggest you contact Lucidworks support for help with that. Best, Erick On Sun, Jul 30, 2017 at 11:56 AM, MKrishna wrote: > The a

Re: Copy field from string to date

The actual setup is : Lucid works Fusion 3.1.0 (installed on a Linux machine) is the latest upgrade we did for the search index from fusion 2.4.Also with 2.4 we had the schema less mode. Basically we are indexing the outlook files stored in a folder via smb as input to Lucid fusion. My applica

Re: Copy field from string to date

Version 3.1 of _what_? Certainly not Solr as schemaless is not in any 3x version of Solr. So it sounds like you changed some other part of your system. Can't help you there. And I do not recommend schemaless mode for production. Use it to find out what kinds of data you get, but then I'd advise yo

Re: Copy field from string to date

We are using the schema less mode trying to parse outlook(.msg) files in an smb. and I get to see the properties of the .msg file(date_created fields ) stored in dynamic fields date_Created_s and date_created_t. This change is seen only after upgrading the version to 3.1 as the older versions(2.0*

Re: Copy field from string to date

It's right there in the reference guide: https://cwiki.apache.org/confluence/display/solr/Copying+Fields But that's not what I was talking about, you've got it backwards What you haven't really told us is why the data is being sent to date_created in the first place. How are you parsing the fi

Re: Copy field from string to date

date_created field is being indexed as a string and text general making it difficult to apply date range queries date_created_s and date_created_t are the extensions and trying to copy them to *_tdate is throwing an error. "copyFields can take glob-type source specifications if that helps. " Can

Re: Copy field from string to date

bq: We want to use a copy field as a source for another copy field. As asked, this is not supported. You can copy the same source field to multiple copy fields however. copyFields can take glob-type source specifications if that helps. It would help if you gave concrete examples. You say "date c

Re: Copy field a source of copy field

I get your point, the second KeepWordFilter is not keeping anything because the token it gets is : "hey you" and the word is supposed to keep is "hey". Which does clearly not work. The KeepWordFilter just consider each row a single token ( I may be wrong, i didn't check the code, I am just asssumi

Re: Copy field a source of copy field

Je, I also think that!. We have some serious gaps on what you explain to me. First, you point me that there's no real need to use ShingleFilter, I tried with all Tokenizer and the result is the same, the species are not caught. On the simplest scenario I've got this: PUT YOUR FAVORI

Re: Copy field a source of copy field

Yep, we're not communication ;) Use the original source field for the genus, as: The difficulty here is that there might be false hits if the genera names happen to match words in the input that are not part of a genus/species pair. On Thu, Jul 20, 2017 at 9:55 AM, tstusr wrote: > Well, co

Re: Copy field a source of copy field

Well, correct me if I'm wrong. Your suggestion is to use species field as a source of genus field. We try with this Where species work as described and genus just use a KWF, like this: But now, the problem now is different. When we try the

Re: Copy field a source of copy field

OK, you'll need two fields pretty much for certain. The trick is getting _only_ genus names in the genus field. The simplest thing to do would be a straight copyField with a single keep word filter that contains a list of all the genera. That presupposes that the genera are disjoint sets from all

Re: Copy field a source of copy field

Well, our documents consist on pdf files (between 20 to 200 pages). So, we catch words of all the file, for that, we use the extract handler, that's why we have this fields: We catch species in all the pdf content (On attr_content field) Species captured are used for ranking purposes. So, w

Re: Copy field a source of copy field

OK, I take it back. Keepwords handle multiple words just fine. So I have to rewind. I'm having no trouble at all applying multiple, successive keepwords filters, even when there are multiple words on a single line in the keepwords file. Your use of shingles in here is probably going to confuse thi

Re: Copy field a source of copy field

Well, for me it's kind of strange because it's working only with words that have blank spaces. It seems that maybe I'm not explaining well. My field is defined as follows: We have 2 KWF files, "species" and

Re: Copy field a source of copy field

Multiple keyword files work just fine for me. one issue you're having is that multi-word keepwords aren't going to do what you expect. The analysis chains work on _tokens_, and only see one at a time. Plus (apparently) the input is broken up on whitespace (the docs aren't entirely clear on this, b

Re: Copy field a source of copy field

Well, I have no idea why that images display as did. The correct order is: Field chain analyzer. KWF-genus file Test output.

Re: Copy field a source of copy field

It seems that is just taking the last file of keep words. Now for control purposes, I have in genus file: And just is takin

Re: Copy field a source of copy field

The code is very simple, it looks at a quick glance like it just reads the words in then the "accept" method just returns true or false based on whether the text file contains the token. Are you sure you reloaded your core/collection and pushed the changed schema to the right place? The admin/anal

Re: Copy field a source of copy field

Ok, I know shingling will join with "_". But that is the behaviour we want, imagine we have this fields (contained in species file): abarema idiopoda abutilon bakerianum Those become in: abarema idiopoda abutilon bakerianum abarema_idiopoda abutilon_bakerianum But now in my genus file maybe i

Re: Copy field a source of copy field

On 7/17/2017 4:26 PM, tstusr wrote: > We want to use a copy field as a source for another copy field or some kind > of post processing of a field. > As an example imagine we have on species > > abies durangensis > abies flinckii > > so, after post processing, we expect to have only > abies > > whi

Re: Copy field a source of copy field

In a word, "no". Copyfields are not chained together. I'm not at all sure what you're trying to accomplish with those filter chains anyway, By shingling _then_ doing the stopwords, you'll have some input like abies durangensis become abies abies_durangensis durangensis Then put that through your

Re: copy field source not working in solr schema.xml

Although what you pasted isn't the complete schema I guess you miss a wrote: > Error : > org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: > Could not load conf for core demo7: copyField dest :'i_member_id' is not an > explicit field and doesn't match a dynamicField.. S

Re: copy field from boolean to int

I already use this field elsewhere, so I don't want to change it's type. I did implement a UpdateRequestProcessor to copy from a bool to an int. This works, but even better would be to fix Solr so that I can use DocValues with boolean. So, I am going to try to get that working as well. On Tue, Mar

Re: copy field from boolean to int

Can you reindex? Just use 1,0. On Tue, Mar 17, 2015 at 6:08 PM, Chris Hostetter wrote: > > Can you open a jira to add docValues support for BoolField? ... i can't > think of any good reason not to directly support that in Solr for > BoolField ... seems like just an oversight that slipped through

Re: copy field from boolean to int

Can you open a jira to add docValues support for BoolField? ... i can't think of any good reason not to directly support that in Solr for BoolField ... seems like just an oversight that slipped through the cracks. For now, your best bet is probably to use an UpdateProcessor ... maybe 2 insta

Re: copy Field / postprocess Fields after analyze / dynamic analyzer config

Not that I know of, sorry. Best Erick On Fri, Feb 8, 2013 at 10:11 AM, Kai Gülzau wrote: > I there a way to postprocess a field after analyze? > > Saying postprocess I think of renaming, moving or appending fields. > > > Some more information: > > My schema.xml contains several language suffix

Re: Copy Field Question

Hello, I think you don't have that much tuning possiblities using only the schema.xml file. You will have to write some custom Java code (subclasses of UpdateRequestProcessor and UpdateRequestProcessorFactory), build a Java jar containing your custom code, put that jar in one of the path declared

Re: Copy Field Question

Thanks, Mark! Mark Miller schrieb: Its the pre-analyzed form thats copied. The field that its copied to will determine the analyzer/filters for that field. If you want to check out the code doing it, its in org.apache.solr.update.DocumentBuilder -- - Mark http://www.lucidimagination.com On M

Re: Copy Field Question

Its the pre-analyzed form thats copied. The field that its copied to will determine the analyzer/filters for that field. If you want to check out the code doing it, its in org.apache.solr.update.DocumentBuilder -- - Mark http://www.lucidimagination.com On Mon, Aug 3, 2009 at 8:12 AM, Chantal Ac

Re: Copy field : String Vs Text

Hi Timothy, In copyfield I used the name that was not part of the doc and matching to the dynamic text fieldType declaration. It worked. I searched on Q=gudactor:"xxx". It is able to search on actor with full text... thanks, Senthil On Fri, Apr 24, 2009 at 4:08 PM, Harsch, Timothy J. (

RE: Copy field : String Vs Text

I'd be curious to hear someone explain the mechanics of a String field. I'm not entirely sure but I believe a String field is not tokenized and thus only exact matches work. I think in your case you should be searching on your "name" field and faceting on the "actor" field. -Original Mess

Re: Copy Field and Dynamic Fields

On 3/5/06, Grant Ingersoll <[EMAIL PROTECTED]> wrote: > Can the copy field functionality be applied to dynamic fields? You're finding the weak points fast, Grant :-) copyField doesn't work with dynamic fields yet, but it seems like a good think to enable. copyField from a dynamic field to a norma