Re: Did /export use to emit tuples and now does not?

2017-07-05 Thread Ronald Wood
ssion that always uses the /export handler to sort and partition result sets. In 6x the search expression can be used with the qt=/export param to use the /export handler. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Jul 4, 2017 at 11:38 AM, Ronald Wood wrote:

Did /export use to emit tuples and now does not?

2017-07-04 Thread Ronald Wood
some more work as docValues aren’t the default when using the gettingstarted index. -Ronald Wood

Re: Custom FieldTypes

2017-03-22 Thread Ronald Wood
http://www.solr-start.com/ - Resources for Solr users, new and experienced On 22 March 2017 at 15:46, Ronald Wood wrote: > Thanks. I had seen that page but had passed it over since I don’t want to do de-duping (text fields with the exact same text are possible and not cause fo

Re: Custom FieldTypes

2017-03-22 Thread Ronald Wood
new and experienced On 22 March 2017 at 14:55, Ronald Wood wrote: > I suppose it could be, but the flexibility of using copy directives is appealing for handling multiple fields as defined in the schema. > > Since I have rarely looked at the UpdateRequestProcessor

Re: Custom FieldTypes

2017-03-22 Thread Ronald Wood
. -R On 3/22/17, 2:21 PM, "Alexandre Rafalovitch" wrote: Can this be done at the UpdateRequestProcessor stage? Regards, Alex On 22 Mar 2017 1:48 PM, "Ronald Wood" wrote: I have been mulling over the usefulness of a new Hash

Custom FieldTypes

2017-03-22 Thread Ronald Wood
I have been mulling over the usefulness of a new Hash field type for being able to validate data that is indexed but not stored. Basically, I’d use copy directives to copy all fields to be hashed to the new hash field and store a SHA-256 hash as a string. I’m still not sure how valuable it would

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-25 Thread Ronald Wood
custom build might be a partial patch. We’ll just have to see. - Ronald S. Wood On 8/25/16, 06:50, "Toke Eskildsen" wrote: Ronald Wood wrote: > Did you find you had to do a full conversion all at once because simply turning on > docvalues in the schema caused issu

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-25 Thread Ronald Wood
Alessandro, yes I can see how this could be conceived of as a more general problem; and yes useDocValues also strikes me as being unlike the other properties since it would only be used temporarily. We’ve actually had to migrate fields from one to another when changing types, along with awkward

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-24 Thread Ronald Wood
I created https://issues.apache.org/jira/browse/SOLR-9437 for the proposal below. I suppose beside feasibility, there’s the question of whether the change is needed by others. I’d love to hear if it meets anyone else’s needs. - Ronald S. Wood On 8/24/16, 15:08, "Ronald Wood" wrot

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-24 Thread Ronald Wood
enabled and finally you swap. Cheers On Wed, Aug 24, 2016 at 2:56 PM, Shawn Heisey wrote: > On 8/23/2016 2:01 PM, Ronald Wood wrote: > > In general, is there a way to migrate existing indexes (we have > petabytes of data) by enabling docvalues and increm

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-24 Thread Ronald Wood
does a bulk update of the status of 1 million records. ☺ - Ronald S. Wood On 8/24/16, 09:56, "Shawn Heisey" wrote: On 8/23/2016 2:01 PM, Ronald Wood wrote: > In general, is there a way to migrate existing indexes (we have petabytes of data) by enabling docvalues and inc

Re: Is it safe to upgrade an existing field to docvalues?

2016-08-24 Thread Ronald Wood
Solr schema enabling docValues 5) Point to the new converted index 6) Start Solr Am I right ? This is actually a useful tool when re-indexing could be extremely long. Cheers On Wed, Aug 24, 2016 at 12:05 PM, Toke Eskildsen wrote: > On Tue, 2016-08-23

Is it safe to upgrade an existing field to docvalues?

2016-08-23 Thread Ronald Wood
ng old 4.x indexes, and it would be wiser to first migrate the indexes to 5.x format before enabling docvalues? (We expect that would also take us a month using incremental optimize.) Can someone clarify what migration paths to docvalues are likely to succeed? Thanks! -Ronald Wood.

Re: Solr /export and dates (Solr 5.5.1)

2016-06-01 Thread Ronald Wood
d to add dates to the /export handler for date support in the Parallel SQL interface. Erick, if you're reading this, let us know if this is in the works. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Jun 1, 2016 at 8:15 PM, Ronald Wood mailto:rw...@smarsh.com>> wrote: I hav

Solr /export and dates (Solr 5.5.1)

2016-06-01 Thread Ronald Wood
I have spent a bit of time with the export handler in 5.5.1 (since we are unable to upgrade directly from 4 to 6). The speed looks impressive at first glance compared to paging with cursors. However, I am deeply confused that it does not seem to be possible to either sort on or get date values

Re: Distributed queries hang in a non-SolrCloud environment, Solr 4.10.4

2015-07-06 Thread Ronald Wood
-9967 (fax) www.smarsh.com <http://www.smarsh.com/> Immediate customer support: Call 1-866-762-7741 (x2) or visit www.smarsh.com/support <http://www.smarsh.com/support> On 7/3/15, 1:42 AM, "Shalin Shekhar Mangar" wrote: >On Fri, Jul 3, 2015 at 1:06 AM, Ronald Wo

Re: Distributed queries hang in a non-SolrCloud environment, Solr 4.10.4

2015-07-02 Thread Ronald Wood
m/support> On 7/2/15, 3:56 PM, "Ryan, Michael F. (LNG-DAY)" wrote: >Try running jstack on the aggregator - that will show you where the threads >are hanging. > >-Michael > >-Original Message- >From: Ronald Wood [mailto:rw...@smarsh.com] >Sent:

Distributed queries hang in a non-SolrCloud environment, Solr 4.10.4

2015-07-02 Thread Ronald Wood
We are running into an issue when doing distributed queries on Solr 4.10.4. We do not use SolrCloud but instead keep track of shards that need to be searched based on date ranges. We have been running distributed queries without incident for several years now, but we only recently upgraded to