RE: solrcloud backup null pointer exeption

2019-07-26 Thread Will Martin
can you share: solr version? zookeeper ensemble type number of shards in the collection? distribution of shard replicas in the SolrCloud? from there the most obvious question is whether the stack trace is from the shard leader for the collection or the localhost; if they are not the same? There

SolrCloud BACKUP single shard collections

2019-07-15 Thread Will Martin
Hi. I have 8 collections in a 3 node SolrCloud: 6.3 Given the following scenario: 1. preferredleader REPLICAPROP for all collections on core_node2 2. zookeeper->overseer_elect->leader has core_node1 3. BACKUP command always writes to/using core_node1 ??? Notes: 1. all collections have exactl

Re: Discuss: virtual nodes in Solr

2019-06-28 Thread Will Martin
From: S G mailto:sg.online.em...@gmail.com>> Subject: Discuss: virtual nodes in Solr Date: June 28, 2019 at 8:04:44 PM EDT To: solr-user@lucene.apache.org Reply-To: solr-user@lucene.apache.org Hi, Has Solr tried to use vnodes

Re: Solr slave core corrupted and not replicating.

2019-06-05 Thread Will Martin
a bounce happens while that state exists?. (which is why we use solr/bin/stop or service stop) will martin On Wed, Jun 5, 2019 at 6:26 PM varma mahesh wrote: > ++solr-user@lucene.apache.org > > On Thu 6 Jun, 2019, 1:19 AM varma mahesh, wrote: > > > Hi Team, > >

Re: Cluster with no overseer?

2019-05-21 Thread Will Martin
there being anything particularly tricky about that with fusion , which means I can't remember what I did... or have it doc'd at home. ;-) Will Martin DEVOPS ENGINEER 540.454.9565 8609 WESTWOOD CENTER DR, SUITE 475 VIENNA, VA 22182 geturgently.com On Tue, May 21, 2019 at 11:40 PM W

Re: Cluster with no overseer?

2019-05-21 Thread Will Martin
Walter. Can I cross-post to zk-dev? Will MartinDEVOPS ENGINEER540.454.9565 urgently-email-logo Description: application/apple-msg-attachment 8609 WESTWOOD CENTER DR, SUITE 475VIENNA, VA 22182geturgently.com On May 21, 2019, at 9:26 PM, Will Martin <wmar...@urgent.ly> wrote:+1Will Martin

Re: Cluster with no overseer?

2019-05-21 Thread Will Martin
+1 Will Martin DEVOPS ENGINEER 540.454.9565 8609 WESTWOOD CENTER DR, SUITE 475 VIENNA, VA 22182 geturgently.com On Tue, May 21, 2019 at 7:39 PM Walter Underwood wrote: > ADDROLE times out after 180 seconds. This seems to be an unrecoverable > state for the cluster, so that is a

Re: Bad type on operand stack: SolrInputDocument not assignable to SolrDocumentBase

2019-01-28 Thread Will Martin
Hi Shawn: We are deployed across the globe in many regions with different use patterns.Spring-data-solr is front and center for us and has proven pretty darn stable. "There can be some very strange problems when trying to use SolrJ with Spring.”Could you expand on this, so that we might know what m

Re: [SECURITY] CVE-2018-8026: XXE vulnerability due to Apache Solr configset upload (exchange rate provider config / enum field config / TIKA parsecontext)

2018-07-04 Thread will martin
The cve id was reserved in April. The jira ticket 1 mo ago. Is this the first notice to this list? Thx On Wed, Jul 4, 2018, 12:56 PM Uwe Schindler wrote: > CVE-2018-8026: XXE vulnerability due to Apache Solr configset upload > (exchange rate provider config / enum field config / TIKA parseconte

Re: Solr Capacity Planning

2017-06-17 Thread Will Martin
derstand if there is any recommendation on how to size the > infrastructure and hardware requirements for Solr clusters. Also, what are > the best practices to consider during this setup. > > Thanks Seriously. Will Martin

Re: Solr performance on EC2 linux

2017-05-01 Thread Will Martin
Ubuntu 16.04 LTS - Xenial (HVM) Is this your Xenial version? On 5/1/2017 6:37 PM, Jeff Wartes wrote: > I tried a few variations of various things before we found and tried that > linux/EC2 tuning page, including: >- EC2 instance type: r4, c4, and i3 >- Ubuntu version: Xenial and Trust

Re: Solrj similarity setting

2017-01-22 Thread Will Martin
Farida: Can you define a dsl? (domain specific model). If you stand a RESTful api on the DSL, you can write a BM25F similarity, with conditionals maybe controlled by a func query accessing field payloads? :-) On 1/21/2017 6:13 AM, Markus Jelsma wrote: No, this is not possible. A similarity i

Re: CloudSolrStream can't set the setZkClientTimeout and setZkConnectTimeout properties

2017-01-19 Thread Will Martin
Default behavior. Client - Server negotiate 2/3 of min (max server, max client). This allows a client time to search for a new leader before all of its time consumed. zookeeper user @ apache org -will On 1/19/2017 12:59 PM, Yago Riveiro wrote: I can see some reconnects in my logs, the proc

Re: How to train the model using user clicks when use ltr(learning to rank) module?

2017-01-06 Thread Will Martin
to the other training data. What that equation is, will take some more effort i'm not sure this response is helpful at all, but i'm going to go with it because I recognize all of it from AOL, Microsoft and Comcast work. Before the days of ML in Search. On 1/5/2017 3:33 PM, Jeffer

Re: How to train the model using user clicks when use ltr(learning to rank) module?

2017-01-05 Thread Will Martin
k. Before the days of ML in Search. On 1/5/2017 3:33 PM, Jeffery Yuan wrote: Thanks , Will Martin. I checked the pdf it's great. but seems not very useful for my question: How to train the model using user clicks when use ltr(learning to rank) module. I know the concept after reading thes

Re: How to train the model using user clicks when use ltr(learning to rank) module?

2017-01-05 Thread Will Martin
http://www.dcc.fc.up.pt/~pribeiro/aulas/na1516/slides/na1516-slides-ir.pdf see the relevant sections for good info On 1/5/2017 3:02 AM, Jeffery Yuan wrote: > Thanks very much for integrating machine learning to Solr. > https://github.com/apache/lucene-solr/blob/f62874e47a0c790b9e396f58ef6f

Re: XFS or EXT4 on Amazon AWS AMIs

2016-12-22 Thread Will Martin
I'd like to see the MongoDB report(?). ext4fs design specifications includes support for large files via allocation placement. MongoDB, the last time I checked, does pre-allocation which gives it the performance benefit of ext4fs multiple design factors (Block and Inode Allocation Policy), but t

Re: SOLR vs mongdb

2016-11-23 Thread Will Martin
mongdb governance criticisms. and a recognition that OSS community is full of people trying new combinations, or old negated scenarios. so governance models have to be coded; Solr has such. This Lucene listserv serves that purpose, among other resources, in coaching work in a secure and best p

Re: Should zookeeper be run on the worker machines?

2016-11-23 Thread Will Martin
This is laughable; the so use case wording and the request here. imo of course. On 11/23/2016 11:00 AM, Tech Id wrote: > Hi, > > Can someone please respond to this zookeeper-for-Solr Stack-Overflow > question: http://stackoverflow.com/questions/40755137/should- > zookeeper-be-run-on-the-worker-m

Re: field set up help

2016-11-17 Thread Will Martin
don't give up yet kris. q={!prefix f=metatag.date}2016-10&debugQuery g'luck will On 11/17/2016 5:56 PM, Kris Musshorn wrote: This q={!prefix f=metatag.date}2016-10 returns zero records -Original Message- From: KRIS MUSSHORN [mailto:mussho...@comcast.net] Sent: Thursday, November 17, 2

Re: Is it possible to do pivot grouping in SOLR?

2016-11-17 Thread Will Martin
well, a quickly formulated query against some strange kind of endpoint... collapse and expand; with expand.sort look it up; its in the ref guide. On 11/17/2016 1:42 PM, bbarani wrote: > Is there a way to do pivot grouping (group within a group) in SOLR? > > We initially group the results by

Re: Keeping faster and slower solr slaves alined with the same index version

2016-11-11 Thread Will Martin
Csongor: If session locking is new to you, here is a comprehensive explanation of the "Active - Active multi-region" scenario you're encountering and how NetFlix resolves the matter. Although I remain confused by a 15 minute network transfer of non-optimized segments; or even if you are replic

RE: Solr java.lang.OutOfMemoryError: Java heap space

2015-09-28 Thread will martin
http://opensourceconnections.com/blog/2014/07/13/reindexing-collections-with-solrs-cursor-support/ -Original Message- From: Ajinkya Kale [mailto:kaleajin...@gmail.com] Sent: Monday, September 28, 2015 2:46 PM To: solr-user@lucene.apache.org; java-u...@lucene.apache.org Subject: Solr jav

RE: How to update SOLR schema from continuous integration environment

2014-11-02 Thread Will Martin
the field that will be removed, wait > for replication. > 3. Update the schema on the master and slaves. > > I have not tried to automate this for continuous deployment. It isn't > a big deal for a single server test environment. It is the prod > deployment that is

RE: How to update SOLR schema from continuous integration environment

2014-11-01 Thread Will Martin
ood wun...@wunderwood.org http://observer.wunderwood.org/ On Nov 1, 2014, at 7:29 AM, Will Martin wrote: > http://www.thoughtworks.com/insights/blog/enabling-continuous-delivery-enter prises-testing > > > -Original Message- > From: Jack Krupansky [mailto:j...@basetechno

RE: How to update SOLR schema from continuous integration environment

2014-11-01 Thread Will Martin
http://www.thoughtworks.com/insights/blog/enabling-continuous-delivery-enterprises-testing -Original Message- From: Jack Krupansky [mailto:j...@basetechnology.com] Sent: Saturday, November 01, 2014 9:46 AM To: solr-user@lucene.apache.org Subject: Re: How to update SOLR schema from contin

Re: exporting to CSV with solrj

2014-10-31 Thread will martin
"Why do you want to use CSV in SolrJ?" Alexandre are you looking for a design gig. This kind of question really begs nothing but disdain. Commodity search exists, not matter what Paul Nelson writes and part of that problem is due to advanced users always rewriting the reqs and specs of less experi

RE: Solr Memory Usage

2014-10-29 Thread Will Martin
Oops. My wording was poor. My reference to those who don't research the matter was pointing at a large number of engineers I have worked with; not this list. -Original Message- From: Will Martin [mailto:wmartin...@gmail.com] Sent: Wednesday, October 29, 2014 6:38 PM To: '

RE: Solr Memory Usage

2014-10-29 Thread Will Martin
This command only touches OS level caches that hold pages destined for (or not) the swap cache. Its use means that disk will be hit on future requests, but in many instances the pages were headed for ejection anyway. It does not have anything whatsoever to do with Solr caches. It also is not frag

RE: Sharding configuration

2014-10-28 Thread Will Martin
Informational only. FYI Machine parallelism has been empirically proven to be application dependent. See DaCapo benchmarks (lucene indexing and lucene searching) use in http://dx.doi.org/10.1145/2479871.2479901 " Parallelism profiling and wall-time prediction for multi-threaded applicat

RE: Log message "zkClient has disconnected".

2014-10-27 Thread Will Martin
Modassar: Can you share your hw setup? And what size are your batches? Can you make them smaller; it doesn't mean your throughput will necessarily suffer. Re Will -Original Message- From: Modassar Ather [mailto:modather1...@gmail.com] Sent: Tuesday, October 28, 2014 2:12 AM To: solr-

RE: unable to build solr 4.10.1

2014-10-27 Thread Will Martin
There is no Javadoc jar at that location. Does that help? -Original Message- From: Karunakar Reddy [mailto:karunaka...@gmail.com] Sent: Tuesday, October 28, 2014 2:41 AM To: solr-user@lucene.apache.org Subject: unable to build solr 4.10.1 Hi , I am getting below error while doing "ant d

RE: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of synch.

2014-10-27 Thread Will Martin
than the rate of requests from the incoming multiple threads. On Mon, Oct 27, 2014 at 7:09 PM, Will Martin wrote: > 2 naïve comments, of course. > > > > - Queuing theory > > - Zookeeper logs. > > > > From: S.L [mailto:simpleliving...@gmai

RE: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of synch.

2014-10-27 Thread Will Martin
t 27, 2014 at 7:09 PM, Will Martin wrote: > 2 naïve comments, of course. > > > > - Queuing theory > > - Zookeeper logs. > > > > From: S.L [mailto:simpleliving...@gmail.com] > Sent: Monday, October 27, 2014 1:42 PM > To: solr-user@luce

RE: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of synch.

2014-10-27 Thread Will Martin
2 naïve comments, of course. - Queuing theory - Zookeeper logs. From: S.L [mailto:simpleliving...@gmail.com] Sent: Monday, October 27, 2014 1:42 PM To: solr-user@lucene.apache.org Subject: Re: Heavy Multi-threaded indexing and SolrCloud 4.10.1 replicas out of synch.

RE: OpenExchangeRates.Org rates in solr

2014-10-26 Thread Will Martin
: OpenExchangeRates.Org rates in solr Hi Will, I am learning Solr now. I can use it later for business or for free access. Thank you. Regards Olivier 2014-10-26 17:32 GMT+01:00 Will Martin : > Hi Olivier: > > Can you clarify this message? Are you using Solr at the business? Or

RE: OpenExchangeRates.Org rates in solr

2014-10-26 Thread Will Martin
Hi Olivier: Can you clarify this message? Are you using Solr at the business? Or are you giving free access to solr installations? Thanks, Will -Original Message- From: Olivier Austina [mailto:olivier.aust...@gmail.com] Sent: Sunday, October 26, 2014 10:57 AM To: solr-user@lucene.apac

RE: How to properly use Levenstein distance with ~ in Java

2014-10-23 Thread Will Martin
In terms of recent work with edit-distance (specifically Levenshtein) and your expressed interest might find this paper provocative. "We measure the keyword similarity between two strings by lemmatizing them, removing stopwords, and computing the cosine similarity. We then include the keyword sim

RE: about Solr log file

2014-10-22 Thread Will Martin
Hi Lee: I'm returning to the Solr/Lucene community and haven't made it to Solr Clouds yet, but w reference to discrete servers If you put a logback configuration in place, you can with configuration alone and (my choice) gelf4j send each logging flow to a graylog2 server. In graylog2 you could cr