Re: solr 7 optimize with Tlog/Pull replicas

2019-03-13 Thread Aroop Ganguly
gments=1 >>>>>> >>>>>> Best, >>>>>> Wei >>>>>> >>>>>> >>>>>> On Fri, Mar 8, 2019 at 12:29 PM Erick Erickson >>>> >>>>>> wrote: >>>>>> >>>>>>> This is very odd for at least two reasons: >>>>>>> >>>>>>> 1> TLOG replicas shouldn’t optimize on the follower. They should >>>> optimize >>>>>>> on the leader then replicate the entire index to the follower. >>>>>>> >>>>>>> 2> As of Solr 7.5, optimize should not optimize to a single segment >>>>>>> _unless_ that segment is < 5G. See LUCENE-7976. Or you explicitly set >>>>>>> numSegments on the optimize command. >>>>>>> >>>>>>> So if you can reliably reproduce this, it’s probably worth a JIRA…... >>>>>>> >>>>>>>> On Mar 8, 2019, at 11:21 AM, Wei wrote: >>>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> RecentIy I encountered a strange issue with optimize in Solr 7.6. The >>>>>>> cloud >>>>>>>> is created with 4 shards with 2 Tlog replicas per shard. After batch >>>>>>> index >>>>>>>> update I issue an optimize command to a randomly picked replica in the >>>>>>>> cloud. After a while when I check, all the non-leader Tlog replicas >>>>>>>> finished optimization to a single segment, however all the leader >>>>>>> replicas >>>>>>>> still have multiple segments. Previously inn the all NRT replica >>>>>>> cloud, I >>>>>>>> see optimization is triggered on all nodes. Is the optimization >>>> process >>>>>>>> different with Tlog/Pull replicas? >>>>>>>> >>>>>>>> Best, >>>>>>>> Wei >>>>>>> >>>>>>> >>>> >>>> >> >

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-13 Thread Erick Erickson
>>> >>>>>> 1> TLOG replicas shouldn’t optimize on the follower. They should >>> optimize >>>>>> on the leader then replicate the entire index to the follower. >>>>>> >>>>>> 2> As of Solr 7.5, optimize should not optimize to a single segment >>>>>> _unless_ that segment is < 5G. See LUCENE-7976. Or you explicitly set >>>>>> numSegments on the optimize command. >>>>>> >>>>>> So if you can reliably reproduce this, it’s probably worth a JIRA…... >>>>>> >>>>>>> On Mar 8, 2019, at 11:21 AM, Wei wrote: >>>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> RecentIy I encountered a strange issue with optimize in Solr 7.6. The >>>>>> cloud >>>>>>> is created with 4 shards with 2 Tlog replicas per shard. After batch >>>>>> index >>>>>>> update I issue an optimize command to a randomly picked replica in the >>>>>>> cloud. After a while when I check, all the non-leader Tlog replicas >>>>>>> finished optimization to a single segment, however all the leader >>>>>> replicas >>>>>>> still have multiple segments. Previously inn the all NRT replica >>>>>> cloud, I >>>>>>> see optimization is triggered on all nodes. Is the optimization >>> process >>>>>>> different with Tlog/Pull replicas? >>>>>>> >>>>>>> Best, >>>>>>> Wei >>>>>> >>>>>> >>> >>> >

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-13 Thread Aroop Ganguly
e on the follower. They should >> optimize >>>>> on the leader then replicate the entire index to the follower. >>>>> >>>>> 2> As of Solr 7.5, optimize should not optimize to a single segment >>>>> _unless_ that segment is < 5G

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-12 Thread Wei
ess_ that segment is < 5G. See LUCENE-7976. Or you explicitly set > >>> numSegments on the optimize command. > >>> > >>> So if you can reliably reproduce this, it’s probably worth a JIRA…... > >>> > >>>> On Mar 8, 2019, at 11:21 AM,

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-11 Thread Erick Erickson
;>> >>>> On Mar 8, 2019, at 11:21 AM, Wei wrote: >>>> >>>> Hi, >>>> >>>> RecentIy I encountered a strange issue with optimize in Solr 7.6. The >>> cloud >>>> is created with 4 shards with 2 Tlog replicas

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-10 Thread Wei
cloud >> > is created with 4 shards with 2 Tlog replicas per shard. After batch >> index >> > update I issue an optimize command to a randomly picked replica in the >> > cloud. After a while when I check, all the non-leader Tlog replicas >> > finished optimization to a single segment, however all the leader >> replicas >> > still have multiple segments. Previously inn the all NRT replica >> cloud, I >> > see optimization is triggered on all nodes. Is the optimization process >> > different with Tlog/Pull replicas? >> > >> > Best, >> > Wei >> >>

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-10 Thread Wei
all the non-leader Tlog replicas > > finished optimization to a single segment, however all the leader > replicas > > still have multiple segments. Previously inn the all NRT replica cloud, > I > > see optimization is triggered on all nodes. Is the optimization process > > different with Tlog/Pull replicas? > > > > Best, > > Wei > >

Re: solr 7 optimize with Tlog/Pull replicas

2019-03-08 Thread Erick Erickson
licas > still have multiple segments. Previously inn the all NRT replica cloud, I > see optimization is triggered on all nodes. Is the optimization process > different with Tlog/Pull replicas? > > Best, > Wei

solr 7 optimize with Tlog/Pull replicas

2019-03-08 Thread Wei
finished optimization to a single segment, however all the leader replicas still have multiple segments. Previously inn the all NRT replica cloud, I see optimization is triggered on all nodes. Is the optimization process different with Tlog/Pull replicas? Best, Wei

TLOG+Pull replicas

2019-02-02 Thread Omar Tamer
Hi, I have a collection with 2 TLOG and 6 PULL replicas. When one of the pull nodes dies and is replaced with a new instance. It is being replaced by an NRT replica in the collection (the desired action is to be replaced by a PULL replica). collection is being created by collections?action=CREA