[
https://issues.apache.org/jira/browse/SOLR-13888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972069#comment-16972069
]
Mark Miller commented on SOLR-13888:
------------------------------------
Let me drop a little more for old times sake:
I like to run this to monitor my machine on linux:
dstat -cdngymprl
dstat -tcp
The first I might change up a bit, the second is for like, are reusing
connections, are a ton in close_wait, tcp blah blah
The first is like global resource monitoring. And I run Solr tests on 16 cores,
32 hyper threaded, so I run often with like 12-18 JVMs or more and I watch that
graph - and with master, it should be an utter mess of a graph. Lots of idle
cpu, lots of blocking, perhaps lots of paging, not many tasks running at once,
lots of tasks blocked, bad load, etc, etc
I work until by the time I'm done, thats all butter, all the way through the
tests. No real idle. No paging. like 50 running tasks usually hardly any ever
blocking. Thats so doable, and so sweet. And thats how you go like 5 minutes
for Solr tests.
The thing is, I was making great improvements and not getting lower. And thats
when I started finding some real bottlenecks. But this thing can tests as fast
or faster than Lucene's :) Holy shit surprise. I can't wait till you show me.
> SolrCloud 2
> -----------
>
> Key: SOLR-13888
> URL: https://issues.apache.org/jira/browse/SOLR-13888
> Project: Solr
> Issue Type: Task
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Mark Miller
> Assignee: Mark Miller
> Priority: Major
> Attachments: solrscreen.png
>
>
> As devs discuss dropping the SolrCloud name on the dev list, here is an issue
> titled SolrCloud 2.
> A couple times now I've pulled on the sweater thread that is our broken
> tests. It leads to one place - SolrCloud is sick and devs are adding spotty
> code on top of it at a rate that will lead to the system falling in on
> itself. As it is, it's a very slow, very inefficient, very unreliable, very
> buggy system.
> This is not why I am here. This is the opposite of why I am here.
> So please, let's stop. We can't build on that thing as it is.
>
> I need some time, I lost a lot of work at one point, the scope has expanded
> since I realized how problematic some things really are, but I have an
> alternative path that is not so duct tape and straw. As the building climbs,
> that foundation is going to kill us all.
>
> This i not about an architecture change - the architecture is fine. The
> implementation is broken and getting worse.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
