[
https://issues.apache.org/jira/browse/SOLR-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159526#comment-17159526
]
Mark Robert Miller commented on SOLR-14636:
-------------------------------------------
!IMG_5575 (1).jpg!
Once I get all the tests in the 5-10 second or below range (5-10 seconds
becoming the long tail), debugging fails becomes a different ball game. You
quickly realize that sensible logging has been neglected though - its no wonder
given how the tests, especially on fails, spam out huge logs, most of it
unrelated to the test or anything but requests and updates up the wazzoo but
perhaps or perhaps not related to the fail. So with tricky corner cases left
and within striking distance, I first start coloring the logs - it helps me
parse them much quicker and see exceptions vs debug, etc. This is for running a
single test, not the suite. Reproduction gets easier as well, it doesn't count
so much on what crazy stuff is going on with other tests to tickle the
gremlins. On my branch the gremlins are not allowed in the none Nightly run.
All the tests must run in peaceful harmony together. They can play hunger games
in Nightly or some other mode. I've pretickled the gremlins and kicked them the
hell out.
But anyway, once you drop the insane update log flooding that we do to
ourselves out and you have these sub 10 second tests (including beforeclass and
afterclass and setup and teardown! the master branch tests spend most of their
time there spitting out logs), you start trying to debug more with the logs and
you realize key information is not there while a lot of crap is, and now that
you have this small little log file, it's much easier to start to make it more
helpful. And then as you do that, you realize a good thing when you see it and
you want to focus down even more on specific things - so I pre make debug
logging config files for different focuses and tasks - are you hunting close
leaks, shutdown bugs, overseer state updates, etc - in each case there is a
slightly different base setup that is nice to have ready to go and flip on and
off.
> Provide a reference implementation for SolrCloud that is stable and fast.
> -------------------------------------------------------------------------
>
> Key: SOLR-14636
> URL: https://issues.apache.org/jira/browse/SOLR-14636
> Project: Solr
> Issue Type: Task
> Reporter: Mark Robert Miller
> Assignee: Mark Robert Miller
> Priority: Major
> Attachments: IMG_5575 (1).jpg
>
>
> SolrCloud powers critical infrastructure and needs the ability to run quickly
> with stability. This reference implementation will allow for this.
> *location*: [https://github.com/apache/lucene-solr/tree/reference_impl]
> *status*: alpha
> *speed*: ludicrous
> *tests***:
> * *core*: {color:#00875a}*solid*{color} with *{color:#de350b}ignores{color}*
> * *solrj*: {color:#00875a}*solid*{color} with {color:#de350b}*ignores*{color}
> * *test-framework*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/analysis-extras*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/analytics*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/clustering*: {color:#00875a}*solid*{color} with
> *{color:#de350b}ignores{color}*
> * *contrib/dataimporthandler*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/dataimporthandler-extras*: {color:#00875a}*solid*{color} with
> *{color:#de350b}ignores{color}*
> * *contrib/extraction*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/jaegertracer-configurator*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/langid*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/prometheus-exporter*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> * *contrib/velocity*: {color:#00875a}*solid*{color} with
> {color:#de350b}*ignores*{color}
> _* Running tests quickly and efficiently with strict policing will more
> frequently find bugs and requires a period of hardening._
> _** Non Nightly currently, Nightly comes last._
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
