[
https://issues.apache.org/jira/browse/SOLR-14130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17008973#comment-17008973
]
Erick Erickson commented on SOLR-14130:
---------------------------------------
[~jbernste] I took a quick look at the patch and it looks great. There are two
things I might suggest:
1> A short note on how to set up the collection you index to, mostly just the
configset you should use (_default I assume, one shard no replicas?).
2> When I was playing around with this concept I found it useful to have the
option of a "batch" parameter to allow me to group runs, in this case maybe
default to the directory specified "/user/foo/logs". I can easily see wanting
to restrict searches to "baseline", "change1" etc., not to mention deleting all
the logs indexed for a particular batch when no longer relevant while keeping
those that are. Or maybe just use the directory specified and encourage users
to put different runs (or whatever) in different dirs.
There are a number of refinements that I was playing around with for
experimenting, one in particular (that can wait for later) is being able to
facet on the first recognizable line in the exceptions. "recognizable" might be
a line that mentions "org.apache.solr" or "org.apache.lucene". Then when I
facet on it and see 2,500 exceptions generated by the query parser, I can skip
them easily... But that's for later and only really useful when there's a UI
around it.
Now if we just had a UI around this for arbitrary searches ;)
> Add postlogs command line tool for indexing Solr logs
> -----------------------------------------------------
>
> Key: SOLR-14130
> URL: https://issues.apache.org/jira/browse/SOLR-14130
> Project: Solr
> Issue Type: Task
> Security Level: Public(Default Security Level. Issues are Public)
> Reporter: Joel Bernstein
> Assignee: Joel Bernstein
> Priority: Major
> Attachments: SOLR-14130.patch, SOLR-14130.patch, SOLR-14130.patch,
> SOLR-14130.patch, SOLR-14130.patch, SOLR-14130.patch, SOLR-14130.patch,
> Screen Shot 2019-12-19 at 2.04.41 PM.png, Screen Shot 2019-12-19 at 2.16.01
> PM.png, Screen Shot 2019-12-19 at 2.35.41 PM.png, Screen Shot 2019-12-21 at
> 8.46.51 AM.png
>
>
> This ticket adds a simple command line tool for posting Solr logs to a solr
> index. The tool works with the out of the box Solr log format. Still a work
> in progress but currently indexes:
> * queries
> * updates
> * commits
> * new searchers
> * errors - including stack traces
> Attached are some sample visualizations using Solr Streaming Expressions and
> Math Expressions after the data has been loaded. The visualizations show:
> time series, scatter plots, histograms and quantile plots, but really this is
> just scratching the surface of the visualizations that can be done with the
> Solr logs.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org
For additional commands, e-mail: issues-h...@lucene.apache.org
