On 17-11-04 23:47:07, Landry Breuil wrote: > Hi, > > here's a WIP port for hindsight, > (http://mozilla-services.github.io/hindsight/) a 'C-based data > processing infrastructure pipeline' for log/metrics analysis and > distribution, akin to the ELK stack. It replaces 'heka' which was also a > mozilla too (see > https://mail.mozilla.org/pipermail/heka/2016-May/001059.html) > > So far i have it running in basic testing with hacks around, getting > system logs via udp input, or nginx access logfile parsing on the fly - > didnt try yet to output the messages to ES or something else. > > If ppl are interested in this topic/trying it, let me know.
I've heard of it and would like to play with it, didn't have a chance yet. I'll have a look, though I apologise in advance for my spotty and far between replies. > Im not sure > i'll pursue this, given that some stuff relies on linux stuff > (pthread_timedjoin_np) or inotify to reload config on the fly, > posix semaphores to notify threads... and i know nothing to lua porting > :) > > More info on how its used at mozilla: > https://docs.telemetry.mozilla.org/concepts/data_pipeline.html > > Landry
