Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-24 Thread Arnaud Clère
Hi, Regarding ETW, I found this blog post interesting as they are pursuing very similar goals wrt to convenience of trace analysis vs performance of tracing: https://blogs.msdn.microsoft.com/vancem/2015/09/20/rich-payload-data-in-eventsource-v4-6/ It points to a slightly more detailed explanation

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-18 Thread Arnaud Clère
Hi Christian, Thanks for the pointers regarding LTT and the underlying Common Trace Format, that was very informative. The fact that CTF supports variants and dynamically sized structures makes it a possible output for modmedLog, as is IETF's Compressed Binary Object Representation. What is not

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-14 Thread Christian Gagneraud
On 12 October 2017 at 10:10, Arnaud Clère wrote: > Regarding the ParTraP language, currently, you need to parse, transform and > classify > unstructured traces in a JSON form to be able to use it. JSON will remain the > pivot format > between trace stores and tools so, if ETW or whatever native

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-11 Thread Christian Gagneraud
On 11 October 2017 at 21:20, Christian Gagneraud wrote: > In the kernel mode case, you access the events from /proc, which is > backed by a kernel RCU list/buffer, i don't know how they have > implemented their userspace solution, but i'm expecting something > "pretty well done". Interesting, on

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-11 Thread Arnaud Clère
ginal Message- From: Christian Gagneraud [mailto:chg...@gmail.com] Sent: mercredi 11 octobre 2017 10:21 To: Thiago Macieira Cc: development@qt-project.org Subject: Re: [Development] QtCS 2017 logging/tracing session notes Hi, Going through the wiki, the pdf and the codereview again, i see 3 differ

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-11 Thread Christian Gagneraud
Hi, Going through the wiki, the pdf and the codereview again, i see 3 different things: - Qt: Logging framework - ModMed: real-time dissection of organised/structured logs - Ltt/ETW: event tracing/profiling Different needs, different means, different reasons and different goals. I like all 3! ;)

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Sze Howe Koh
On 11 October 2017 at 03:49, Thiago Macieira wrote: > > On Tuesday, 10 October 2017 20:18:42 CEST Mat Sutcliffe wrote: > > On 10 October 2017 at 15:28, Thiago Macieira > > > > wrote: > > > On Tuesday, 10 October 2017 15:12:52 CEST Christian Gagneraud wrote: > > > > (PS: I don't even know if qDebu

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Thiago Macieira
On Tuesday, 10 October 2017 20:18:42 CEST Mat Sutcliffe wrote: > On 10 October 2017 at 15:28, Thiago Macieira > > wrote: > > On Tuesday, 10 October 2017 15:12:52 CEST Christian Gagneraud wrote: > > > (PS: I don't even know if qDebug streaming is lock-free and i'm > > > interested to know the answ

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Mat Sutcliffe
On 10 October 2017 at 15:28, Thiago Macieira wrote: > On Tuesday, 10 October 2017 15:12:52 CEST Christian Gagneraud wrote: > > > (PS: I don't even know if qDebug streaming is lock-free and i'm > > interested to know the answer:)) > > It's not. There are mutexes inside. > The SO answer and its co

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Thiago Macieira
On Tuesday, 10 October 2017 15:12:52 CEST Christian Gagneraud wrote: > On 10 October 2017 at 22:48, Thiago Macieira wrote: > > do not change qdebug but provide structured tracing as a new facility > > Any chance this can be made lock-free from a caller point of view? No, we cannot provide a loc

Re: [Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Christian Gagneraud
On 10 October 2017 at 22:48, Thiago Macieira wrote: > do not change qdebug but provide structured tracing as a new facility Any chance this can be made lock-free from a caller point of view? (PS: I don't even know if qDebug streaming is lock-free and i'm interested to know the answer:)) A lock-fr

[Development] QtCS 2017 logging/tracing session notes

2017-10-10 Thread Thiago Macieira
== Discussion == * Structured logging: ** We want to extract information from logs and detect common messages. For example: {| ! From ! To |- | Got message "Hello" | Got message "%s" Hello |- | Got message "World" | Got message "%s" World |} ** We want to al