2013/2/28 Benjamin Smedberg <benja...@smedbergs.us> > On 2/28/2013 10:33 AM, Benoit Jacob wrote: > >> Please, please make your plans include the ability to get raw text files >> (CSV or JSON or something else, I don't care as long as I can easily parse >> it). >> > Could you be more specific? Note that while the text files currently > provided on crash-analysis, they are not the full dataset: they include a > limited and specific set of fields.
I know; but that's already plenty enough data to do many useful things. As to being more specific, here's an example of something I'm currently doing with CSV crash report dumps: http://people.mozilla.org/~bjacob/gfx_features_stats/ Obviously I would be very interested in the ability to do the same with Telemetry instead. Another example I mentioned above is bugzilla comments getting data from dumps; here's a link just to give an example: https://bugzilla.mozilla.org/show_bug.cgi?id=771774#c28 > It looks to me like telemetry payloads typically include many more fields, > and some of these are not single-value fields but rather more complex > histograms and such. Putting all of that into text files may leave us with > unworkably large text files. > Good point; so I suppose that that would support using JSON instead of CSV, as in Josh's second email in this thread, which I hadn't seen when I wrote this. > > Because the raw crash files do not include new metadata fields, this has > led to weird engineering practices like shoving interesting metadata into > the freeform app notes field, and then parsing that data back out later. > I'm worried about perpetuating this kind of behavior, which is hard on the > database and leads to very arcane queries in many cases. > I don't agree with the notion that freeform fields are bad. freeform plain text is an amazing file format. It allows to add any kind of data without administrative overhead and is still easy to parse (if the data was that was added was formatted with easy parsing in mind). But if one considers it a bad thing that people use it, then one should address the issues that are causing people to use it. As you mention, raw crash files may not include newer metadata fields. So maybe that can be fixed by making it easier or even automatable to include new fields in raw crash files? Related/similar conversation in https://bugzilla.mozilla.org/show_bug.cgi?id=641461 Benoit > > What is the current volume of telemetry pings per day? > > --BDS > > _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
