Tomorrow morning we will be changing how Treeherder gets data from Task Cluster.
tl;dr — No action required on your part. We are changing some things under the hood, but everything should look the same. More Info ======= Greg Arndt, Jonas Jensen and I have been working on using Pulse to get results to Treeherder rather than Task Cluster posting directly to the Treeherder APIs. This will mean simpler data ingestion with better validation. Huge thanks to Jonas Jensen who came up with the scheme for this in the first place and helped me get rolling on it. Also huge thanks to Greg who’s done a ton of fantastic work on the Task Cluster side of this. We will take this live tomorrow, July 7th around 10am. What’s going to happen? ================= The new Fancy-Pants <taskcluster-treeherder> app that Greg wrote has already been posting messages to pulse exchanges for both stage and production. But Treeherder-prod hasn’t been listening. We will turn on Treeherder-prod’s Fancy-Pants ``read_pulse_jobs`` process. Then push a change to the Old-Pants <mozilla-taskcluster> app that will make it stop posting jobs to Treeherder’s API. You shouldn’t notice anything, but in the unlikely event that you DO, please chime in on #treeherder and check in with :camd (me) or :garndt. We’ve been testing this on Treeherder-staging for a month or so and it’s been working great. We hope to continue that trend on prod. :) Other benefits ========== 1. Other tools can now post data to their own Pulse exchanges, register them with Treeherder, and we will pick that data up. Please submit a bug to Treeherder with your exchange information and we will get you set up. 2. The submission data will be validated against a JSON-schema <https://github.com/mozilla/treeherder/blob/master/schemas/pulse-job.yml> to take the guess-work out of submitting to Treeherder. You should validate your own data prior to submission to your exchange. 3. Folks playing with Treeherder on your local Vagrant instance can now use the read_pulse_jobs management command to ingest Task Cluster data as well as BuildBot. The docs for this are at: https://treeherder.readthedocs.io/pulseload.html Please let me or Greg Arndt know if you have any questions. Thanks heaps! :) -Cam P.S. - Here’s a blog post I wrote about it in the early-stages of planning this: https://cheshirecam.wordpress.com/2015/09/30/treeherder-loading-data-from-pulse/ It’s mostly still true. _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
