Hi, I've been digging around a bit more and I think I have an idea to help narrow the conditions in which I'm seeing this error.
I re-configured a test box to output the report to disk and to PuppetDB so I
was able to compare the data sent.
I see a correlation between time metrics stored a Ruby.BigNumber and all the
failed metrics when trying store the report in PuppetDB. Since the metrics
values with differ from run to run, it could be possible to have runs which
are able to be stored without this specific error.
A summary comparison table is available in the attachment
reports-errors-summary.tsv.
To produce this I took the error line from the PuppetDB log
(report-puppetdb_error.log)
where traceback lists details of "value does not match schema"
:cause "Value does not match schema: {:metrics [nil nil nil nil nil nil nil
nil nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil nil]}"
Each nil value I assumed to be not an error. I lined these values up in
appearance
order with the metrics data from the same log. (I won't paste the entire line
here
since it's quite long).
I then got the corresponding value from the report stored on disk (attached
as report-stored.yaml).
Note: for these reports I was using our puppetmaster manifest, so there are more
resource metrics than on an example with an empty manifest.
Thanks,
Kienan
| resources | changed | 1 | nil | |
| resources | corrective_change | 1 | nil | |
| resources | failed | 0 | nil | |
| resources | failed_to_restart | 0 | nil | |
| resources | out_of_sync | 1 | nil | |
| resources | restarted | 0 | nil | |
| resources | scheduled | 0 | nil | |
| resources | skipped | 0 | nil | |
| resources | total | 715 | nil | |
| time | alternatives | 0.023357004 | nil | |
| time | anchor | 8.95E-04 | nil | |
| time | augeas | 0.089786623 | nil | |
| time | catalog_application | 4.96E+00 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.49594088389994795e1 |
| time | concat_file | 0.001357939 | nil | |
| time | concat_fragment | 5.54E-03 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal36:0.55388270000000005e2 |
| time | config_retrieval | 7.15E+00 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.71511594359999435e1 |
| time | convert_catalog | 0.544536797000546 | nil | |
| time | cron | 0.014934991 | nil | |
| time | exec | 0.020149716 | nil | |
| time | fact_generation | 2.20E+00 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.21955279620005967e1 |
| time | file | 1.173581222 | nil | |
| time | file_line | 2.55E-02 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal36:0.25507619999999998e1 |
| time | filebucket | 1.11E-04 | nil | |
| time | group | 7.41E-04 | nil | |
| time | ini_setting | 1.27E-02 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal36:0.12673942999999998e1 |
| time | mailalias | 5.89E-04 | nil | |
| time | node_retrieval | 6.56E+00 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.65608796540000185e1 |
| time | package | 0.009044969 | nil | |
| time | plugin_sync | 1.49E+00 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.14851964310000767e1 |
| time | postgresql_conf | 3.16E-04 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal36:0.31588600000000003e3 |
| time | postgresql_conn_validator | 0.054996048 | nil | |
| time | postgresql_psql | 1.220987548 | nil | |
| time | puppetdb_conn_validator | 0.033792702 | nil | |
| time | resources | 6.83E-05 | nil | |
| time | service | 2.94E-01 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal27:0.29372240299999997e0 |
| time | ssh_authorized_key | 0.0013181 | nil | |
| time | sshkey | 8.07E-04 | nil | |
| time | total | 22.909333186 | nil | |
| time | transaction_evaluation | 4.70985980499972 | nil | |
| time | user | 3.47E-02 | {:value (not (instance? java.lang.Number a-java.lang.String))} | ruby/object:BigDecimal36:0.34683594000000005e1 |
| time | vcsrepo | 0.055521215 | nil | |
| changes | total | 1 | nil | |
| events | failure | 0 | nil | |
| events | success | 1 | nil | |
| events | total | 1 | nil |
2019-03-08T11:03:59.479-05:00 INFO [p.p.command] [16-1552061039324] [86 ms]
'replace facts' command processed for pm-buster.test
2019-03-08T11:04:05.158-05:00 INFO [p.p.command] [17-1552061044601] [178 ms]
'replace catalog' command processed for pm-buster.test
2019-03-08T11:04:12.519-05:00 ERROR [p.p.command] [18] [store report] Fatal
error on attempt 0 for pm-buster.test
clojure.lang.ExceptionInfo: throw+: {:fatal true, :cause #error {
:cause "Value does not match schema: {:metrics [nil nil nil nil nil nil nil
nil nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil nil]}"
:data {:type :schema.core/error, :schema {:catalog_uuid (maybe Str),
#schema.core.OptionalKey{:k :job_id} (maybe Str), :producer (maybe Str),
:transaction_uuid (maybe Str), :puppet_version java.lang.String, :noop (maybe
Bool), :corrective_change (maybe Bool), :logs [{:file (maybe Str), :line (maybe
Int), :level java.lang.String, :message java.lang.String, :source
java.lang.String, :tags [java.lang.String], :time (pred datetime?)}],
:report_format Int, :start_time (pred datetime?), :producer_timestamp (pred
datetime?), :cached_catalog_status (maybe Str), :end_time (pred datetime?),
:status (maybe Str), :configuration_version java.lang.String, :environment
java.lang.String, :code_id (maybe Str), :resources [{:corrective_change (maybe
Bool), :events [{:status java.lang.String, :corrective_change (maybe Bool),
:timestamp (pred datetime?), :property (maybe Str), :new_value (maybe (protocol
json/JSONable)), :old_value (maybe (protocol json/JSONable)), :message (maybe
Str)}], :file (maybe Str), :skipped java.lang.Boolean, :line (maybe Int),
:resource_type java.lang.String, :resource_title java.lang.String, :timestamp
(pred datetime?), :containment_path [java.lang.String]}], :noop_pending (maybe
Bool), :certname java.lang.String, :metrics [{:category java.lang.String, :name
java.lang.String, :value java.lang.Number}]}, :value {:catalog_uuid
"65a343f7-a9d2-49d3-8228-6dc493c6651e", :producer "pm-buster.test",
:transaction_uuid "dd892cf0-7b90-41f1-ad23-1160a26f3a81", :puppet_version
"5.5.10", :noop false, :corrective_change true, :logs [{:file nil, :line nil,
:level "info", :message "Using configured environment 'production'", :source
"Puppet", :tags ["info"], :time "2019-03-08T11:03:55.376-05:00"} {:file nil,
:line nil, :level "info", :message "Retrieving pluginfacts", :source "Puppet",
:tags ["info"], :time "2019-03-08T11:03:55.376-05:00"} {:file nil, :line nil,
:level "info", :message "Retrieving plugin", :source "Puppet", :tags ["info"],
:time "2019-03-08T11:03:55.464-05:00"} {:file nil, :line nil, :level "info",
:message "Retrieving locales", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:03:56.719-05:00"} {:file nil, :line nil, :level "info", :message
"Loading facts", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:03:56.873-05:00"} {:file nil, :line nil, :level "info", :message
"Caching catalog for pm-buster.test", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:04:05.360-05:00"} {:file nil, :line nil, :level "info", :message
"Applying configuration version '1552061039'", :source "Puppet", :tags
["info"], :time "2019-03-08T11:04:06.979-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "\n--- /etc/resolv.conf\t2019-03-08
11:03:40.655157319 -0500\n+++ /tmp/puppet-file20190308-8169-3y2g5b\t2019-03-08
11:04:08.239316522 -0500\n@@ -1 +1,4 @@\n+# This file is managed by Puppet, do
not edit\n+search test.\n+options timeout:1 attempts:3 rotate\n nameserver
192.168.121.1\n", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"
"content"], :time "2019-03-08T11:04:08.248-05:00"} {:file nil, :line nil,
:level "info", :message "Computing checksum on file /etc/resolv.conf", :source
"Puppet", :tags ["info"], :time "2019-03-08T11:04:08.249-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "info", :message "Filebucketed /etc/resolv.conf to puppet
with sum d13d36cc65371591ba7ffcd99ff9606f", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]", :tags ["info" "file" "class"
"resolvconf" "profile::resolvconf" "profile" "role::puppetmaster" "role"
"puppetmaster" "node" "__node_regexp__pm-..test"], :time
"2019-03-08T11:04:08.308-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "\n", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"
"content"], :time "2019-03-08T11:04:08.576-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "content changed
'{md5}d13d36cc65371591ba7ffcd99ff9606f' to
'{md5}e6efdf3730b968df02f0d11b2b16bedb'", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"],
:time "2019-03-08T11:04:08.577-05:00"} {:file nil, :line nil, :level "notice",
:message "Applied catalog in 4.96 seconds", :source "Puppet", :tags ["notice"],
:time "2019-03-08T11:04:11.724-05:00"}], :report_format 10, :start_time
"2019-03-08T11:03:48.701-05:00", :producer_timestamp
"2019-03-08T11:04:12.382-05:00", :cached_catalog_status "not_used", :end_time
"2019-03-08T11:04:11.611-05:00", :status "changed", :configuration_version
"1552061039", :environment "production", :code_id nil, :resources
[{:corrective_change true, :events [{:status "success", :timestamp
"2019-03-08T11:04:08.249-05:00", :property "content", :new_value
"{md5}e6efdf3730b968df02f0d11b2b16bedb", :old_value
"{md5}d13d36cc65371591ba7ffcd99ff9606f", :corrective_change true, :message
"content changed '{md5}d13d36cc65371591ba7ffcd99ff9606f' to
'{md5}e6efdf3730b968df02f0d11b2b16bedb'"}], :file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:skipped false, :line 34, :resource_type "File", :resource_title
"/etc/resolv.conf", :timestamp "2019-03-08T11:04:08.241-05:00",
:containment_path ["Stage[main]" "Resolvconf" "File[/etc/resolv.conf]"]}],
:noop_pending false, :certname "pm-buster.test", :metrics [{:category
"resources", :name "changed", :value 1} {:category "resources", :name
"corrective_change", :value 1} {:category "resources", :name "failed", :value
0} {:category "resources", :name "failed_to_restart", :value 0} {:category
"resources", :name "out_of_sync", :value 1} {:category "resources", :name
"restarted", :value 0} {:category "resources", :name "scheduled", :value 0}
{:category "resources", :name "skipped", :value 0} {:category "resources",
:name "total", :value 715} {:category "time", :name "alternatives", :value
0.023357004} {:category "time", :name "anchor", :value 8.948749999999999E-4}
{:category "time", :name "augeas", :value 0.08978662300000002} {:category
"time", :name "catalog_application", :value "0.49594088389994795e1"} {:category
"time", :name "concat_file", :value 0.001357939} {:category "time", :name
"concat_fragment", :value "0.55388270000000005e-2"} {:category "time", :name
"config_retrieval", :value "0.71511594359999435e1"} {:category "time", :name
"convert_catalog", :value 0.5445367970005464} {:category "time", :name "cron",
:value 0.014934991} {:category "time", :name "exec", :value 0.020149716}
{:category "time", :name "fact_generation", :value "0.21955279620005967e1"}
{:category "time", :name "file", :value 1.173581221999999} {:category "time",
:name "file_line", :value "0.25507619999999998e-1"} {:category "time", :name
"filebucket", :value 1.11395E-4} {:category "time", :name "group", :value
7.41019E-4} {:category "time", :name "ini_setting", :value
"0.12673942999999998e-1"} {:category "time", :name "mailalias", :value
5.889840000000001E-4} {:category "time", :name "node_retrieval", :value
"0.65608796540000185e1"} {:category "time", :name "package", :value
0.009044969000000002} {:category "time", :name "plugin_sync", :value
"0.14851964310000767e1"} {:category "time", :name "postgresql_conf", :value
"0.31588600000000003e-3"} {:category "time", :name "postgresql_conn_validator",
:value 0.054996048} {:category "time", :name "postgresql_psql", :value
1.220987548} {:category "time", :name "puppetdb_conn_validator", :value
0.033792702} {:category "time", :name "resources", :value 6.8272E-5} {:category
"time", :name "service", :value "0.29372240299999997e0"} {:category "time",
:name "ssh_authorized_key", :value 0.0013181} {:category "time", :name
"sshkey", :value 8.06631E-4} {:category "time", :name "total", :value
22.909333186} {:category "time", :name "transaction_evaluation", :value
4.709859804999724} {:category "time", :name "user", :value
"0.34683594000000005e-1"} {:category "time", :name "vcsrepo", :value
0.055521215} {:category "changes", :name "total", :value 1} {:category
"events", :name "failure", :value 0} {:category "events", :name "success",
:value 1} {:category "events", :name "total", :value 1}], :job_id nil}, :error
{:metrics [nil nil nil nil nil nil nil nil nil nil nil nil {:value (not
(instance? java.lang.Number a-java.lang.String))} nil {:value (not (instance?
java.lang.Number a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil nil]}}
:via
[{:type clojure.lang.ExceptionInfo
:message "Value does not match schema: {:metrics [nil nil nil nil nil nil
nil nil nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil nil]}"
:data {:type :schema.core/error, :schema {:catalog_uuid (maybe Str),
#schema.core.OptionalKey{:k :job_id} (maybe Str), :producer (maybe Str),
:transaction_uuid (maybe Str), :puppet_version java.lang.String, :noop (maybe
Bool), :corrective_change (maybe Bool), :logs [{:file (maybe Str), :line (maybe
Int), :level java.lang.String, :message java.lang.String, :source
java.lang.String, :tags [java.lang.String], :time (pred datetime?)}],
:report_format Int, :start_time (pred datetime?), :producer_timestamp (pred
datetime?), :cached_catalog_status (maybe Str), :end_time (pred datetime?),
:status (maybe Str), :configuration_version java.lang.String, :environment
java.lang.String, :code_id (maybe Str), :resources [{:corrective_change (maybe
Bool), :events [{:status java.lang.String, :corrective_change (maybe Bool),
:timestamp (pred datetime?), :property (maybe Str), :new_value (maybe (protocol
json/JSONable)), :old_value (maybe (protocol json/JSONable)), :message (maybe
Str)}], :file (maybe Str), :skipped java.lang.Boolean, :line (maybe Int),
:resource_type java.lang.String, :resource_title java.lang.String, :timestamp
(pred datetime?), :containment_path [java.lang.String]}], :noop_pending (maybe
Bool), :certname java.lang.String, :metrics [{:category java.lang.String, :name
java.lang.String, :value java.lang.Number}]}, :value {:catalog_uuid
"65a343f7-a9d2-49d3-8228-6dc493c6651e", :producer "pm-buster.test",
:transaction_uuid "dd892cf0-7b90-41f1-ad23-1160a26f3a81", :puppet_version
"5.5.10", :noop false, :corrective_change true, :logs [{:file nil, :line nil,
:level "info", :message "Using configured environment 'production'", :source
"Puppet", :tags ["info"], :time "2019-03-08T11:03:55.376-05:00"} {:file nil,
:line nil, :level "info", :message "Retrieving pluginfacts", :source "Puppet",
:tags ["info"], :time "2019-03-08T11:03:55.376-05:00"} {:file nil, :line nil,
:level "info", :message "Retrieving plugin", :source "Puppet", :tags ["info"],
:time "2019-03-08T11:03:55.464-05:00"} {:file nil, :line nil, :level "info",
:message "Retrieving locales", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:03:56.719-05:00"} {:file nil, :line nil, :level "info", :message
"Loading facts", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:03:56.873-05:00"} {:file nil, :line nil, :level "info", :message
"Caching catalog for pm-buster.test", :source "Puppet", :tags ["info"], :time
"2019-03-08T11:04:05.360-05:00"} {:file nil, :line nil, :level "info", :message
"Applying configuration version '1552061039'", :source "Puppet", :tags
["info"], :time "2019-03-08T11:04:06.979-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "\n--- /etc/resolv.conf\t2019-03-08
11:03:40.655157319 -0500\n+++ /tmp/puppet-file20190308-8169-3y2g5b\t2019-03-08
11:04:08.239316522 -0500\n@@ -1 +1,4 @@\n+# This file is managed by Puppet, do
not edit\n+search test.\n+options timeout:1 attempts:3 rotate\n nameserver
192.168.121.1\n", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"
"content"], :time "2019-03-08T11:04:08.248-05:00"} {:file nil, :line nil,
:level "info", :message "Computing checksum on file /etc/resolv.conf", :source
"Puppet", :tags ["info"], :time "2019-03-08T11:04:08.249-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "info", :message "Filebucketed /etc/resolv.conf to puppet
with sum d13d36cc65371591ba7ffcd99ff9606f", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]", :tags ["info" "file" "class"
"resolvconf" "profile::resolvconf" "profile" "role::puppetmaster" "role"
"puppetmaster" "node" "__node_regexp__pm-..test"], :time
"2019-03-08T11:04:08.308-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "\n", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"
"content"], :time "2019-03-08T11:04:08.576-05:00"} {:file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:line 34, :level "notice", :message "content changed
'{md5}d13d36cc65371591ba7ffcd99ff9606f' to
'{md5}e6efdf3730b968df02f0d11b2b16bedb'", :source
"/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content", :tags ["notice"
"file" "class" "resolvconf" "profile::resolvconf" "profile"
"role::puppetmaster" "role" "puppetmaster" "node" "__node_regexp__pm-..test"],
:time "2019-03-08T11:04:08.577-05:00"} {:file nil, :line nil, :level "notice",
:message "Applied catalog in 4.96 seconds", :source "Puppet", :tags ["notice"],
:time "2019-03-08T11:04:11.724-05:00"}], :report_format 10, :start_time
"2019-03-08T11:03:48.701-05:00", :producer_timestamp
"2019-03-08T11:04:12.382-05:00", :cached_catalog_status "not_used", :end_time
"2019-03-08T11:04:11.611-05:00", :status "changed", :configuration_version
"1552061039", :environment "production", :code_id nil, :resources
[{:corrective_change true, :events [{:status "success", :timestamp
"2019-03-08T11:04:08.249-05:00", :property "content", :new_value
"{md5}e6efdf3730b968df02f0d11b2b16bedb", :old_value
"{md5}d13d36cc65371591ba7ffcd99ff9606f", :corrective_change true, :message
"content changed '{md5}d13d36cc65371591ba7ffcd99ff9606f' to
'{md5}e6efdf3730b968df02f0d11b2b16bedb'"}], :file
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp",
:skipped false, :line 34, :resource_type "File", :resource_title
"/etc/resolv.conf", :timestamp "2019-03-08T11:04:08.241-05:00",
:containment_path ["Stage[main]" "Resolvconf" "File[/etc/resolv.conf]"]}],
:noop_pending false, :certname "pm-buster.test", :metrics [{:category
"resources", :name "changed", :value 1} {:category "resources", :name
"corrective_change", :value 1} {:category "resources", :name "failed", :value
0} {:category "resources", :name "failed_to_restart", :value 0} {:category
"resources", :name "out_of_sync", :value 1} {:category "resources", :name
"restarted", :value 0} {:category "resources", :name "scheduled", :value 0}
{:category "resources", :name "skipped", :value 0} {:category "resources",
:name "total", :value 715} {:category "time", :name "alternatives", :value
0.023357004} {:category "time", :name "anchor", :value 8.948749999999999E-4}
{:category "time", :name "augeas", :value 0.08978662300000002} {:category
"time", :name "catalog_application", :value "0.49594088389994795e1"} {:category
"time", :name "concat_file", :value 0.001357939} {:category "time", :name
"concat_fragment", :value "0.55388270000000005e-2"} {:category "time", :name
"config_retrieval", :value "0.71511594359999435e1"} {:category "time", :name
"convert_catalog", :value 0.5445367970005464} {:category "time", :name "cron",
:value 0.014934991} {:category "time", :name "exec", :value 0.020149716}
{:category "time", :name "fact_generation", :value "0.21955279620005967e1"}
{:category "time", :name "file", :value 1.173581221999999} {:category "time",
:name "file_line", :value "0.25507619999999998e-1"} {:category "time", :name
"filebucket", :value 1.11395E-4} {:category "time", :name "group", :value
7.41019E-4} {:category "time", :name "ini_setting", :value
"0.12673942999999998e-1"} {:category "time", :name "mailalias", :value
5.889840000000001E-4} {:category "time", :name "node_retrieval", :value
"0.65608796540000185e1"} {:category "time", :name "package", :value
0.009044969000000002} {:category "time", :name "plugin_sync", :value
"0.14851964310000767e1"} {:category "time", :name "postgresql_conf", :value
"0.31588600000000003e-3"} {:category "time", :name "postgresql_conn_validator",
:value 0.054996048} {:category "time", :name "postgresql_psql", :value
1.220987548} {:category "time", :name "puppetdb_conn_validator", :value
0.033792702} {:category "time", :name "resources", :value 6.8272E-5} {:category
"time", :name "service", :value "0.29372240299999997e0"} {:category "time",
:name "ssh_authorized_key", :value 0.0013181} {:category "time", :name
"sshkey", :value 8.06631E-4} {:category "time", :name "total", :value
22.909333186} {:category "time", :name "transaction_evaluation", :value
4.709859804999724} {:category "time", :name "user", :value
"0.34683594000000005e-1"} {:category "time", :name "vcsrepo", :value
0.055521215} {:category "changes", :name "total", :value 1} {:category
"events", :name "failure", :value 0} {:category "events", :name "success",
:value 1} {:category "events", :name "total", :value 1}], :job_id nil}, :error
{:metrics [nil nil nil nil nil nil nil nil nil nil nil nil {:value (not
(instance? java.lang.Number a-java.lang.String))} nil {:value (not (instance?
java.lang.Number a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil {:value (not (instance? java.lang.Number
a-java.lang.String))} {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil {:value (not (instance? java.lang.Number
a-java.lang.String))} nil nil nil nil nil]}}
:at [schema.core$validator$fn__16302 invoke "core.clj" 155]}]
:trace
[[schema.core$validator$fn__16302 invoke "core.clj" 155]
[schema.core$validate invokeStatic "core.clj" 164]
[schema.core$validate invoke "core.clj" 159]
[puppetlabs.puppetdb.command$store_report$fn__37619 invoke "command.clj" 378]
[puppetlabs.puppetdb.command$store_report invokeStatic "command.clj" 377]
[puppetlabs.puppetdb.command$store_report invoke "command.clj" 376]
[puppetlabs.puppetdb.command$process_command_BANG_ invokeStatic "command.clj"
412]
[puppetlabs.puppetdb.command$process_command_BANG_ invoke "command.clj" 403]
[puppetlabs.puppetdb.command$process_command_and_respond_BANG_$fn__37727
invoke "command.clj" 467]
[puppetlabs.puppetdb.command$call_with_quick_retry$fn__37721 invoke
"command.clj" 448]
[puppetlabs.puppetdb.command$call_with_quick_retry invokeStatic "command.clj"
447]
[puppetlabs.puppetdb.command$call_with_quick_retry invoke "command.clj" 445]
[puppetlabs.puppetdb.command$process_command_and_respond_BANG_ invokeStatic
"command.clj" 465]
[puppetlabs.puppetdb.command$process_command_and_respond_BANG_ invoke
"command.clj" 462]
[puppetlabs.puppetdb.command$process_cmdref$fn__37737 invoke "command.clj"
530]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086$fn__36087
invoke "metrics.clj" 14]
[puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4
call nil -1]
[com.codahale.metrics.Timer time "Timer.java" 101]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086
invoke "metrics.clj" 14]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086$fn__36087
invoke "metrics.clj" 14]
[puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4
call nil -1]
[com.codahale.metrics.Timer time "Timer.java" 101]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086
invoke "metrics.clj" 14]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_ invokeStatic
"metrics.clj" 17]
[puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_ invoke "metrics.clj"
6]
[puppetlabs.puppetdb.command$process_cmdref invokeStatic "command.clj" 526]
[puppetlabs.puppetdb.command$process_cmdref invoke "command.clj" 505]
[puppetlabs.puppetdb.command$message_handler$fn__37752 invoke "command.clj"
593]
[puppetlabs.puppetdb.threadpool$dochan$fn__37490$fn__37491 invoke
"threadpool.clj" 117]
[puppetlabs.puppetdb.threadpool$call_on_threadpool$fn__37486 invoke
"threadpool.clj" 95]
[clojure.lang.AFn run "AFn.java" 22]
[java.util.concurrent.ThreadPoolExecutor runWorker "ThreadPoolExecutor.java"
1128]
[java.util.concurrent.ThreadPoolExecutor$Worker run "ThreadPoolExecutor.java"
628]
[java.lang.Thread run "Thread.java" 834]]}}
at slingshot.support$stack_trace.invoke(support.clj:201)
at
puppetlabs.puppetdb.command$store_report$fn__37619.invoke(command.clj:377)
at
puppetlabs.puppetdb.command$store_report.invokeStatic(command.clj:377)
at puppetlabs.puppetdb.command$store_report.invoke(command.clj:376)
at
puppetlabs.puppetdb.command$process_command_BANG_.invokeStatic(command.clj:412)
at
puppetlabs.puppetdb.command$process_command_BANG_.invoke(command.clj:403)
at
puppetlabs.puppetdb.command$process_command_and_respond_BANG_$fn__37727.invoke(command.clj:467)
at
puppetlabs.puppetdb.command$call_with_quick_retry$fn__37721.invoke(command.clj:448)
at
puppetlabs.puppetdb.command$call_with_quick_retry.invokeStatic(command.clj:447)
at
puppetlabs.puppetdb.command$call_with_quick_retry.invoke(command.clj:445)
at
puppetlabs.puppetdb.command$process_command_and_respond_BANG_.invokeStatic(command.clj:465)
at
puppetlabs.puppetdb.command$process_command_and_respond_BANG_.invoke(command.clj:462)
at
puppetlabs.puppetdb.command$process_cmdref$fn__37737.invoke(command.clj:530)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086$fn__36087.invoke(metrics.clj:14)
at
puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown
Source)
at com.codahale.metrics.Timer.time(Timer.java:101)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086.invoke(metrics.clj:14)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086$fn__36087.invoke(metrics.clj:14)
at
puppetlabs.puppetdb.utils.metrics.proxy$java.lang.Object$Callable$7da976d4.call(Unknown
Source)
at com.codahale.metrics.Timer.time(Timer.java:101)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_$fn__36085$fn__36086.invoke(metrics.clj:14)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_.invokeStatic(metrics.clj:17)
at
puppetlabs.puppetdb.utils.metrics$multitime_BANG__STAR_.invoke(metrics.clj:6)
at
puppetlabs.puppetdb.command$process_cmdref.invokeStatic(command.clj:526)
at puppetlabs.puppetdb.command$process_cmdref.invoke(command.clj:505)
at
puppetlabs.puppetdb.command$message_handler$fn__37752.invoke(command.clj:593)
at
puppetlabs.puppetdb.threadpool$dochan$fn__37490$fn__37491.invoke(threadpool.clj:117)
at
puppetlabs.puppetdb.threadpool$call_on_threadpool$fn__37486.invoke(threadpool.clj:95)
at clojure.lang.AFn.run(AFn.java:22)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:834)
--- !ruby/object:Puppet::Transaction::Report
host: pm-buster.test
time: '2019-03-08T11:03:48.701907057-05:00'
configuration_version: 1552061039
transaction_uuid: dd892cf0-7b90-41f1-ad23-1160a26f3a81
report_format: 10
puppet_version: 5.5.10
status: changed
transaction_completed: true
noop: false
noop_pending: false
environment: production
logs:
- level: info
message: Using configured environment 'production'
source: Puppet
tags:
- info
time: '2019-03-08T11:03:55.376504243-05:00'
file:
line:
- level: info
message: Retrieving pluginfacts
source: Puppet
tags:
- info
time: '2019-03-08T11:03:55.376767150-05:00'
file:
line:
- level: info
message: Retrieving plugin
source: Puppet
tags:
- info
time: '2019-03-08T11:03:55.464016364-05:00'
file:
line:
- level: info
message: Retrieving locales
source: Puppet
tags:
- info
time: '2019-03-08T11:03:56.719684292-05:00'
file:
line:
- level: info
message: Loading facts
source: Puppet
tags:
- info
time: '2019-03-08T11:03:56.873781267-05:00'
file:
line:
- level: info
message: Caching catalog for pm-buster.test
source: Puppet
tags:
- info
time: '2019-03-08T11:04:05.360893319-05:00'
file:
line:
- level: info
message: Applying configuration version '1552061039'
source: Puppet
tags:
- info
time: '2019-03-08T11:04:06.979222093-05:00'
file:
line:
- level: notice
message: "\n--- /etc/resolv.conf\t2019-03-08 11:03:40.655157319 -0500\n+++
/tmp/puppet-file20190308-8169-3y2g5b\t2019-03-08
11:04:08.239316522 -0500\n@@ -1 +1,4 @@\n+# This file is managed by Puppet,
do
not edit\n+search test.\n+options timeout:1 attempts:3 rotate\n nameserver
192.168.121.1\n"
source: "/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content"
tags:
- notice
- file
- class
- resolvconf
- profile::resolvconf
- profile
- role::puppetmaster
- role
- puppetmaster
- node
- __node_regexp__pm-..test
- content
time: '2019-03-08T11:04:08.248564046-05:00'
file:
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp"
line: 34
- level: info
message: Computing checksum on file /etc/resolv.conf
source: Puppet
tags:
- info
time: '2019-03-08T11:04:08.249322871-05:00'
file:
line:
- level: info
message: Filebucketed /etc/resolv.conf to puppet with sum
d13d36cc65371591ba7ffcd99ff9606f
source: "/Stage[main]/Resolvconf/File[/etc/resolv.conf]"
tags:
- info
- file
- class
- resolvconf
- profile::resolvconf
- profile
- role::puppetmaster
- role
- puppetmaster
- node
- __node_regexp__pm-..test
time: '2019-03-08T11:04:08.308387018-05:00'
file:
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp"
line: 34
- level: notice
message: "\n"
source: "/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content"
tags:
- notice
- file
- class
- resolvconf
- profile::resolvconf
- profile
- role::puppetmaster
- role
- puppetmaster
- node
- __node_regexp__pm-..test
- content
time: '2019-03-08T11:04:08.576948895-05:00'
file:
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp"
line: 34
- level: notice
message: content changed '{md5}d13d36cc65371591ba7ffcd99ff9606f' to
'{md5}e6efdf3730b968df02f0d11b2b16bedb'
source: "/Stage[main]/Resolvconf/File[/etc/resolv.conf]/content"
tags:
- notice
- file
- class
- resolvconf
- profile::resolvconf
- profile
- role::puppetmaster
- role
- puppetmaster
- node
- __node_regexp__pm-..test
time: '2019-03-08T11:04:08.577397383-05:00'
file:
"/etc/puppet/code/environments/production/modules/resolvconf/manifests/init.pp"
line: 34
- level: notice
message: Applied catalog in 4.96 seconds
source: Puppet
tags:
- notice
time: '2019-03-08T11:04:11.724508795-05:00'
file:
line:
metrics:
resources:
name: resources
label: Resources
values:
- - total
- Total
- 715
- - skipped
- Skipped
- 0
- - failed
- Failed
- 0
- - failed_to_restart
- Failed to restart
- 0
- - restarted
- Restarted
- 0
- - changed
- Changed
- 1
- - out_of_sync
- Out of sync
- 1
- - scheduled
- Scheduled
- 0
- - corrective_change
- Corrective change
- 1
time:
name: time
label: Time
values:
- - user
- User
- !ruby/object:BigDecimal 36:0.34683594000000005e-1
- - group
- Group
- 0.000741019
- - ssh_authorized_key
- Ssh authorized key
- 0.0013181
- - anchor
- Anchor
- 0.0008948749999999999
- - package
- Package
- 0.009044969000000002
- - file
- File
- 1.173581221999999
- - exec
- Exec
- 0.020149716
- - file_line
- File line
- !ruby/object:BigDecimal 36:0.25507619999999998e-1
- - service
- Service
- !ruby/object:BigDecimal 27:0.29372240299999997e0
- - mailalias
- Mailalias
- 0.0005889840000000001
- - sshkey
- Sshkey
- 0.000806631
- - resources
- Resources
- 6.8272e-05
- - vcsrepo
- Vcsrepo
- 0.055521215
- - alternatives
- Alternatives
- 0.023357004
- - augeas
- Augeas
- 0.08978662300000002
- - concat_fragment
- Concat fragment
- !ruby/object:BigDecimal 36:0.55388270000000005e-2
- - concat_file
- Concat file
- 0.001357939
- - postgresql_conf
- Postgresql conf
- !ruby/object:BigDecimal 36:0.31588600000000003e-3
- - postgresql_psql
- Postgresql psql
- 1.220987548
- - postgresql_conn_validator
- Postgresql conn validator
- 0.054996048
- - ini_setting
- Ini setting
- !ruby/object:BigDecimal 36:0.12673942999999998e-1
- - puppetdb_conn_validator
- Puppetdb conn validator
- 0.033792702
- - cron
- Cron
- 0.014934991
- - filebucket
- Filebucket
- 0.000111395
- - node_retrieval
- Node retrieval
- !ruby/object:BigDecimal 27:0.65608796540000185e1
- - plugin_sync
- Plugin sync
- !ruby/object:BigDecimal 27:0.14851964310000767e1
- - fact_generation
- Fact generation
- !ruby/object:BigDecimal 27:0.21955279620005967e1
- - convert_catalog
- Convert catalog
- 0.5445367970005464
- - config_retrieval
- Config retrieval
- !ruby/object:BigDecimal 27:0.71511594359999435e1
- - transaction_evaluation
- Transaction evaluation
- 4.709859804999724
- - catalog_application
- Catalog application
- !ruby/object:BigDecimal 27:0.49594088389994795e1
- - total
- Total
- 22.909333186
changes:
name: changes
label: Changes
values:
- - total
- Total
- 1
events:
name: events
label: Events
values:
- - total
- Total
- 1
- - failure
- Failure
- 0
- - success
- Success
- 1
# report redacted
corrective_change: true
catalog_uuid: 65a343f7-a9d2-49d3-8228-6dc493c6651e
cached_catalog_status: not_used
signature.asc
Description: PGP signature
