Jira (PUP-6620) Ensure test setup doesn't mask test failure of PMT to connect to Forge

[Ethan Brown (JIRA)]

Title: Message Title

Ethan Brown commented on PUP-6620   Re: Ensure test setup doesn't mask test failure of PMT to connect to Forge Manual validation has shown that this removal of the pre-suite step to install certs on Windows will successfully demonstrate test failures related to connecting to the forge over HTTPS, when the cert bundle from the puppet-agent / Vanagon builds is not included or configured properly. I have additionally validated that in the last passing test run over packages at https://jenkins.puppetlabs.com/view/puppet-agent/view/stable/view/puppet/job/platform_puppet_intn-van-sys_stable/SLAVE_LABEL=beaker,TEST_TARGET=windows2012r2-64a/199/consoleFull that the 070_InstallCACerts.rb pre-suite step is no longer run: 07:17:50 "pre_suite": [ 07:17:50 "setup/common/pre-suite/000-delete-puppet-when-none.rb", 07:17:50 "setup/aio/pre-suite/010_Install.rb", 07:17:50 "setup/aio/pre-suite/015_PackageHostsPresets.rb", 07:17:50 "setup/aio/pre-suite/020_InstallCumulusModules.rb", 07:17:50 "setup/aio/pre-suite/021_InstallAristaModule.rb", 07:17:50 "setup/common/pre-suite/025_StopFirewall.rb", 07:17:50 "setup/common/pre-suite/040_ValidateSignCert.rb", 07:17:50 "setup/aio/pre-suite/045_EnsureMasterStartedOnPassenger.rb" 07:17:50 ], The test install/basic_install.rb succeeded in connecting to the Forge over HTTPS 07:23:43 Begin tests/modules/install/basic_install.rb 07:23:43 07:23:43 puppet module install (agent) 07:23:43 07:23:43 h7qxajveeuo8vdg.delivery.puppetlabs.net (redhat7-64-1) 07:23:43$ puppet module list --render-as pson 07:23:43 {"environment":"production","modules_by_path":{"/etc/puppetlabs/code/environments/production/modules":[],"/etc/puppetlabs/code/modules":[],"/opt/puppetlabs/puppet/modules":[]}} 07:23:43 07:23:43 h7qxajveeuo8vdg.delivery.puppetlabs.net (redhat7-64-1) executed in 0.82 seconds 07:23:43 07:23:43 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:23:43$ cmd.exe /c puppet module list --render-as pson 07:23:45 {"environment":"production","modules_by_path":{"C:/ProgramData/PuppetLabs/code/environments/production/modules":[],"C:/ProgramData/PuppetLabs/code/modules":[]}} 07:23:45 07:23:45 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 1.77 seconds 07:23:45 07:23:45 * setup 07:23:45 Stubbing address forge.puppetlabs.com to IP 10.32.22.198 on machine atkmhzhs92fa6w6.delivery.puppetlabs.net 07:23:45 07:23:45 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:23:45$ cygpath -m $(mktemp -t apply_manifest.pp.XXXXXX) 07:23:45 C:/cygwin64/tmp/apply_manifest.pp.pKC893 07:23:45 07:23:45 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.10 seconds 07:23:45 localhost $ scp /tmp/beaker20160819-13140-otb5t6 windows2012r2-64-1:C:/cygwin64/tmp/apply_manifest.pp.pKC893 {:ignore => } 07:23:45 07:23:45 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:23:45$ cmd.exe /c puppet apply --verbose C:/cygwin64/tmp/apply_manifest.pp.pKC893 07:23:55 Notice: Compiled catalog for atkmhzhs92fa6w6.delivery.puppetlabs.net in environment production in 0.16 seconds 07:23:55 Info: Applying configuration version '1471616633' 07:23:55 Notice: /Stage[main]/Main/Host[forge.puppetlabs.com]/ensure: created 07:23:55 Info: Computing checksum on file C:/Windows/System32/drivers/etc/hosts 07:23:55 Notice: Applied catalog in 0.08 seconds 07:23:55 07:23:55 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 9.53 seconds 07:23:55 07:23:55 * install module 'pmtacceptance-nginx' 07:23:55 07:23:55 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:23:55$ cmd.exe /c puppet module install pmtacceptance-nginx 07:23:57 Notice: Preparing to install into C:/ProgramData/PuppetLabs/code/environments/production/modules ... 07:23:57 Notice: Downloading from https://forgeapi.puppetlabs.com ... 07:24:04 Notice: Installing -- do not interrupt ... 07:24:04 C:/ProgramData/PuppetLabs/code/environments/production/modules 07:24:04 └── pmtacceptance-nginx (v0.0.1) 07:24:04 07:24:04 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 9.14 seconds 07:24:04 07:24:04 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:04$ cmd.exe /c puppet config print environment 07:24:06 production 07:24:06 07:24:06 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 1.62 seconds 07:24:06 07:24:06 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:06$ cmd.exe /c puppet config print modulepath --environment production 07:24:07 C:/ProgramData/PuppetLabs/code/environments/production/modules;C:/ProgramData/PuppetLabs/code/modules;C:/opt/puppetlabs/puppet/modules 07:24:07 07:24:07 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 1.59 seconds 07:24:07 07:24:07 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:07$ [ -d "C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx" ] 07:24:07 07:24:07 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.09 seconds 07:24:07 07:24:07 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:07$ [ -d "C:/ProgramData/PuppetLabs/code/modules/nginx" ] 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.08 seconds 07:24:08 Exited: 1 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:08$ [ -d "C:/opt/puppetlabs/puppet/modules/nginx" ] 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.09 seconds 07:24:08 Exited: 1 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:08$ ls -ld "C:/ProgramData/PuppetLabs/code/environments/production/modules" 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 C:/ProgramData/PuppetLabs/code/environments/production/modules 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.11 seconds 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:08$ ls -alR "C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx" 07:24:08 C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx: 07:24:08 total 10 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 . 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 .. 07:24:08 -rw-r--r-- 1 Administrator None 238 Aug 19 07:24 Modulefile 07:24:08 -rw-r--r-- 1 Administrator None 33 Aug 19 07:24 README 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 manifests 07:24:08 -rw-r--r-- 1 Administrator None 623 Aug 19 07:24 metadata.json 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 spec 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 tests 07:24:08 07:24:08 C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx/manifests: 07:24:08 total 5 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 . 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 .. 07:24:08 -rw-r--r-- 1 Administrator None 193 Aug 19 07:24 init.pp 07:24:08 07:24:08 C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx/spec: 07:24:08 total 6 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 . 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 .. 07:24:08 -rw-r--r-- 1 Administrator None 47 Aug 19 07:24 spec.opts 07:24:08 -rw-r--r-- 1 Administrator None 426 Aug 19 07:24 spec_helper.rb 07:24:08 07:24:08 C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx/tests: 07:24:08 total 5 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 . 07:24:08 drwxr-xr-x 1 Administrator None 0 Aug 19 07:24 .. 07:24:08 -rw-r--r-- 1 Administrator None 14 Aug 19 07:24 init.pp 07:24:08 07:24:08 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.11 seconds 07:24:08 Begin teardown 07:24:08 07:24:08 h7qxajveeuo8vdg.delivery.puppetlabs.net (redhat7-64-1) 07:24:08$ puppet module list --render-as pson 07:24:09 {"environment":"production","modules_by_path":{"/etc/puppetlabs/code/environments/production/modules":[],"/etc/puppetlabs/code/modules":[],"/opt/puppetlabs/puppet/modules":[]}} 07:24:09 07:24:09 h7qxajveeuo8vdg.delivery.puppetlabs.net (redhat7-64-1) executed in 0.86 seconds 07:24:09 07:24:09 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:09$ cmd.exe /c puppet module list --render-as pson 07:24:10 {"environment":"production","modules_by_path":{"C:/ProgramData/PuppetLabs/code/environments/production/modules":["Module nginx(C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx)"],"C:/ProgramData/PuppetLabs/code/modules":[]}} 07:24:11 07:24:11 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 1.83 seconds 07:24:11 07:24:11 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:11$ rm -rf 'C:/ProgramData/PuppetLabs/code/environments/production/modules/nginx' 07:24:11 07:24:11 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 0.09 seconds 07:24:11 Unstubbing address forge.puppetlabs.com to IP 10.32.22.198 on machine atkmhzhs92fa6w6.delivery.puppetlabs.net 07:24:11 07:24:11 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) 07:24:11$ cmd.exe /c puppet resource host forge.puppetlabs.com ensure=absent 07:24:19 Notice: /Host[forge.puppetlabs.com]/ensure: removed 07:24:19 host { 'forge.puppetlabs.com': 07:24:19 ensure => 'absent', 07:24:19 } 07:24:19 07:24:19 atkmhzhs92fa6w6.delivery.puppetlabs.net (windows2012r2-64-1) executed in 8.41 seconds 07:24:19 End teardown 07:24:19 tests/modules/install/basic_install.rb passed in 36.47 seconds Add Comment   This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.