On 11.01.2016 11:03, Jan Chaloupka wrote:
> Hi,
> 
> cockpit integration tests have proofed to be very useful for discovering
> regression and bugs for kubernetes.
> The current workflow of updating kubernetes is to rebase/rebuilt
> kubernetes, run very basic tests and hope it will work.
> The workflow did not show up to be much bulletproof.
> 
> Would it be possible to run kubernetes related cockpit integration tests
> on each new build of kubernetes in rawhide? 

Something like this?

$ cd cockpit/test
$ sudo ./vm-prep # needed the first time
$ koji download-build --arch=x86_64 --arch=noarch <kubernetes-build-id>
$ ./testsuite-prepare
$ ./vm-install kubernetes*.rpm
$ ./check-kubernetes -tvs

Did you try something like that. Some deps described in test/README need
to be installed.

There are also docker images that stage all this with the deps [1], but
they probably need some tweaking for this use case ... and you may want
to start simple as above.

[1] https://github.com/cockpit-project/cockpituous/tree/master/verify

> Once I tried to run the
> tests and ended up with downloading a lot of images each over 1GB. 

The above will download some unnecessary images. See where the
testsuite-prepare shell script calls vm-download... Only the $BUILD_OS
(default fedora-23) should be necessary in your case.

But for starters that shouldn't be a big problem right?

After you've tried this out and it works, there's obviously lots of room
for tweaking it and customizing the script you'll use.

> How
> hard it would be to write down a simple script that would expect
> kubernetes build and distribution? As a result, it would set everything
> up and run required tests (without user intervention). Or if possible to
> use your system (possibly Jenkins?) and periodically run integration
> tests (or with a suitable trigger).

See above for the beginnings of such a script. And ask Ari (CC'd) about
Jenkins. I believe his Jenkins instance could run such a script no?

Stef
_______________________________________________
cockpit-devel mailing list
[email protected]
https://lists.fedorahosted.org/admin/lists/[email protected]

Reply via email to