Simon Sobisch <simonsobi...@gnu.org> writes: > Thanks for your work on adding a testsuite. Can you please explain why > you do this when a complete testsuite exists in autoconf (autotest) > format (which roots back to decade of work in GnuCOBOL, with all > copyrights for that already with the FSF)? >
I don't think any of us were aware of it ("we" being "the general GCC developer community", not the COBOL folks, for the purposes of this email) until yesterday when richi mused about it on IRC maybe existing and we went looking out of curiosity. I agree that having that testsuite integrated would be fantastic. > Is the existence of this in upstream [1] just unknown (because it was > not part of the initial patches [for reasons I not understood])? > I would've personally liked to see the NIST testsuite integration at least in the initial patches, but it is what it is. I don't think the GnuCOBOL testsuite was brought up at all (and I think most of us weren't aware of it) in the patch upstreaming discussions. Now that we *are* aware of it, it seems desirable to have for sure. > Is the format such a big issue (note: previous discussions elaborated > "a test suite is very important and other frontends also use a > framework other than dejagnu)? > > If dejagnu is the way to go: > > * Shouldn't there be deprecation of autotest in autoconf (of course > only if that preference is also outside of gcc)? It's a GCC / GNU toolchain-only preference because it allows easily doing cross + simulator testing, and all of our tools are used to its format. It's definitely not perfect. Years ago (way before I followed GCC), there was talk of replacing dejagnu, just efforts failed. > > * Shouldn't there be a (at least semi automated) script / migration > tool (at least for this specific time in place to convert the "UAT" > once into dejagnu format)? Yes. Having testsuite integration is seen as critical at this point. richi just wanted to present this as a non-COBOL person to give us something to play with. > > > > Thanks for giving me some context on this, > Simon > > > [1]: > https://gitlab.cobolworx.com/COBOLworx/gcc-cobol/-/tree/master+cobol/gcc/cobol/UAT thanks, sam