On 03/19/2017 02:32 PM, Joel Sherrill wrote:
> Hi
>
> I was following up on Gedare's testing and tried leon3. There
> were a surprising number of failures there with SMP disabled.
> This is testing with gdb. Does anyone else get the same 
> results with qemu or tsim?  Any idea what's broken?
>
>
> Passed:   458
> Failed:    20
> Timeouts:  73
> Invalid:    3
> -------------
> Total:    554
>
> Failures:
>  cdtest.exe
>  spintrcritical20.exe
>  dl05.exe
>  spintrcritical01.exe
>  spintrcritical04.exe
>  spintrcritical10.exe
>  spintrcritical22.exe
>  sp69.exe
>  spintrcritical21.exe
>  sp11.exe
>  spintrcritical16.exe
>  spintrcritical23.exe
>  psxfile01.exe
>  spintrcritical05.exe
>  spintrcritical02.exe
>  spintrcritical08.exe
>  psxgetrusage01.exe
>  spcpucounter01.exe
>
>
>
> _______________________________________________
> devel mailing list
> devel@rtems.org
> http://lists.rtems.org/mailman/listinfo/devel

Tthe source of the failures for leon3 came from missing support for the
CASA instruction and lack of the %asr23 register. I have uploaded new
sis patches to my server, and attached a patch for RSB that pulls them
in. With that patch applied, I get the following results:

==> erc32log.txt <==

Passed:   560
Failed:     1
Timeouts:   0
Invalid:    0
-------------
Total:    561

Failures:
 spcontext01.exe
Average test time: 0:00:00.439075
Testing time     : 0:04:06.321377

==> leon2log.txt <==

Passed:   560
Failed:     1
Timeouts:   0
Invalid:    0
-------------
Total:    561

Failures:
 spcache01.exe
Average test time: 0:00:00.650810
Testing time     : 0:06:05.104584

==> leon3log.txt <==

Passed:   559
Failed:     0
Timeouts:   0
Invalid:    2
-------------
Total:    561

Invalid:
 sptimecounter01.exe
 spinternalerror01.exe
Average test time: 0:00:00.510382
Testing time     : 0:04:46.324846

The new sis version now supports an -r switch that executes the binary
at start-up. This means that the 'run' application is no longer really
needed. An optional execution time-out can also be specified (in
simulated time) to avoid having to use time-outs on the host. I have
attached a patch for rtems-tools with three sis configs for rtems-test,
erc32-sis.mc, leon2-sis.mc and leon3-sis.mc. A typical run through all
leon3 test would be:

rtems-test --rtems-bsp=leon3-sis sparc-rtems4.12/c/leon3/testsuites

Jiri.
>From 3e0bd1b41942c4a992e47417657c92acfa117b12 Mon Sep 17 00:00:00 2001
From: Jiri Gaisler <j...@gaisler.se>
Date: Thu, 23 Mar 2017 22:30:01 +0100
Subject: [PATCH] gdb: update to latest sis patches

	* Addition of CASA instruction for leon3
	* Handle access to %asr23 correctly (leon3)
---
 rtems/config/tools/rtems-gdb-7.12-1.cfg | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/rtems/config/tools/rtems-gdb-7.12-1.cfg b/rtems/config/tools/rtems-gdb-7.12-1.cfg
index 52c9fa2..9cb33b8 100644
--- a/rtems/config/tools/rtems-gdb-7.12-1.cfg
+++ b/rtems/config/tools/rtems-gdb-7.12-1.cfg
@@ -12,8 +12,8 @@
 #
 # ERC32 simulator fixes. (still OK from 7.11)
 #
-%patch add gdb %{rtems_gdb_patches}/gdb-7.11-sis-leon2-leon3.diff
-%hash md5 gdb-7.11-sis-leon2-leon3.diff 88eac302290ea2a58bd7e08aaca94efd
+%patch add gdb https://gaisler.org/gdb/gdb-7.11.1-sis-leon2-leon3.diff
+%hash md5 gdb-7.11.1-sis-leon2-leon3.diff f1d0e9ba7723cd7e9a7a13700cb5575a
 
 #
 # FreeBSD specific fixes (still OK from 7.11)
-- 
2.7.4

>From aed7a40a29318be4f053762106d53c4a8af9bd09 Mon Sep 17 00:00:00 2001
From: Jiri Gaisler <j...@gaisler.se>
Date: Thu, 23 Mar 2017 22:24:03 +0100
Subject: [PATCH] tester: Added test scripts for standalone sis

	* sis now accepts the -r switch to run the application
	  at startup. An optional execution time limit can also be
	  specified with -tlim (e.g. -tlim 100 s).
---
 tester/rtems/testing/bsps/erc32-sis.mc | 54 ++++++++++++++++++++++++++++++++++
 tester/rtems/testing/bsps/leon2-sis.mc | 54 ++++++++++++++++++++++++++++++++++
 tester/rtems/testing/bsps/leon3-sis.mc | 54 ++++++++++++++++++++++++++++++++++
 3 files changed, 162 insertions(+)
 create mode 100644 tester/rtems/testing/bsps/erc32-sis.mc
 create mode 100644 tester/rtems/testing/bsps/leon2-sis.mc
 create mode 100644 tester/rtems/testing/bsps/leon3-sis.mc

diff --git a/tester/rtems/testing/bsps/erc32-sis.mc b/tester/rtems/testing/bsps/erc32-sis.mc
new file mode 100644
index 0000000..b71a604
--- /dev/null
+++ b/tester/rtems/testing/bsps/erc32-sis.mc
@@ -0,0 +1,54 @@
+#
+# RTEMS Tools Project (http://www.rtems.org/)
+# Copyright 2015 On-Line Applications Research Corporation (OAR).
+# All rights reserved.
+#
+# This file is part of the RTEMS Tools package in 'rtems-tools'.
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions are met:
+#
+# 1. Redistributions of source code must retain the above copyright notice,
+# this list of conditions and the following disclaimer.
+#
+# 2. Redistributions in binary form must reproduce the above copyright notice,
+# this list of conditions and the following disclaimer in the documentation
+# and/or other materials provided with the distribution.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+# AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
+# ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE
+# LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
+# CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
+# SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
+# INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
+# CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
+# ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
+# POSSIBILITY OF SUCH DAMAGE.
+#
+
+#
+# All paths in defaults must be Unix format. Do not store any Windows format
+# paths in the defaults.
+#
+# Every entry must describe the type of checking a host must pass.
+#
+# Records:
+#  key: type, attribute, value
+#   type     : none, dir, exe, triplet
+#   attribute: none, required, optional
+#   value    : 'single line', '''multi line'''
+#
+
+#
+# The erc32 BSP
+#
+[global]
+bsp:              none,    none,     'erc32'
+
+[erc32]
+erc32:            none,    none,     '%{_rtscripts}/run.cfg'
+erc32_arch:       none,    none,     'sparc'
+bsp_run_cmd:      none,    none,     '%{rtems_tools}/%{bsp_arch}-rtems%{rtems_version}-sis'
+bsp_run_opts:     none,    none,     '-nouartrx -r -tlim 600 s'
diff --git a/tester/rtems/testing/bsps/leon2-sis.mc b/tester/rtems/testing/bsps/leon2-sis.mc
new file mode 100644
index 0000000..8854fd6
--- /dev/null
+++ b/tester/rtems/testing/bsps/leon2-sis.mc
@@ -0,0 +1,54 @@
+#
+# RTEMS Tools Project (http://www.rtems.org/)
+# Copyright 2015 On-Line Applications Research Corporation (OAR).
+# All rights reserved.
+#
+# This file is part of the RTEMS Tools package in 'rtems-tools'.
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions are met:
+#
+# 1. Redistributions of source code must retain the above copyright notice,
+# this list of conditions and the following disclaimer.
+#
+# 2. Redistributions in binary form must reproduce the above copyright notice,
+# this list of conditions and the following disclaimer in the documentation
+# and/or other materials provided with the distribution.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+# AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
+# ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE
+# LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
+# CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
+# SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
+# INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
+# CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
+# ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
+# POSSIBILITY OF SUCH DAMAGE.
+#
+
+#
+# All paths in defaults must be Unix format. Do not store any Windows format
+# paths in the defaults.
+#
+# Every entry must describe the type of checking a host must pass.
+#
+# Records:
+#  key: type, attribute, value
+#   type     : none, dir, exe, triplet
+#   attribute: none, required, optional
+#   value    : 'single line', '''multi line'''
+#
+
+#
+# The leon2 BSP
+#
+[global]
+bsp:              none,    none,     'leon2'
+
+[leon2]
+leon2:            none,    none,     '%{_rtscripts}/run.cfg'
+leon2_arch:       none,    none,     'sparc'
+bsp_run_cmd:      none,    none,     '%{rtems_tools}/%{bsp_arch}-rtems%{rtems_version}-sis'
+bsp_run_opts:     none,    none,     '-leon2 -nouartrx -r -tlim 200 s'
diff --git a/tester/rtems/testing/bsps/leon3-sis.mc b/tester/rtems/testing/bsps/leon3-sis.mc
new file mode 100644
index 0000000..1d55044
--- /dev/null
+++ b/tester/rtems/testing/bsps/leon3-sis.mc
@@ -0,0 +1,54 @@
+#
+# RTEMS Tools Project (http://www.rtems.org/)
+# Copyright 2015 On-Line Applications Research Corporation (OAR).
+# All rights reserved.
+#
+# This file is part of the RTEMS Tools package in 'rtems-tools'.
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions are met:
+#
+# 1. Redistributions of source code must retain the above copyright notice,
+# this list of conditions and the following disclaimer.
+#
+# 2. Redistributions in binary form must reproduce the above copyright notice,
+# this list of conditions and the following disclaimer in the documentation
+# and/or other materials provided with the distribution.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
+# AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
+# IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
+# ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE
+# LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR
+# CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF
+# SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS
+# INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN
+# CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
+# ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
+# POSSIBILITY OF SUCH DAMAGE.
+#
+
+#
+# All paths in defaults must be Unix format. Do not store any Windows format
+# paths in the defaults.
+#
+# Every entry must describe the type of checking a host must pass.
+#
+# Records:
+#  key: type, attribute, value
+#   type     : none, dir, exe, triplet
+#   attribute: none, required, optional
+#   value    : 'single line', '''multi line'''
+#
+
+#
+# The leon3 BSP
+#
+[global]
+bsp:              none,    none,     'leon3'
+
+[leon3]
+leon3:            none,    none,     '%{_rtscripts}/run.cfg'
+leon3_arch:       none,    none,     'sparc'
+bsp_run_cmd:      none,    none,     '%{rtems_tools}/%{bsp_arch}-rtems%{rtems_version}-sis'
+bsp_run_opts:     none,    none,     '-leon3 -nouartrx -r -tlim 200 s'
-- 
2.7.4

_______________________________________________
devel mailing list
devel@rtems.org
http://lists.rtems.org/mailman/listinfo/devel

Reply via email to