Hi James,
On Mon, Jan 13, 2025 at 08:20:52PM -0500, James McCoy wrote:
> This looks like typical flakiness that I see in the neovim tests.
> Downgrading the severity.
I see similar flakyness in the buildd logs on s390x and riscv64, and
in the reproduce.debian.net logs, in these tests:
Failures:
From test_options.vim:
Found errors in Test_shortmess_F3():
command line..script
/build/reproducible-path/neovim-0.10.4/test/old/testdir/runtest.vim[543]..function
RunTheTest[55]..Test_shortmess_F3 line 19: Expected ['bar'] but got ['foo']
command line..script
/build/reproducible-path/neovim-0.10.4/test/old/testdir/runtest.vim[543]..function
RunTheTest[55]..Test_shortmess_F3 line 29: Expected ['baz'] but got ['foo']
----
FAILED 1 test, listed below:
FAILED test/functional/terminal/edit_spec.lua @ 38: :edit term://* runs
TermOpen early enough to set buffer-local 'scrollback'
test/functional/terminal/edit_spec.lua:67: Row 1 did not match.
Expected:
|*96: foobar |
| |
|^[Process exited 0] |
| |
Actual:
|*36: foobar |
| |
|^[Process exited 0] |
| |
To print the expect() call that would assert the current screen state, use
screen:snapshot_util(). In case of non-deterministic failures, use
screen:redraw_debug() to show all intermediate screen states.
Snapshot:
screen:expect({
grid = [[
36: foobar |
|
^[Process exited 0] |
|
]]
})
stack traceback:
test/functional/ui/screen.lua:850: in function '_wait'
test/functional/ui/screen.lua:526: in function 'expect'
test/functional/terminal/edit_spec.lua:67: in function
<test/functional/terminal/edit_spec.lua:38>
---
FAILED 1 test, listed below:
FAILED test/functional/ui/highlight_spec.lua @ 1350: CursorColumn highlight
is updated if cursor is moved from timer
test/functional/ui/highlight_spec.lua:1362: Row 1 did not match.
Expected:
|*aaaa{21:a} |
|*bbbb{21:b} |
|*cccc{21:c} |
|*dddd^d |
|{1:~ }|
|{1:~ }|
|{1:~ }|
| |
Actual:
|*^aaaaa |
|*{21:b}bbbb |
|*{21:c}cccc |
|*{21:d}dddd |
|{1:~ }|
|{1:~ }|
|{1:~ }|
| |
To print the expect() call that would assert the current screen state, use
screen:snapshot_util(). In case of non-deterministic failures, use
screen:redraw_debug() to show all intermediate screen states.
Snapshot:
screen:expect({
grid = [[
^aaaaa |
{21:b}bbbb |
{21:c}cccc |
{21:d}dddd |
{1:~ }|*3
|
]]
})
stack traceback:
test/functional/ui/screen.lua:850: in function '_wait'
test/functional/ui/screen.lua:526: in function 'expect'
test/functional/ui/highlight_spec.lua:1362: in function
<test/functional/ui/highlight_spec.lua:1350>
For the tests which fail in `_wait`, maybe the timeouts could be increased.
Thanks,
Chris
