Source: balboa
Version: 2.0.0+ds-4
Severity: serious

Hi Sascha,

Where previously the autopkgtests for balboa would complete in seconds (<1
min), after the most recent no-change rebuild against new rocksdb they hang
indefinitely and eventually fail with a timeout.

Looking at the systemd journal output shows some segfaults, which might be
related!

Unfortunately, Debian does not run autopkgtests for binNMUs of packages and
does not gate promotion of binNMUs to testing on autopkgtest results, so
this regression is not reflected on
https://ci.debian.net/packages/b/balboa/.  I noticed it because Ubuntu does
run autopkgtests for no-change rebuilds of packages
(https://autopkgtest.ubuntu.com/packages/b/balboa/kinetic/amd64), and I have
reproduced the failure in a Debian sid container:



[...]
root@balboa:~/balboa-2.0.0+ds# timeout 60 sh ./debian/tests/test-run 
Jun 10 17:13:04 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:04 balboa balboa-rocksdb[1609]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:04 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:04 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 1.
Jun 10 17:13:09 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:09 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:09 balboa balboa-rocksdb[1625]:  (blb_rocksdb_open) rocksdb_open() 
Jun 10 17:13:09 balboa balboa-rocksdb[1625]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:09 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 2.
Jun 10 17:13:14 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:14 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:14 balboa balboa-rocksdb[1637]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:14 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:19 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 3.
Jun 10 17:13:19 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:20 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:20 balboa balboa-rocksdb[1652]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:20 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:20 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 4.
Jun 10 17:13:25 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:25 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:25 balboa balboa-rocksdb[4004]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:25 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 5.
Jun 10 17:13:30 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:30 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:30 balboa balboa-rocksdb[4014]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:30 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 6.
Jun 10 17:13:35 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:35 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:35 balboa balboa-rocksdb[4061]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Main process 
exited, code=dumped, status=11/SEGV
Jun 10 17:13:35 balboa systemd[1]: balboa-backend@rocksdb.service: Failed with 
result 'core-dump'.
Jun 10 17:13:40 balboa systemd[1]: balboa-backend@rocksdb.service: Scheduled 
restart job, restart counter is at 7.
Jun 10 17:13:40 balboa systemd[1]: Stopped Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:41 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:41 balboa balboa-rocksdb[4077]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
● balboa-backend@rocksdb.service - Basic Little Book of Answers, 'rocksdb' 
Backend
     Loaded: loaded (/lib/systemd/system/balboa-backend@.service; enabled; 
vendor preset: enabled)
    Drop-In: /run/systemd/system/service.d
             └─zzz-lxc-service.conf
     Active: active (running) since Fri 2022-06-10 17:13:41 UTC; 30ms ago
       Docs: https://github.com/DCSO/balboa
   Main PID: 4077 (balboa-rocksdb)
      Tasks: 10 (limit: 37953)
     Memory: 1.3M
        CPU: 20ms
     CGroup: 
/system.slice/system-balboa\x2dbackend.slice/balboa-backend@rocksdb.service
             └─4077 /usr/bin/balboa-rocksdb

Jun 10 17:13:41 balboa systemd[1]: Started Basic Little Book of Answers, 
'rocksdb' Backend.
Jun 10 17:13:41 balboa balboa-rocksdb[4077]:  (blb_rocksdb_open) rocksdb_open() 
failed: `Invalid argument: Compression type LZ4 is not linked with the binary.`
Jun 10 17:13:03 balboa systemd[1]: Started Basic Little Book of Answers.
Jun 10 17:13:03 balboa balboa[1552]: time="2022-06-10T17:13:03Z" level=info 
msg="switching to log file /var/log/balboa.log"
● balboa.service - Basic Little Book of Answers
     Loaded: loaded (/lib/systemd/system/balboa.service; enabled; vendor 
preset: enabled)
    Drop-In: /run/systemd/system/service.d
             └─zzz-lxc-service.conf
     Active: active (running) since Fri 2022-06-10 17:13:03 UTC; 37s ago
       Docs: https://github.com/DCSO/balboa
   Main PID: 1552 (balboa)
      Tasks: 17 (limit: 37953)
     Memory: 33.5M
        CPU: 303ms
     CGroup: /system.slice/balboa.service
             └─1552 /usr/bin/balboa serve -f /etc/balboa/feeders.yaml -l 
/var/log/balboa.log

Jun 10 17:13:03 balboa systemd[1]: Started Basic Little Book of Answers.
Jun 10 17:13:03 balboa balboa[1552]: time="2022-06-10T17:13:03Z" level=info 
msg="switching to log file /var/log/balboa.log"
{"level":"info","msg":"starting feeder HTTP 
Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"accepting submissions on port 
8081","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"starting feeder Socket 
Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"starting feeder Suricata Socket 
Input","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:03Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 
127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"serving GraphQL on port 
8080","time":"2022-06-10T17:13:03Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:13Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 
127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:13Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:13Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:23Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 
127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:23Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:23Z"}
{"level":"info","msg":"got 1562529 bytes via 
HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 
observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via 
HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 
observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via 
HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 
observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via 
HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"enqueued 11931 
observations","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"got 1562529 bytes via 
HTTP","time":"2022-06-10T17:13:30Z"}
{"level":"info","msg":"ConsumeFeed() starting","time":"2022-06-10T17:13:33Z"}
{"level":"warning","msg":"connecting to backend failed: dial tcp 
127.0.0.1:4242: connect: connection refused","time":"2022-06-10T17:13:33Z"}
{"level":"info","msg":"ConsumeFeed() finished","time":"2022-06-10T17:13:33Z"}
Terminated
[...]

This definitely looks to me like it warrants further investigation before
promoting new rocksdb (and balboa) to testing.

Cheers,
-- 
Steve Langasek                   Give me a lever long enough and a Free OS
Debian Developer                   to set it on, and I can move the world.
Ubuntu Developer                                   https://www.debian.org/
slanga...@ubuntu.com                                     vor...@debian.org

Attachment: signature.asc
Description: PGP signature

Reply via email to