Since updating to OpenBSD 7.3 and unifi-7.3.83, I've been having some
weird issues with my APs not adopting properly.
Any thoughts on how to further debug this? I backed up my config and
made a new unifi install that suffers the same issues.
I'm not entirely sure this is the cause of the adoption issues, but it
seems to be using the wrong snappy, using a pure-java implementation
that has been removed in newer versions of snappy-java.
I'm seeing the AP POST to /inform, and getting back a 500 error.
13:10:36.235613 f4:92:bf:a5:5d:5c 00:a0:98:0c:88:67 0800 1514:
172.16.40.21.35180 > 172.16.40.50.8080: . 1:1449(1448) ack 1 win 913
<nop,nop,timestamp 634800 1330034802> (DF) (ttl 64, id 60323, len 1500)
0000: 00a0 980c 8867 f492 bfa5 5d5c 0800 4500 .....g....]\..E.
0010: 05dc eba3 4000 4006 a110 ac10 2815 ac10 ....@.@.....(...
0020: 2832 896c 1f90 517b 4412 29ab 957c 8010 (2.l..Q{D.)..|..
0030: 0391 fd0f 0000 0101 080a 0009 afb0 4f46 ..............OF
0040: b872 504f 5354 202f 696e 666f 726d 2048 .rPOST /inform H
0050: 5454 502f 312e 310d 0a48 6f73 743a 2031 TTP/1.1..Host: 1
0060: 3732 2e31 362e 3430 2e35 303a 3830 3830 72.16.40.50:8080
0070: 0d0a 4163 ..Ac
...
13:10:36.241555 00:a0:98:0c:88:67 f4:92:bf:a5:5d:5c 0800 676: 172.16.40.50.8080
> 172.16.40.21.35180: P 1:611(610) ack 5891 win 271 <nop,nop,timestamp
1330034812 634800> (DF) (ttl 64, id 58486, len 662)
0000: f492 bfa5 5d5c 00a0 980c 8867 0800 4500 ....]\.....g..E.
0010: 0296 e476 4000 4006 ab83 ac10 2832 ac10 ...v@.@.....(2..
0020: 2815 1f90 896c 29ab 957c 517b 5b14 8018 (....l)..|Q{[...
0030: 010f ea25 0000 0101 080a 4f46 b87c 0009 ...%......OF.|..
0040: afb0 4854 5450 2f31 2e31 2035 3030 200d ..HTTP/1.1 500 .
0050: 0a43 6f6e 7465 6e74 2d54 7970 653a 2074 .Content-Type: t
0060: 6578 742f 6874 6d6c 3b63 6861 7273 6574 ext/html;charset
0070: 3d75 7466 =utf
Looking in the unifi/server.log, this seems to correspond with this log
message (the long java stack trace trimmed, but if you want it, I'm
happy to send).
[2023-05-21T13:10:36,238] <inform-4> ERROR [InformServlet] - Servlet.service()
for servlet [InformServlet] in context with path [] threw exception
java.lang.UnsupportedOperationException: isValidCompressedBuffer is not
supported in pure-java mode
at
org.xerial.snappy.pure.PureJavaSnappy.isValidCompressedBuffer(PureJavaSnappy.java:259)
~[snappy-java-1.1.8.4.jar:1.1.8.4]
Some searching, suggests that this happens when snappy-java doesn't find
the "real" snappy and falls back to a pure-java implementation has since
been removed, but I'm not sure how to debug why it's not finding the
real one. One suspicious thing is that I see mentions of SNAPPY_V=1.1.8
snappy-java/Makefile, but I have snappy-1.1.9 installed.
https://github.com/xerial/snappy-java/blob/master/Milestone.md#snappy-java-1176-2020-06-26
https://github.com/xerial/snappy-java/tree/1.1.7.6#using-pure-java-snappy-implementation
Not sure if it's helpful, but this is on an bhyve vm. I can provide a
full dmesg as well, but that also seems like a distraction.
kern.version=OpenBSD 7.3 (GENERIC.MP) #1125: Sat Mar 25 10:36:29 MDT 2023
dera...@amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
boost-1.80.0p2v0 free peer-reviewed portable C++ source libraries
bzip2-1.0.8p0 block-sorting file compressor, unencumbered
cairo-1.17.8 vector graphics library
curl-8.1.0 transfer files with FTP, HTTP, HTTPS, etc.
cyrus-sasl-2.1.28 RFC 2222 SASL (Simple Authentication and Security Layer)
gettext-runtime-0.21.1 GNU gettext runtime libraries and programs
giflib-5.2.1 tools and library routines for working with GIF images
glib2-2.74.6 general-purpose utility library
graphite2-1.3.14 rendering for complex writing systems
harfbuzz-7.1.0 text shaping library
icu4c-72.1v0 International Components for Unicode
javaPathHelper-2.2 helper script for launching java applications
jdk-11.0.18.10.1p0v0 OpenJDK Software Development Kit v11.0.18+10-1
jpeg-2.1.4v0 SIMD-accelerated JPEG codec replacement of libjpeg
lcms2-2.14 color management library
libffi-3.4.4 Foreign Function Interface
libiconv-1.17 character set conversion library
libstemmer-2.2.0 stemming algorithms for text processing
libxml-2.10.4 XML parsing library
lz4-1.9.4 fast BSD-licensed data compression
lzo2-2.10p2 portable speedy lossless data compression library
mongodb-3.6.23p2 scalable, high-performance document-oriented database
nghttp2-1.52.0 library for HTTP/2
nghttp3-0.9.0 implementation of HTTP/3
ngtcp2-0.13.1 implementation of the RFC 9000 QUIC protocol
openldap-client-2.6.4v0 LDAP client library and tools
pcre-8.44 perl-compatible regular expression library
pcre2-10.37p1 perl-compatible regular expression library, version 2
png-1.6.39 library for manipulating PNG images
python-3.10.11 interpreted object-oriented programming language
quirks-6.121 exceptions to pkg_add rules and cache
snappy-1.1.9 fast compression/decompression library
sqlite3-3.41.0 embedded SQL implementation
tiff-4.5.0p0 tools and library routines for working with TIFF images
unifi-7.3.83 controller for Ubiquiti uniFi (wifi/routing/switching/voip)
xz-5.4.1 library and tools for XZ and LZMA compressed files
yaml-cpp-0.6.3 YAML parser and emitter in C++
zabbix-agent-6.2.6p0 network and application monitoring - agent
zstd-1.5.5 zstandard fast real-time compression algorithm
