On 2023/09/11 22:12, Theo Buehler wrote:
> On Mon, Sep 11, 2023 at 08:49:13PM +0100, Stuart Henderson wrote:
> > On 2023/09/11 21:48, Theo Buehler wrote:
> > > On Mon, Sep 11, 2023 at 09:41:39PM +0200, Bjorn Ketelaars wrote:
> > > > Diff below switches sysutils/borgbackup/2.0 from OpenSSL-1.1 to
> > > > OpenSSL-3.0. Reason to switch is the EOL status of OpenSSL-1.1.1.
> > >
> > > If you land this, please also update the comments regarding bumps at the
> > > top of the openssl/1.1 and openssl/3.0 Makefiles.
> > >
> > > Has anyone ever tested borgbackup on BTI/IBT machines?
> > >
> >
> > Works fine with borgbackup/1.2, but I don't think that uses OCB.
>
> My understanding is that only 2.0 links against OpenSSL, so 1.2 should
> be fine anyway.
>
> The rason I'm asking is that I am still unclear to what extent OpenSSL
> and its consumers are affected by BTI. robert hit some things with node
> and thus switched it to 3.1 because of its native BTI/IBT support.
>
> For borgbackup/2.0 it is not entirely obvious what parts are routed
> through hashlib/LibreSSL and which parts are directly pulled in from
> the statically linked openssl. It might be worth running regress tests
> on a capable machine and if there are issues use 3.1 instead.
Seems OK as long as the test suite is enough to exercise this.
===> Regression tests for borgbackup-2.0.0b6p3
============================= test session starts ==============================
platform openbsd7 -- Python 3.10.12, pytest-7.1.3, pluggy-1.2.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False
min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10
warmup=False warmup_iterations=100000)
Tests enabled: root, symlinks, hardlinks, atime/mtime, modes
Tests disabled: BSD flags, fuse2, fuse3
rootdir: /usr/obj/ports/borgbackup-2.0.0b6/borgbackup-2.0.0b6, configfile:
setup.cfg
plugins: xdist-3.3.1, benchmark-4.0.0
collected 1695 items
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archive.py ...... [ 0%]
................................ [ 2%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/benchmark.py .... [ 2%]
................................................ [ 5%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/cache.py ........ [ 5%]
........................................................................ [ 10%]
[ 10%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/checksums.py .. [ 10%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/chunker.py ...... [ 10%]
... [ 10%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/chunker_pytest.py s [
10%]
sssssssssssssssssss.. [ 11%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/chunker_slow.py . [ 12%]
[ 12%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/compress.py ..... [ 12%]
....................................... [ 14%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/crypto.py ....... [ 15%]
......... [ 15%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/efficient_collection_queue.py
. [ 15%]
.. [ 15%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/file_integrity.py . [
15%]
.................. [ 16%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/hashindex.py .... [ 17%]
....................................... [ 19%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/hashindex_pytest.py s [
19%]
.s [ 19%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/helpers.py ...... [ 19%]
........................................................................ [ 24%]
.......................................................... [ 27%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/item.py ......... [ 28%]
............ [ 28%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/key.py .......... [ 29%]
................................................ [ 32%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/locking.py ...... [ 32%]
............... [ 33%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/logger.py .... [ 33%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/lrucache.py .. [ 33%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/nanorst.py ...... [ 34%]
.. [ 34%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/patterns.py ..... [ 34%]
........................................................................ [ 38%]
....................................................................... [ 43%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/platform.py sssss [ 43%]
sss.. [ 43%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/remote.py ....... [ 44%]
........................................ [ 46%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/repoobj.py ... [ 46%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/repository.py ... [ 46%]
........................................................................ [ 51%]
......... [ 51%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/shellpattern.py . [ 51%]
........................................................................ [ 55%]
.. [ 55%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/version.py ...... [ 56%]
..................... [ 57%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/xattr.py sss.... [ 57%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/argparsing.py .
[ 58%]
.......... [ 58%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/benchmark_cmd.py
. [ 58%]
[ 58%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/bypass_lock_option.py
. [ 58%]
.....s [ 59%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/check_cmd.py .
[ 59%]
...............ss........sssssssssssss [ 61%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/checks.py . [
61%]
...........s.....................s.... [ 63%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/config_cmd.py .
[ 63%]
s [ 63%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/corruption.py .
[ 63%]
.... [ 64%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/create_cmd.py .
[ 64%]
...........................................s............................ [ 68%]
.......................s.......sssssssssssssssssssssssssssssssssssssssss [ 72%]
sssssssssss [ 73%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/debug_cmds.py .
[ 73%]
.................sssssssss [ 74%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/delete_cmd.py .
[ 74%]
.......ssss [ 75%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/diff_cmd.py . [
75%]
.....sss [ 76%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/disk_full.py s
[ 76%]
[ 76%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/extract_cmd.py
. [ 76%]
s...sss...........ss.......s...sss...........ss......sssssssssssssssssss [ 80%]
ssssssss [ 81%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/help_cmd.py . [
81%]
........................................................ [ 84%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/info_cmd.py . [
84%]
.....sss [ 84%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/key_cmds.py . [
84%]
.................................sssssssssssssssss [ 87%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/list_cmd.py . [
87%]
.........sssss [ 88%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/lock_cmds.py .
[ 88%]
...ss [ 89%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/mount_cmds.py s
[ 89%]
sssssssssssssssss [ 90%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/patterns.py . [
90%]
.. [ 90%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/prune_cmd.py .
[ 90%]
.........sssss [ 91%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rcompress_cmd.py
. [ 91%]
[ 91%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rcreate_cmd.py
. [ 91%]
.........sssss [ 92%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rdelete_cmd.py
. [ 92%]
.s [ 92%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/recreate_cmd.py
. [ 92%]
.................................sssssssssssssssss [ 95%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rename_cmd.py .
[ 95%]
.s [ 95%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/return_codes.py
. [ 95%]
[ 95%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rinfo_cmd.py .
[ 95%]
.......ssss [ 96%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/rlist_cmd.py .
[ 96%]
...........ssssss [ 97%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/serve_cmd.py .
[ 97%]
. [ 97%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/tar_cmds.py s [
97%]
ssssss.....sssssss.....ssssssssssss [ 99%]
build/lib.openbsd-7.3-amd64-cpython-310/borg/testsuite/archiver/transfer_cmd.py
. [ 99%]
..sss [100%]
----------------------------------------------------------------------------------------------------------------------
benchmark: 52 tests
-----------------------------------------------------------------------------------------------------------------------
Name (time in us) Min
Max Mean StdDev
Median IQR Outliers OPS
Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_propdict_attributes[Item-deleted-False] 1.9450 (1.0)
18.4020 (1.00) 2.0199 (1.0) 0.1088 (inf)
1.9930 (1.0) 0.0230 (inf) 10944;11831 495,062.0056 (1.0)
86141 1
test_propdict_attributes[Item-size-1000] 1.9510 (1.00)
25.2030 (1.37) 2.0297 (1.00) 0.1448 (inf)
1.9980 (1.00) 0.0230 (inf) 6035;7135 492,689.8684 (1.00)
44317 1
test_propdict_attributes[Item-mode-1911] 1.9650 (1.01)
18.3760 (1.0) 2.0619 (1.02) 0.1815 (inf)
2.0120 (1.01) 0.0341 (inf) 799;16063 484,991.5778 (0.98)
69358 1
test_info[zeros-python-none-none] 804,326.2910 (>1000.0)
1,119,409.4200 (>1000.0) 913,548.4922 (>1000.0) 120,191.2768 (inf)
880,530.2300 (>1000.0) 98,939.3367 (inf) 1;1 1.0946 (0.00)
5 1
test_info[random-python-none-none] 804,624.0950 (>1000.0)
1,190,299.0340 (>1000.0) 947,904.8820 (>1000.0) 164,258.5630 (inf)
881,937.3720 (>1000.0) 259,836.6855 (inf) 1;0 1.0550 (0.00)
5 1
test_check[zeros-python-lz4-none] 813,130.4940 (>1000.0)
1,191,371.2840 (>1000.0) 1,001,272.3630 (>1000.0) 149,265.5401 (inf)
976,702.5310 (>1000.0) 231,736.3975 (inf) 2;0 0.9987 (0.00)
5 1
test_check[random-python-none-none] 816,752.8670 (>1000.0)
1,196,776.7050 (>1000.0) 1,085,152.4830 (>1000.0) 152,418.6187 (inf)
1,143,051.1710 (>1000.0) 109,504.8726 (inf) 1;1 0.9215
(0.00) 5 1
test_list[zeros-python-none-none] 821,086.8600 (>1000.0)
1,178,949.4500 (>1000.0) 1,011,289.4620 (>1000.0) 130,967.6291 (inf)
1,028,866.4550 (>1000.0) 156,563.6063 (inf) 2;0 0.9888
(0.00) 5 1
test_info[random-python-lz4-none] 821,220.3790 (>1000.0)
1,201,618.9440 (>1000.0) 992,875.2390 (>1000.0) 149,112.8727 (inf)
995,359.1940 (>1000.0) 225,479.3128 (inf) 2;0 1.0072 (0.00)
5 1
test_check[random-python-none-repokey-aes-ocb] 822,111.7460 (>1000.0)
1,216,518.2720 (>1000.0) 1,056,092.3714 (>1000.0) 184,129.1183 (inf)
1,167,590.0880 (>1000.0) 315,918.3218 (inf) 1;0 0.9469
(0.00) 5 1
test_check[zeros-python-none-none] 824,954.8900 (>1000.0)
1,129,598.3900 (>1000.0) 977,825.3988 (>1000.0) 124,001.8268 (inf)
1,007,481.2990 (>1000.0) 200,823.9422 (inf) 2;0 1.0227
(0.00) 5 1
test_list[zeros-python-lz4-none] 838,352.2840 (>1000.0)
1,204,115.4940 (>1000.0) 1,085,444.6452 (>1000.0) 146,838.3344 (inf)
1,128,902.3220 (>1000.0) 170,888.3145 (inf) 1;0 0.9213
(0.00) 5 1
test_info[random-python-none-repokey-aes-ocb] 852,163.8340 (>1000.0)
1,057,530.2900 (>1000.0) 956,996.5642 (>1000.0) 83,008.4514 (inf)
983,772.8430 (>1000.0) 129,967.2130 (inf) 2;0 1.0449 (0.00)
5 1
test_check[zeros-python-none-repokey-aes-ocb] 858,247.6560 (>1000.0)
1,186,795.7590 (>1000.0) 1,002,877.3778 (>1000.0) 122,357.8418 (inf)
968,387.0890 (>1000.0) 148,722.0430 (inf) 2;0 0.9971 (0.00)
5 1
test_list[zeros-python-lz4-repokey-aes-ocb] 862,574.4380 (>1000.0)
1,127,647.9630 (>1000.0) 1,000,312.8442 (>1000.0) 95,754.3084 (inf)
994,790.0180 (>1000.0) 104,980.6917 (inf) 2;0 0.9997 (0.00)
5 1
test_check[zeros-python-lz4-repokey-aes-ocb] 865,544.4390 (>1000.0)
1,271,349.4070 (>1000.0) 1,029,136.6814 (>1000.0) 152,467.5490 (inf)
1,006,599.3230 (>1000.0) 179,935.7720 (inf) 2;0 0.9717
(0.00) 5 1
test_check[random-python-lz4-repokey-aes-ocb] 871,756.3230 (>1000.0)
1,137,622.3470 (>1000.0) 983,962.4646 (>1000.0) 108,442.3819 (inf)
949,565.6990 (>1000.0) 170,548.4850 (inf) 2;0 1.0163 (0.00)
5 1
test_extract[random-python-lz4-none] 882,796.6090 (>1000.0)
882,796.6090 (>1000.0) 882,796.6090 (>1000.0) 0.0000 (1.0)
882,796.6090 (>1000.0) 0.0000 (1.0) 0;0 1.1328 (0.00)
1 1
test_list[zeros-python-none-repokey-aes-ocb] 883,815.0400 (>1000.0)
1,166,921.7970 (>1000.0) 1,079,453.9690 (>1000.0) 113,552.1723 (inf)
1,128,922.9450 (>1000.0) 111,595.1940 (inf) 1;0 0.9264
(0.00) 5 1
test_extract[zeros-python-lz4-none] 884,261.8680 (>1000.0)
884,261.8680 (>1000.0) 884,261.8680 (>1000.0) 0.0000 (1.0)
884,261.8680 (>1000.0) 0.0000 (1.0) 0;0 1.1309 (0.00)
1 1
test_list[random-python-lz4-none] 896,641.3060 (>1000.0)
979,222.8800 (>1000.0) 955,801.7192 (>1000.0) 34,340.9460 (inf)
967,616.0780 (>1000.0) 37,176.6490 (inf) 1;0 1.0462 (0.00)
5 1
test_delete[zeros-python-lz4-repokey-aes-ocb] 897,272.1780 (>1000.0)
897,272.1780 (>1000.0) 897,272.1780 (>1000.0) 0.0000 (1.0)
897,272.1780 (>1000.0) 0.0000 (1.0) 0;0 1.1145 (0.00)
1 1
test_delete[zeros-python-none-repokey-aes-ocb] 897,395.9070 (>1000.0)
897,395.9070 (>1000.0) 897,395.9070 (>1000.0) 0.0000 (1.0)
897,395.9070 (>1000.0) 0.0000 (1.0) 0;0 1.1143 (0.00)
1 1
test_extract[random-python-lz4-repokey-aes-ocb] 900,815.2430 (>1000.0)
900,815.2430 (>1000.0) 900,815.2430 (>1000.0) 0.0000 (1.0)
900,815.2430 (>1000.0) 0.0000 (1.0) 0;0 1.1101 (0.00)
1 1
test_info[random-python-lz4-repokey-aes-ocb] 920,901.7140 (>1000.0)
1,169,002.1810 (>1000.0) 1,089,048.5338 (>1000.0) 103,381.2585 (inf)
1,147,194.4410 (>1000.0) 131,191.4990 (inf) 1;0 0.9182
(0.00) 5 1
test_list[random-python-none-repokey-aes-ocb] 932,962.1610 (>1000.0)
1,126,055.2590 (>1000.0) 1,012,014.7000 (>1000.0) 78,532.6568 (inf)
990,045.9190 (>1000.0) 122,121.2933 (inf) 2;0 0.9881 (0.00)
5 1
test_create_lz4[zeros-python-repokey-aes-ocb] 940,503.7550 (>1000.0)
940,503.7550 (>1000.0) 940,503.7550 (>1000.0) 0.0000 (1.0)
940,503.7550 (>1000.0) 0.0000 (1.0) 0;0 1.0633 (0.00)
1 1
test_create_lz4[random-python-repokey-aes-ocb] 949,029.0600 (>1000.0)
949,029.0600 (>1000.0) 949,029.0600 (>1000.0) 0.0000 (1.0)
949,029.0600 (>1000.0) 0.0000 (1.0) 0;0 1.0537 (0.00)
1 1
test_help[python] 951,576.8740 (>1000.0)
976,126.6620 (>1000.0) 962,907.6538 (>1000.0) 10,948.6552 (inf)
957,381.6930 (>1000.0) 18,651.9185 (inf) 2;0 1.0385 (0.00)
5 1
test_delete[zeros-python-none-none] 966,869.7840 (>1000.0)
966,869.7840 (>1000.0) 966,869.7840 (>1000.0) 0.0000 (1.0)
966,869.7840 (>1000.0) 0.0000 (1.0) 0;0 1.0343 (0.00)
1 1
test_delete[random-python-none-repokey-aes-ocb] 969,138.1400 (>1000.0)
969,138.1400 (>1000.0) 969,138.1400 (>1000.0) 0.0000 (1.0)
969,138.1400 (>1000.0) 0.0000 (1.0) 0;0 1.0318 (0.00)
1 1
test_info[zeros-python-lz4-repokey-aes-ocb] 973,170.8320 (>1000.0)
1,123,825.2670 (>1000.0) 1,033,492.0644 (>1000.0) 56,991.3460 (inf)
1,032,579.3000 (>1000.0) 67,078.5375 (inf) 2;0 0.9676
(0.00) 5 1
test_info[zeros-python-none-repokey-aes-ocb] 981,745.3300 (>1000.0)
1,186,910.6020 (>1000.0) 1,074,418.9798 (>1000.0) 78,647.0335 (inf)
1,088,507.1310 (>1000.0) 106,663.1070 (inf) 2;0 0.9307
(0.00) 5 1
test_list[random-python-lz4-repokey-aes-ocb] 984,508.6189 (>1000.0)
1,185,759.6550 (>1000.0) 1,076,094.4584 (>1000.0) 98,749.6883 (inf)
1,033,101.4580 (>1000.0) 186,279.4626 (inf) 2;0 0.9293
(0.00) 5 1
test_extract[random-python-none-none] 985,498.2060 (>1000.0)
985,498.2060 (>1000.0) 985,498.2060 (>1000.0) 0.0000 (1.0)
985,498.2060 (>1000.0) 0.0000 (1.0) 0;0 1.0147 (0.00)
1 1
test_info[zeros-python-lz4-none] 986,085.0930 (>1000.0)
1,132,938.0510 (>1000.0) 1,021,871.3946 (>1000.0) 62,403.6076 (inf)
999,074.7990 (>1000.0) 45,160.1294 (inf) 1;1 0.9786 (0.00)
5 1
test_delete[random-python-lz4-repokey-aes-ocb] 1,001,377.4870 (>1000.0)
1,001,377.4870 (>1000.0) 1,001,377.4870 (>1000.0) 0.0000 (1.0)
1,001,377.4870 (>1000.0) 0.0000 (1.0) 0;0 0.9986
(0.00) 1 1
test_check[random-python-lz4-none] 1,008,359.2550 (>1000.0)
1,237,037.0470 (>1000.0) 1,121,208.6944 (>1000.0) 99,053.0476 (inf)
1,110,582.4700 (>1000.0) 177,882.9410 (inf) 2;0 0.8919
(0.00) 5 1
test_list[random-python-none-none] 1,026,739.8460 (>1000.0)
1,187,280.5370 (>1000.0) 1,099,857.6596 (>1000.0) 71,066.8864 (inf)
1,112,655.4750 (>1000.0) 126,837.0418 (inf) 3;0 0.9092
(0.00) 5 1
test_delete[random-python-none-none] 1,042,522.7310 (>1000.0)
1,042,522.7310 (>1000.0) 1,042,522.7310 (>1000.0) 0.0000 (1.0)
1,042,522.7310 (>1000.0) 0.0000 (1.0) 0;0 0.9592
(0.00) 1 1
test_extract[random-python-none-repokey-aes-ocb] 1,084,405.5670 (>1000.0)
1,084,405.5670 (>1000.0) 1,084,405.5670 (>1000.0) 0.0000 (1.0)
1,084,405.5670 (>1000.0) 0.0000 (1.0) 0;0 0.9222
(0.00) 1 1
test_create_none[random-python-none] 1,101,507.4650 (>1000.0)
1,101,507.4650 (>1000.0) 1,101,507.4650 (>1000.0) 0.0000 (1.0)
1,101,507.4650 (>1000.0) 0.0000 (1.0) 0;0 0.9078
(0.00) 1 1
test_delete[zeros-python-lz4-none] 1,112,457.0410 (>1000.0)
1,112,457.0410 (>1000.0) 1,112,457.0410 (>1000.0) 0.0000 (1.0)
1,112,457.0410 (>1000.0) 0.0000 (1.0) 0;0 0.8989
(0.00) 1 1
test_create_none[zeros-python-none] 1,121,092.1760 (>1000.0)
1,121,092.1760 (>1000.0) 1,121,092.1760 (>1000.0) 0.0000 (1.0)
1,121,092.1760 (>1000.0) 0.0000 (1.0) 0;0 0.8920
(0.00) 1 1
test_extract[zeros-python-none-none] 1,125,892.5820 (>1000.0)
1,125,892.5820 (>1000.0) 1,125,892.5820 (>1000.0) 0.0000 (1.0)
1,125,892.5820 (>1000.0) 0.0000 (1.0) 0;0 0.8882
(0.00) 1 1
test_extract[zeros-python-none-repokey-aes-ocb] 1,127,211.4080 (>1000.0)
1,127,211.4080 (>1000.0) 1,127,211.4080 (>1000.0) 0.0000 (1.0)
1,127,211.4080 (>1000.0) 0.0000 (1.0) 0;0 0.8871
(0.00) 1 1
test_delete[random-python-lz4-none] 1,139,564.0440 (>1000.0)
1,139,564.0440 (>1000.0) 1,139,564.0440 (>1000.0) 0.0000 (1.0)
1,139,564.0440 (>1000.0) 0.0000 (1.0) 0;0 0.8775
(0.00) 1 1
test_create_lz4[random-python-none] 1,341,845.2330 (>1000.0)
1,341,845.2330 (>1000.0) 1,341,845.2330 (>1000.0) 0.0000 (1.0)
1,341,845.2330 (>1000.0) 0.0000 (1.0) 0;0 0.7452
(0.00) 1 1
test_create_none[random-python-repokey-aes-ocb] 1,349,441.1370 (>1000.0)
1,349,441.1370 (>1000.0) 1,349,441.1370 (>1000.0) 0.0000 (1.0)
1,349,441.1370 (>1000.0) 0.0000 (1.0) 0;0 0.7410
(0.00) 1 1
test_create_lz4[zeros-python-none] 1,368,210.0900 (>1000.0)
1,368,210.0900 (>1000.0) 1,368,210.0900 (>1000.0) 0.0000 (1.0)
1,368,210.0900 (>1000.0) 0.0000 (1.0) 0;0 0.7309
(0.00) 1 1
test_create_none[zeros-python-repokey-aes-ocb] 1,434,839.4489 (>1000.0)
1,434,839.4489 (>1000.0) 1,434,839.4489 (>1000.0) 0.0000 (1.0)
1,434,839.4489 (>1000.0) 0.0000 (1.0) 0;0 0.6969
(0.00) 1 1
test_extract[zeros-python-lz4-repokey-aes-ocb] 1,452,424.6550 (>1000.0)
1,452,424.6550 (>1000.0) 1,452,424.6550 (>1000.0) 0.0000 (1.0)
1,452,424.6550 (>1000.0) 0.0000 (1.0) 0;0 0.6885
(0.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from
1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================ 1420 passed, 275 skipped in 1276.34s (0:21:16) ================
