Hello all, I've performed some benchmarks following the instructions provided by Michele (https://github.com/freedomofpress/securedrop/issues/1861#issuecomment-554035468).
Please find attached the results. >From my tests its seems to not exist any particular performance loss; actually some tests results in a gain. please let me know if there is something else I could support retesting to possibly speed up the progress on the integration of the proposed patch. Best, Giovanni Il giorno sab 9 nov 2019 alle ore 18:19 Michele Orrù <michele.o...@ens.fr> ha scritto: >> >> seriously? For a few months you are writing emails without subject landing >> in >> my spam folder, and then you are starting threats? > > > Hi Doko, > > as I wrote privately immediately after: > >> reading back my email it sounds a lot like a threat. >> When I wrote the email I was just thinking that I should give a heads up >> because it's been now more than one month and I don't know what else to do >> besides asking other dd. >> >> So, please forgive the tone in my previous email Matthias. > > > I'm not trying to threaten you, I just want to help you out improve debian, > and from my (naïve) perspective reaching out to other DD was the logical > solution for no answer. > > That said, I'm sorry for the subject line. I'm relatively new here: I didn't > know if my b.d.o email will be processed adding the issue number in the > subject, and I didn't know if the subject will be embedded in the message and > cause confusion. Besides email to b.d.o: > - I tried to reach out to you on irc, over public channels and in private; > - people tried to reach out to you via ubuntu bug tracker: > https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/1452115. > Perhaps you can give me some slack, and we can all move on? Holger already > told me that was stupid. > > Now that this bug has come to your attention again: > >> I also doubt very much your numbers, 2.5 - 5 times slower is not expected. >> PIE >> has some impact, but not that bad. > > > Even before measuring performance loss (which could be due to intel turbo > being active on my machine for a start, and I'm happy to test again so that > you can double-check my steps), do you think performances are crucial for > enabling PIE on /usr/bin/python3? > > If not, would you mind if I try to help out updating the package? It's a > relatively easy issue and I could learn something about packaging in the > process. > If yes, could you please explain to me how this is different from python2? > > Apologising again, > -- > μ. -- Ing. Giovanni Pellerano - Founding Member and CTO giovanni.peller...@hermescenter.org | +39.328.9590046 HERMES - Center for Transparency and Digital Human Rights Associazione No Profit | Via Aretusa 34, IT-20129 Milan, Italy t. +39-02-87186005 (voicemail) | f. +39-02-87162573 TaxCode: IT-97621810155 | EuropeAid: IT-2012-AOD-0806909254 w. https://www.hermescenter.org | m. i...@hermescenter.org
pyperformance compare py3.7.json py3.7-pie.json py3.7.json ========== Performance version: 0.9.1 Report on Linux-4.19.0-5-amd64-x86_64-with-debian-10.2 Number of logical CPUs: 2 Start date: 2019-11-20 12:57:54.490063 End date: 2019-11-20 13:47:14.201201 py3.7-pie.json ============== Performance version: 0.9.1 Report on Linux-4.19.0-5-amd64-x86_64-with-debian-10.2 Number of logical CPUs: 2 Start date: 2019-11-20 14:42:16.831054 End date: 2019-11-20 15:32:38.021224 ### 2to3 ### Mean +- std dev: 1.48 sec +- 0.07 sec -> 1.49 sec +- 0.09 sec: 1.01x slower Not significant ### chameleon ### Mean +- std dev: 39.6 ms +- 2.8 ms -> 40.4 ms +- 3.8 ms: 1.02x slower Not significant ### chaos ### Mean +- std dev: 440 ms +- 27 ms -> 455 ms +- 31 ms: 1.03x slower Significant (t=-2.88) ### crypto_pyaes ### Mean +- std dev: 396 ms +- 27 ms -> 408 ms +- 31 ms: 1.03x slower Significant (t=-2.24) ### deltablue ### Mean +- std dev: 26.8 ms +- 2.9 ms -> 27.5 ms +- 2.6 ms: 1.03x slower Not significant ### django_template ### Mean +- std dev: 505 ms +- 37 ms -> 513 ms +- 46 ms: 1.02x slower Not significant ### dulwich_log ### Mean +- std dev: 261 ms +- 17 ms -> 263 ms +- 20 ms: 1.00x slower Not significant ### fannkuch ### Mean +- std dev: 1.52 sec +- 0.07 sec -> 1.51 sec +- 0.07 sec: 1.00x faster Not significant ### float ### Mean +- std dev: 391 ms +- 30 ms -> 409 ms +- 32 ms: 1.04x slower Significant (t=-3.05) ### genshi_text ### Mean +- std dev: 135 ms +- 14 ms -> 140 ms +- 14 ms: 1.04x slower Not significant ### genshi_xml ### Mean +- std dev: 286 ms +- 19 ms -> 289 ms +- 32 ms: 1.01x slower Not significant ### go ### Mean +- std dev: 925 ms +- 73 ms -> 970 ms +- 77 ms: 1.05x slower Significant (t=-3.33) ### hexiom ### Mean +- std dev: 33.3 ms +- 3.9 ms -> 36.8 ms +- 3.3 ms: 1.10x slower Significant (t=-5.21) ### html5lib ### Mean +- std dev: 378 ms +- 36 ms -> 381 ms +- 48 ms: 1.01x slower Not significant ### json_dumps ### Mean +- std dev: 47.5 ms +- 6.4 ms -> 47.7 ms +- 4.5 ms: 1.00x slower Not significant ### json_loads ### Mean +- std dev: 91.0 us +- 9.4 us -> 93.8 us +- 9.6 us: 1.03x slower Not significant ### logging_format ### Mean +- std dev: 40.4 us +- 3.1 us -> 42.9 us +- 3.9 us: 1.06x slower Significant (t=-3.91) ### logging_silent ### Mean +- std dev: 666 ns +- 69 ns -> 639 ns +- 86 ns: 1.04x faster Not significant ### logging_simple ### Mean +- std dev: 38.2 us +- 3.2 us -> 36.8 us +- 4.3 us: 1.04x faster Significant (t=2.01) ### mako ### Mean +- std dev: 65.6 ms +- 6.9 ms -> 66.9 ms +- 6.9 ms: 1.02x slower Not significant ### meteor_contest ### Mean +- std dev: 371 ms +- 32 ms -> 415 ms +- 29 ms: 1.12x slower Significant (t=-7.77) ### nbody ### Mean +- std dev: 439 ms +- 40 ms -> 470 ms +- 38 ms: 1.07x slower Significant (t=-4.26) ### nqueens ### Mean +- std dev: 332 ms +- 22 ms -> 370 ms +- 23 ms: 1.11x slower Significant (t=-9.26) ### pathlib ### Mean +- std dev: 78.3 ms +- 7.5 ms -> 80.1 ms +- 7.4 ms: 1.02x slower Not significant ### pickle ### Mean +- std dev: 35.2 us +- 4.7 us -> 36.4 us +- 4.0 us: 1.03x slower Not significant ### pickle_dict ### Mean +- std dev: 80.9 us +- 8.2 us -> 94.6 us +- 8.4 us: 1.17x slower Significant (t=-9.05) ### pickle_list ### Mean +- std dev: 11.9 us +- 1.1 us -> 12.4 us +- 1.4 us: 1.04x slower Significant (t=-2.32) ### pickle_pure_python ### Mean +- std dev: 1.83 ms +- 0.23 ms -> 2.00 ms +- 0.20 ms: 1.09x slower Significant (t=-4.24) ### pidigits ### Mean +- std dev: 489 ms +- 27 ms -> 511 ms +- 37 ms: 1.05x slower Significant (t=-3.80) ### python_startup ### Mean +- std dev: 39.6 ms +- 4.2 ms -> 40.5 ms +- 4.6 ms: 1.02x slower Significant (t=-2.02) ### python_startup_no_site ### Mean +- std dev: 27.7 ms +- 3.0 ms -> 28.1 ms +- 3.0 ms: 1.01x slower Not significant ### raytrace ### Mean +- std dev: 1.90 sec +- 0.09 sec -> 1.99 sec +- 0.09 sec: 1.04x slower Significant (t=-5.18) ### regex_compile ### Mean +- std dev: 695 ms +- 55 ms -> 740 ms +- 55 ms: 1.06x slower Significant (t=-4.42) ### regex_dna ### Mean +- std dev: 531 ms +- 40 ms -> 564 ms +- 38 ms: 1.06x slower Significant (t=-4.57) ### regex_effbot ### Mean +- std dev: 11.0 ms +- 0.9 ms -> 11.0 ms +- 1.4 ms: 1.00x slower Not significant ### regex_v8 ### Mean +- std dev: 74.1 ms +- 6.4 ms -> 79.9 ms +- 9.5 ms: 1.08x slower Significant (t=-3.93) ### richards ### Mean +- std dev: 253 ms +- 24 ms -> 288 ms +- 18 ms: 1.14x slower Significant (t=-8.97) ### scimark_fft ### Mean +- std dev: 1.22 sec +- 0.07 sec -> 1.27 sec +- 0.05 sec: 1.04x slower Significant (t=-4.00) ### scimark_lu ### Mean +- std dev: 573 ms +- 57 ms -> 597 ms +- 42 ms: 1.04x slower Significant (t=-2.55) ### scimark_monte_carlo ### Mean +- std dev: 347 ms +- 29 ms -> 378 ms +- 38 ms: 1.09x slower Significant (t=-4.96) ### scimark_sor ### Mean +- std dev: 626 ms +- 37 ms -> 651 ms +- 57 ms: 1.04x slower Significant (t=-2.77) ### scimark_sparse_mat_mult ### Mean +- std dev: 14.9 ms +- 1.5 ms -> 14.1 ms +- 1.8 ms: 1.06x faster Significant (t=2.80) ### spectral_norm ### Mean +- std dev: 434 ms +- 34 ms -> 476 ms +- 41 ms: 1.10x slower Significant (t=-6.04) ### sqlalchemy_declarative ### Mean +- std dev: 936 ms +- 72 ms -> 955 ms +- 52 ms: 1.02x slower Not significant ### sqlalchemy_imperative ### Mean +- std dev: 145 ms +- 27 ms -> 139 ms +- 23 ms: 1.04x faster Not significant ### sqlite_synth ### Mean +- std dev: 10.6 us +- 0.9 us -> 11.3 us +- 0.8 us: 1.07x slower Significant (t=-4.77) ### sympy_expand ### Mean +- std dev: 1.66 sec +- 0.09 sec -> 1.75 sec +- 0.10 sec: 1.05x slower Significant (t=-4.89) ### sympy_integrate ### Mean +- std dev: 105 ms +- 11 ms -> 115 ms +- 10 ms: 1.10x slower Significant (t=-5.49) ### sympy_str ### Mean +- std dev: 1.24 sec +- 0.08 sec -> 1.26 sec +- 0.08 sec: 1.02x slower Not significant ### sympy_sum ### Mean +- std dev: 883 ms +- 91 ms -> 928 ms +- 67 ms: 1.05x slower Significant (t=-3.09) ### telco ### Mean +- std dev: 24.0 ms +- 2.1 ms -> 23.7 ms +- 2.6 ms: 1.01x faster Not significant ### tornado_http ### Mean +- std dev: 1.54 sec +- 0.11 sec -> 1.55 sec +- 0.10 sec: 1.00x slower Not significant ### unpack_sequence ### Mean +- std dev: 158 ns +- 18 ns -> 152 ns +- 16 ns: 1.04x faster Significant (t=2.10) ### unpickle ### Mean +- std dev: 51.5 us +- 5.2 us -> 49.1 us +- 5.5 us: 1.05x faster Significant (t=2.49) ### unpickle_list ### Mean +- std dev: 12.4 us +- 1.1 us -> 12.4 us +- 1.1 us: 1.00x faster Not significant ### unpickle_pure_python ### Mean +- std dev: 1.37 ms +- 0.17 ms -> 1.44 ms +- 0.18 ms: 1.05x slower Significant (t=-2.10) ### xml_etree_generate ### Mean +- std dev: 408 ms +- 33 ms -> 407 ms +- 27 ms: 1.00x faster Not significant ### xml_etree_iterparse ### Mean +- std dev: 593 ms +- 49 ms -> 600 ms +- 47 ms: 1.01x slower Not significant ### xml_etree_parse ### Mean +- std dev: 687 ms +- 37 ms -> 685 ms +- 42 ms: 1.00x faster Not significant ### xml_etree_process ### Mean +- std dev: 332 ms +- 31 ms -> 352 ms +- 27 ms: 1.06x slower Significant (t=-3.94)
