Ubuntu's network-manager has been using a configure flag --enable-lto https://launchpad.net/ubuntu/+source/network-manager/1.30.0-1ubuntu2
Michael, do you want to try that? And I believe on Debian you would still need the special optimize=+lto build option. Thank you, Jeremy Bicha