[COMMITTED] Prepare for 0.179

2020-03-30 Thread Mark Wielaard
Set version to 0.179.
Update NEWS and elfutils.spec.in.
Regenerate po/*.po files.

Signed-off-by: Mark Wielaard 
---
 ChangeLog   |   5 +
 NEWS|  35 +++
 config/ChangeLog|   4 +
 config/elfutils.spec.in |  25 ++
 configure.ac|   2 +-
 po/ChangeLog|   4 +
 po/de.po| 571 +++
 po/es.po| 573 
 po/ja.po| 571 +++
 po/pl.po| 571 +++
 po/uk.po|   2 +-
 11 files changed, 1233 insertions(+), 1130 deletions(-)

diff --git a/ChangeLog b/ChangeLog
index 2c3ed13c..854568e0 100644
--- a/ChangeLog
+++ b/ChangeLog
@@ -1,3 +1,8 @@
+2020-03-30  Mark Wielaard  
+
+   * configure.ac: Set version to 0.179.
+   * NEWS: Add 0.179 section.
+
 2020-03-25  Mark Wielaard  
 
* README: Update mailinglist subscription info.
diff --git a/NEWS b/NEWS
index c147ad3c..d26dccec 100644
--- a/NEWS
+++ b/NEWS
@@ -1,3 +1,38 @@
+Version 0.179
+
+debuginfod-client: When DEBUGINFOD_PROGRESS is set and the program doesn't
+   install its own debuginfod_progressfn_t show download
+   progress on stderr.
+   DEBUGINFOD_TIMEOUT is now defined as seconds to get at
+   least 100K, defaults to 90 seconds.
+   Default to $XDG_CACHE_HOME/debuginfod_client.
+   New functions debuginfod_set_user_data,
+   debuginfod_get_user_data, debuginfod_get_url and
+   debuginfod_add_http_header.
+   Support for file:// URLs.
+
+debuginfod: Uses libarchive directly for reading rpm archives.
+Support for indexing .deb/.ddeb archives through dpkg-deb
+or bsdtar.
+Generic archive support through -Z EXT[=CMD]. Which can be
+used for example for arch-linux pacman files by using
+-Z '.tar.zst=zstdcat'.
+Better logging using User-Agent and X-Forwarded-For headers.
+More prometheus metrics.
+Support for eliding dots or extraneous slashes in path names.
+
+debuginfod-find: Accept /path/names in place of buildid hex.
+
+libelf: Handle PN_XNUM in elf_getphdrnum before shdr 0 is cached
+Ensure zlib resource cleanup on failure.
+
+libdwfl: dwfl_linux_kernel_find_elf and dwfl_linux_kernel_report_offline
+ now find and handle a compressed vmlinuz image.
+
+readelf, elflint: Handle PT_GNU_PROPERTY.
+
+translations: Updated Ukrainian translation.
+
 Version 0.178
 
 debuginfod: New server, client tool and library to index and fetch
diff --git a/config/ChangeLog b/config/ChangeLog
index 368f959e..b8ac8bc7 100644
--- a/config/ChangeLog
+++ b/config/ChangeLog
@@ -1,3 +1,7 @@
+2020-03-30  Mark Wielaard  
+
+   * elfutils.spec.in: Update for 0.179.
+
 2020-03-25  Frank Ch. Eigler 
 
* elfutils.spec.in: *Require: bsdtar instead of dpkg.
diff --git a/config/elfutils.spec.in b/config/elfutils.spec.in
index 6e243650..9f614882 100644
--- a/config/elfutils.spec.in
+++ b/config/elfutils.spec.in
@@ -327,6 +327,31 @@ exit 0
 %systemd_postun_with_restart debuginfod.service
 
 %changelog
+* Mon Mar 30 2020 Mark Wielaard  0.179-1
+- debuginfod-client: When DEBUGINFOD_PROGRESS is set and the program
+  doesn't install its own debuginfod_progressfn_t show download
+  progress on stderr.
+  DEBUGINFOD_TIMEOUT is now defined as seconds to get at least 100K,
+  defaults to 90 seconds.
+  Default to $XDG_CACHE_HOME/debuginfod_client.
+  New functions debuginfod_set_user_data, debuginfod_get_user_data,
+  debuginfod_get_url and debuginfod_add_http_header.
+  Support for file:// URLs.
+- debuginfod: Uses libarchive directly for reading rpm archives.
+  Support for indexing .deb/.ddeb archives through dpkg-deb or bsdtar.
+  Generic archive support through -Z EXT[=CMD]. Which can be used for
+  example for arch-linux pacman files by using -Z '.tar.zst=zstdcat'.
+  Better logging using User-Agent and X-Forwarded-For headers.
+  More prometheus metrics.
+  Support for eliding dots or extraneous slashes in path names.
+- debuginfod-find: Accept /path/names in place of buildid hex.
+- libelf: Handle PN_XNUM in elf_getphdrnum before shdr 0 is cached.
+  Ensure zlib resource cleanup on failure.
+- libdwfl: dwfl_linux_kernel_find_elf and dwfl_linux_kernel_report_offline
+  now find and handle a compressed vmlinuz image.
+- readelf, elflint: Handle PT_GNU_PROPERTY.
+- translations: Updated Ukrainian translation.
+
 * Tue Nov 26 2019 Mark Wielaard  0.178-1
 - debuginfod: New server, client tool and library to index and fetch
   ELF/DWARF files addressed by build-id through HTTP.
diff --git a/configure.ac b/configure.ac
index 14ad66f2..a39e800f 100644
--- a/configure.ac
+++ b/configure.ac
@@ -17,7 +17,7 @@ dnl  GNU General Public License for more

elfutils 0.179 released

2020-03-30 Thread Mark Wielaard
ELFUTILS 0.179 - http://elfutils.org/

A new release of elfutils is available at:
ftp://sourceware.org/pub/elfutils/0.179/
or https://sourceware.org/elfutils/ftp/0.179/

* NEWS *

debuginfod-client:

- When DEBUGINFOD_PROGRESS is set and the program doesn't
  install its own debuginfod_progressfn_t show download
  progress on stderr.
- DEBUGINFOD_TIMEOUT is now defined as seconds to get at
  least 100K, defaults to 90 seconds.
- Default to $XDG_CACHE_HOME/debuginfod_client.
- New functions debuginfod_set_user_data,
  debuginfod_get_user_data, debuginfod_get_url and
  debuginfod_add_http_header.
- Support for file:// URLs.

debuginfod:

- Performance improvements through highly parallelized scanning
  and archive content caching.
- Uses libarchive directly for reading rpm archives.
- Support for indexing .deb/.ddeb archives through dpkg-deb
  or bsdtar.
- Generic archive support through -Z EXT[=CMD]. Which can be
  used for example for arch-linux pacman files by using
  -Z '.tar.zst=zstdcat'.
- Better logging using User-Agent and X-Forwarded-For headers.
- More prometheus metrics.
- Support for eliding dots or extraneous slashes in path names.

debuginfod-find:

- Accept /path/names in place of buildid hex.

libelf:

- Handle PN_XNUM in elf_getphdrnum before shdr 0 is cached
- Ensure zlib resource cleanup on failure.

libdwfl:

- dwfl_linux_kernel_find_elf and dwfl_linux_kernel_report_offline
  now find and handle a compressed vmlinuz image.

readelf, elflint:

- Handle PT_GNU_PROPERTY.

translations:

- Updated Ukrainian translation.

* GIT SHORTLOG *

Aaron Merey (3):
  PR25365: debuginfod-client: restrict cleanup to client-pattern files
  debuginfod-client: default to XDG cache.
  debuginfod-client: Update cache_path when the new default path exists

Dmitry V. Levin (1):
  Do not install libdebuginfod.pc unless debuginfod is enabled

Eli Schwartz (1):
  debuginfod arch-linux test binaries

Frank Ch. Eigler (40):
  debuginfod: usability tweaks, incl. $DEBUGINFOD_PROGRESS client
  debuginfod server: support .deb/.ddeb archives
  debuginfod: pass a distro-summary User-Agent request header
  debuginfod: rework threading model for file/archive scanning
  debuginfod: print U-A: and X-F-F: request headers
  debuginfod: extracted-from-archive file cache
  elfutils.spec: dependency typo fix
  elfutils.spec: typo fix
  PR25415: fix debuginfod SEGV for empty search path list
  PR25394: debuginfod mutex between grooming and scanning
  PR25394 followup: debuginfod casting fixes
  PR25394 followup#2: debuginfod casting fixes
  PR25394 cont'd: debuginfod timing fix for fts-traversal thread
  PR25394 cont'd: debuginfod testsuite fix for -USR1 timing
  empty commit for irker test
  debuginfod: diagnostics verbosity tweak
  PR24393: debuginfod configury: tolerate CXX= configure invocations
  debuginfod test: assert curl & rpm2cpio during test prologue
  ChangeLog catchup for two recent commits
  debuginfod: generalized archive support
  debuginfod: testsuite for general archive (arch-linux) support
  debuginfod testing: SIGUSR2 vs "groom" metric synch
  PR25375: fdcache prefetching to reduce repeated archive decompression
  debuginfod PR25583: map -R to -Z.rpm
  debuginfod client API: add get/set user_data functions
  debuginfod client API: add get_url function
  debuginfod-find: Correct error check for -v source combo
  debuginfod-client thinko: non-default progressfn extra output
  PR25367: improve debuginfod webapi logging
  PR25548: support canonicalized source-path names in debuginfod webapi
  PR25548: CURLOPT_PATH_AS_IS backward compatibility
  PR25548: CURLOPT_PATH_AS_IS backward compatibility
  debuginfod: document and workaround fedora31 zstd compression
  PR25583: debuginfod: prefer bsdtar to dpkg for .deb handling
  PR25583: debuginfod: conditionally prefer bsdtar to dpkg for .deb
  PR25448: debuginfod: add transfer performance metrics
  debuginfod: User-Agent and X-Forwarded-For header relay
  PR25722: debuginfod-find: accept /path/names in place of buildid hex
  PR25739: debuginfod correct mtime for fdcache'd files
  debuginfod-client default_progressfn: formatting fix

Konrad Kleine (3):
  debuginfod.h: fix typo in comment: legnth -> length
  debuginfod/doc: Fix typo debuginfo_progressfn_t ->
  debuginfod_progressfn_t
  debuginfod: file:// URLs: handle curl resp. code

Mark Wielaard (27):
  config: versioned libdebuginfod libraries should not be in -devel
  config: Add an explicit Requires elfutils-debuginfod-client for
  debuginfod.
  libdwfl: Find and handle compressed vmlinuz image.
  debuginfod: Fix implicit conversion from 'CURLcode' to 'CURLMcode'
  tests: Run elfcompress under testrun in run-elfclassify.sh
  config: Update elfutils.spec with explicit sub-package requires.
  tests: Add break to avoid implicit-fallthrough warning
  tests: Run strip under testrun in run-debuginfod-find.sh
  Make sure to always build with build-ids.
  debuginfod: Check the DEBUGINFOD_URLS environme

[COMMITTED] config: chmod uploaded dir and files to make them readable.

2020-03-30 Thread Mark Wielaard
Default file permissions on sourceware have changed. Make sure that
the upload-release.sh script sets the permissions right.

Signed-off-by: Mark Wielaard 
---
 config/ChangeLog | 5 +
 config/upload-release.sh | 2 ++
 2 files changed, 7 insertions(+)

diff --git a/config/ChangeLog b/config/ChangeLog
index b8ac8bc7..b5cc1da5 100644
--- a/config/ChangeLog
+++ b/config/ChangeLog
@@ -1,3 +1,8 @@
+2020-03-30  Mark Wielaard  
+
+   * upload-release.sh: chmod uploaded dir and files to make them
+   readable.
+
 2020-03-30  Mark Wielaard  
 
* elfutils.spec.in: Update for 0.179.
diff --git a/config/upload-release.sh b/config/upload-release.sh
index df5e3a07..b52642ea 100755
--- a/config/upload-release.sh
+++ b/config/upload-release.sh
@@ -50,6 +50,8 @@ cp -r $VERSION $HOME/elfutils-$VERSION
 # Upload
 scp -r $VERSION sourceware.org:/sourceware/ftp/pub/elfutils/
 ssh sourceware.org "(cd /sourceware/ftp/pub/elfutils \
+  && chmod go+rx $VERSION \
+  && chmod go+r  $VERSION/elfutils-$VERSION.tar.bz2* \
   && ln -sf $VERSION/elfutils-$VERSION.tar.bz2 elfutils-latest.tar.bz2 \
   && ln -sf $VERSION/elfutils-$VERSION.tar.bz2.sig elfutils-latest.tar.bz2.sig 
\
   && ls -lah elfutils-latest*)"
-- 
2.20.1



patch, debuginfod web page

2020-03-30 Thread Frank Ch. Eigler via Elfutils-devel
Hi -

pushed:


Author: Frank Ch. Eigler 
Date:   Mon Mar 30 17:15:05 2020 -0400

debuginfod quick-setup advice, perf status update

diff --git a/Debuginfod.html b/Debuginfod.html
index 1a490557546f..d5c2d65fab4e 100644
--- a/Debuginfod.html
+++ b/Debuginfod.html
@@ -38,8 +38,13 @@
 [2020-02] welcome users.
   
   The first one federates to all the
-others, so DEBUGINFOD_URLS=https://debuginfod.elfutils.org/
-alone will get you to all of them.
+others, so
+
+export DEBUGINFOD_URLS=https://debuginfod.elfutils.org/
+export DEBUGINFOD_PROGRESS=1
+
+alone will get you to all of them, plus request
+basic progress diagnostics.
   
   
   
@@ -129,7 +134,7 @@
   in progress kkle...@redhat.com
 
 https://perf.wiki.kernel.org/index.php/Main_Page";>perf
-  help wanted
+  partially automatic via elfutils, help 
wanted
 
 https://www.freedesktop.org/software/systemd/man/systemd-coredump.html";>systemd-coredumpd
   https://github.com/systemd/systemd/issues/14711";>help 
wanted



[Bug general/24498] 0.176: isn't LTO ready

2020-03-30 Thread kloczko.tomasz at gmail dot com via Elfutils-devel
https://sourceware.org/bugzilla/show_bug.cgi?id=24498

--- Comment #6 from kloczek  ---
Just gave chance new 0.179 and latest rawhide gcc and looks like now set of
warnings treated as werrors is a bit different.

[tkloczko@barrel elfutils-0.179]$ make -k
make --no-print-directory all-recursive
Making all in config
make[2]: Nothing to be done for 'all'.
Making all in m4
make[2]: Nothing to be done for 'all'.
Making all in lib
make[2]: Nothing to be done for 'all'.
Making all in libelf
make[2]: Nothing to be done for 'all'.
Making all in libcpu
make[2]: Nothing to be done for 'all'.
Making all in backends
make[2]: Nothing to be done for 'all'.
Making all in libebl
make[2]: Nothing to be done for 'all'.
Making all in libdwelf
make[2]: Nothing to be done for 'all'.
Making all in libdwfl
make[2]: Nothing to be done for 'all'.
Making all in libdw
make  all-am
gcc -std=gnu99 -Wall -Wshadow -Wformat=2 -Wold-style-definition
-Wstrict-prototypes -Wtrampolines -Wlogical-op -Wduplicated-cond
-Wnull-dereference -Wimplicit-fallthrough=5 -Werror -Wunused -Wextra
-Wstack-usage=262144-O2 -g -pipe -Wall -Werror=format-security
-Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-protector-strong
-grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
-specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic
-fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
-flto=auto -flto-partition=none -Wformat  -Wl,-z,relro -Wl,--as-needed 
-Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -flto=auto
-flto-partition=none -fuse-linker-plugin -o libdw.so -shared -Wl,-z,defs
-Wl,-z,relro -o libdw.so \
-Wl,--soname,libdw.so.1,--enable-new-dtags \
-Wl,--version-script,libdw.map,--no-undefined \
-Wl,--whole-archive ../libebl/libebl_pic.a
../backends/libebl_backends_pic.a ../libcpu/libcpu_pic.a libdw_pic.a
../libdwelf/libdwelf_pic.a ../libdwfl/libdwfl_pic.a -Wl,--no-whole-archive \
../lib/libeu.a ../libelf/libelf.so -ldl -lz  -llzma -lbz2  -pthread
find-debuginfo.c: In function ‘dwfl_standard_find_debuginfo’:
debuginfod-client.c:85:8: error: ‘bits’ may be used uninitialized in this
function [-Werror=maybe-uninitialized]
find-debuginfo.c:360:24: note: ‘bits’ was declared here
lto1: all warnings being treated as errors
lto-wrapper: fatal error: gcc returned 1 exit status
compilation terminated.
/usr/bin/ld: error: lto-wrapper failed
collect2: error: ld returned 1 exit status
make[3]: *** [Makefile:1405: libdw.so] Error 1
make[3]: Target 'all-am' not remade because of errors.
make[2]: *** [Makefile:649: all] Error 2
Making all in libasm
make[2]: *** No rule to make target '../libdw/libdw.so', needed by 'libasm.so'.
make[2]: Target 'all' not remade because of errors.
Making all in src
make[2]: *** No rule to make target '../libdw/libdw.so', needed by 'readelf'.
gcc -std=gnu99 -Wall -Wshadow -Wformat=2 -Wold-style-definition
-Wstrict-prototypes -Wtrampolines -Wlogical-op -Wduplicated-cond
-Wnull-dereference -Wimplicit-fallthrough=5 -Werror -Wunused -Wextra
-Wstack-usage=262144   -O2 -g -pipe -Wall -Werror=format-security
-Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-protector-strong
-grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
-specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic
-fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
-flto=auto -flto-partition=none -Wformat -Wl,-rpath-link,../libelf:../libdw
-Wl,-z,relro -Wl,--as-needed  -Wl,-z,now
-specs=/usr/lib/rpm/redhat/redhat-hardened-ld -flto=auto -flto-partition=none
-fuse-linker-plugin -o size size.o ../libelf/libelf.so ../lib/libeu.a
size.c: In function ‘handle_elf’:
size.c:634:1: error: stack usage might be unbounded [-Werror=stack-usage=]
  634 | handle_elf (Elf *elf, const char *prefix, const char *fname)
  | ^
size.c: In function ‘handle_ar’:
size.c:341:1: error: stack usage might be unbounded [-Werror=stack-usage=]
  341 | handle_ar (int fd, Elf *elf, const char *prefix, const char *fname)
  | ^
lto1: all warnings being treated as errors
lto-wrapper: fatal error: gcc returned 1 exit status
compilation terminated.
/usr/bin/ld: error: lto-wrapper failed
collect2: error: ld returned 1 exit status
make[2]: *** [Makefile:670: size] Error 1
make[2]: *** No rule to make target '../libasm/libasm.so', needed by 'objdump'.
gcc -std=gnu99 -Wall -Wshadow -Wformat=2 -Wold-style-definition
-Wstrict-prototypes -Wtrampolines -Wlogical-op -Wduplicated-cond
-Wnull-dereference -Wimplicit-fallthrough=5 -Werror -Wunused -Wextra
-Wstack-usage=262144   -O2 -g -pipe -Wall -Werror=format-security
-Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fstack-protector-strong
-grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1
-specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic
-fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection
-flto=auto -flto-partition=none -Wformat -Wl,-rpath-link,../libelf:../libdw
-Wl,-z