Bug#916796: IEEEfull.bib: cannot be read in encoding 'utf8' by biber

[Damir Islamov]

Dear Dr. Dhell,


`á' in ISO-8859-1 8bit charset:
line 23, see `Nicolás Barabino' name.

This character breaks biblatex+biber.

Recoding from ISO-8859-1 to UTF-8 fixes the issue.

Below is scenario and input file.

$ pdflatex test
...
$ biber test
INFO - This is Biber 2.12
INFO - Logfile is 'test.blg'
INFO - Reading 'test.bcf'
INFO - Found 1 citekeys in bib section 0
INFO - Processing section 0
INFO - Looking for bibtex format file 'IEEEfull.bib' for section 0


INFO - ERRORS: 1

minimal input file:
##################################
\documentclass{article}
\usepackage[backend=biber]{biblatex}
\addglobalbib[datatype=bibtex]{IEEEfull.bib}
\begin{document}
\cite{bib1}
\printbibliography
\end{document}
##################################



Also, the biber shows warnings on all plain text strings in
/usr/share/texlive/texmf-dist/bibtex/bib/IEEEtran/IEEE{abrv,example,full}.bib
files after ISO-8859-1 -> UTF-8 recoding.

Example:
$ pdflatex test.tex
...
$ biber test
INFO - This is Biber 2.12
INFO - Logfile is 'test.blg'
INFO - Reading 'test.bcf'
INFO - Found 1 citekeys in bib section 0
INFO - Processing section 0
INFO - Looking for bibtex format file 'IEEEfull.bib' for section 0
INFO - LaTeX decoding ...

WARN - I didn't find a database entry for 'bib1' (section 0)

INFO - No sort tailoring available for locale 'en-US'
INFO - Writing 'test.bbl' with encoding 'UTF-8'
INFO - Output to test.bbl
INFO - WARNINGS: 41


It would be nice to escape them as latex comments by '%'.

--
Sincerely yours
Damir Islamov, PhD

email: da...@trefle.ru

The file /usr/share/texlive/texmf-dist/bibtex/bib/IEEEtran/IEEEfull.bib contains a symbol ERROR - Data file '/usr/share/texlive/texmf-dist/bibtex/bib/IEEEtran/IEEEfull.bib' cannot be read in encoding 'utf8': Can't decode ill-formed UTF-8 octet sequence <E1> at /usr/share/perl5/File/Slurper.pm line 59. INFO - Found BibTeX data source '/usr/share/texlive/texmf-dist/bibtex/bib/IEEEtran/IEEEfull.bib' WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 97, warning: 2630 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 107, warning: 46 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 116, warning: 41 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 123, warning: 19 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 131, warning: 67 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 145, warning: 14 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 155, warning: 36 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 158, warning: 20 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 173, warning: 3 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 179, warning: 33 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 187, warning: 43 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 209, warning: 18 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 218, warning: 38 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 226, warning: 77 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 233, warning: 18 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 236, warning: 19 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 240, warning: 19 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 245, warning: 49 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 253, warning: 20 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 259, warning: 23 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 268, warning: 47 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 280, warning: 51 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 297, warning: 25 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 312, warning: 32 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 326, warning: 29 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 331, warning: 22 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 338, warning: 10 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 340, warning: 21 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 346, warning: 20 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 353, warning: 40 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 367, warning: 28 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 375, warning: 61 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 388, warning: 11 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 394, warning: 59 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 402, warning: 7 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 407, warning: 4 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 417, warning: 34 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 430, warning: 22 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 438, warning: 17 characters of junk seen at toplevel WARN - BibTeX subsystem: /tmp/sTx6tRw3yS/IEEEfull.bib_5064.utf8, line 466, warning: 29 characters of junk seen at toplevel INFO - Overriding locale 'en-US' defaults 'normalization = NFD' with 'normalization = prenormalized' INFO - Overriding locale 'en-US' defaults 'variable = shifted' with 'variable = non-ignorable' INFO - Sorting list 'nty/global//global/global' of type 'entry' with template 'nty' and locale 'en-US'

0xB5653FEF.asc
Description: application/pgp-keys

signature.asc
Description: OpenPGP digital signature