Thank you very much Jean-Marc for helping with testing!
Can you please also try running apt-get purge mysql-* and see if it removes the remnants cleanly? But not too cleanly, mysqld binary or /var/lib/mysql used by mariadb-10.1 should not get deleted by the mysql purge (one user reported he suffered such a case).