Package: octave2.1 I think that texinfo is only required if you intend to modify the documentation. http://www.octave.org/doc/Installation.html
Indeed, it triggers a conflict when tring to install latex, because texinfo requires tex-common, which conflicts with tetex-base and tetex-bin. I'd suggest to switch texinfo dependency from depends to recommends, or suggests.