I finally got around to testing with mem=512M. I can now load the module without a panic. It looks like this is the DMA issue.
-- [bcm43xx] panic on boot https://launchpad.net/bugs/58638 -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
