I've tried what Alex told on freedesktop's bugtracker (please take a look there) so it really seems it's nothing about X itself, just loading the module without X involved the freeze happens.
-- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/735126 Title: [natty] system freezes on boot without disabling KMS -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs