How to permanently disable kvm modules in Linux?

If you don't plan to use kvm at all, why not simply remove the qemu-system-[ARCH] rpm that supplies it. Also, fedora contains a file /etc/sysconfig/modules/kvm.modules which tells the system to load the kvm modules if virtualization extensions are detected in the processor. Modifying /etc/sysconfig/modules/kvm.modules or removing it altogether should also solve the problem, but removing the package seems like it would be the best solution.