Userland and even kernel shouldn't require this anyway, cpu-specific code can still be compiled with those flags separately.