Some further info:
This does not happen on Linux 5.11, searching through 5.11 log there’s another commit metioning PMU registers:
However this one is not backported into 5.10 tree.
Maybe this is where the problem lies, as QEMU will see the absent PMU registers while KVM doesn’t.