If those 10000 people voted on other things it wouldn't do 1% the damage that flagging would do, but then nobody would get rewards and it's pretty lame to hold 10000 people to be responsible for not even 10 percent of the voting power of one user.