I dont think voting for other people changes your ranking. I am not positive about this but i think it is your activity points times your rating equals your total points. Unless you get 1 activity point for each person you vote for. If thats the case means you voted for 4 people???