Because in effect we can sit in our easy chairs and within our own emotions and characters kick someones ass through these sports. I've been to a couple events that brought out things in some people that I knew that was shocking to me. In "real life" they were totally different as far as how they acted, until "their" team was playing. Bottom line, a testosterone release for the most part.
I tend to agree with you though. I love watching a good hockey game where skill dominates the playing. Too much violence and I switch it off.