Hmmmmm....I don't think any competitive diver in the world would agree with that sentiment - same goes for any competitive gymnast (I don't know any competive skaters so I can't comment there). The same amount of "judging" that goes on in these sports is the same level that goes on in basketball, football, rugby, hockey, etc etc...Think I'm crazy? Go talk to some diving judges and see how structured the scoring system is. The only reason different judges give different scores is because they don't all see the same things...and that is something that happens in every sport (especially rugby and water polo, where the refs will even have the explicit option to not call something).
Structured scoring does not a sport make.. For example, as a percussionist in high school there were try outs for all state band involving qualifying, locals, regionals, and then state competition. The scoring was not only structured, it was blind (thanks to the nature of music). It was extremely competitive, even had its own version of overtime to decide contests. I know all this from personal experience. Is it a sport then? No. Although there are many elements of sport I don't think anyone would say that choosing the best musician that day would be a sport. So why would choosing the best diver or figure skater or whatever be any more of a sport? It cannot be argued that athletics is the difference, because I dare anyone to develop the chops needed to play music that physicality is the difference. Sport must be measured, either by mono a mono, team vs. team, or time vs. time.