Of course those are valid views. Yet I suspect that, if there are any dancers reading this, they'd say the opposite.
Not necessarily. Even Balanchine famously said that if you weren't interested in the dancing, you could close your eyes and experience a good concert. Nonetheless, unless one has actually experienced the dancing, I don't think one is in the position of saying "I just want to hear the music."
This is complicated by the facts that (a) some ballets were choreographed after the fact to existing pieces, (b) some ballets like Nutcracker exist in multiple choreographies, (c) some ballets like Miraculous Mandarin and Jeux are heard more often in concert or recordings than on stage. Stravinsky said he preferred Le Sacre as a concert piece, and on the few occasions I have seen it danced the experience has not been satisfactory. On the other hand, seeing Petrouchka made me realize how closely the music mirrored the choreography, Agon takes on wholly new dimensions when you see it danced, and if you have never seen the famous "starburst" tableau at the end of Stravinsky's Apollo, then I would say you have not experienced Apollo.
Here are some selections you can see for yourself (not in great visual quality, but absolutely free):
4 Temperaments https://www.youtube.com/watch?v=uk9dG6p5bFg
Bizet Symphony https://www.youtube.com/watch?v=1wIQyNW1zOc
Fancy Free https://www.youtube.com/watch?v=3Ou-O9Awkzo