I honestly don't think aquiring more knowledge, being open to challenges, while widening perception and stretching one's ears along the way in this passionate pursuit has anything to do with just "taste", my friend.
Nor does it follow that possessing those qualities will guarantee that someone will like how contemporary music sounds.
I've spent a majority of my life listening to and studying new music and while there are some composers (Carter, Boulez are two) whose music I can admit an appreciation for, I do not enjoy listening to it anywhere as much as any work by Haydn, and countless other "old" music composers. And there are many more new music composers whose music is of absolutely no interest to me whatsoever.
I fail to see why the issue of whether more people enjoy it or not is the subject of debate. People gravitate to the music they like more than other music. Many people like Mahler, I don't. Many people like Wagner, I don't. I love Haydn and Mozart, many people find them boring. The same is true for 20th and now 21st century music.
Perfectly natural state of affairs, IMO.