BTW, RVW is one of my faves, too--as are all the others mentioned except Finzi, of whom I've heard very little (only the Naxos disc with the cello cto). What else might you recommend?
Here are 2 discs you might check out. They are really collections with an outstanding assortment of works by British composers. The first one is pretty famous on this board:
I count
Dies Natalis as among the most beautiful works composed in the 20th century, but get it for Holst and VW as well. This really should be a GROC, because it actually is one.

Here's the 2nd one:
Lo, The Full, Final Sacrifice is the one you should hear. But it's all good, especially RVWs
Mass in G minor, though the performance isn't going to please everyone. Amazon has both discs
here.