I’ve been looking at a smaller phone in terms of size but also storage. 128GB does seem the sweet spot for me and whilst looking at how much space I was taking up I discovered a way to quickly delete the downloaded music I had.

If you go to general -> iPhone storage -> music

It shows you all of the downloaded music and you can then simply swipe to the left and tap delete.