Okay, we know that loud music can harm young (and adult!) ears, but there is a flip side to this. Music - especially playing an instrument - can also enhance the brain's sensitivity to speech sounds.
Music is a global function - that is, it stimulates different parts of the brain. Listening and playing music help the different parts of the brain communicate with each other and strengthens the nerve pathways that help us make fine distinctions between sounds. Music can also help children to pay attention and improve memory. Even in adults, music can help with auditory awareness.
So, don't stop listening to music. On the contrary, music is healthy and good for you and it can improve your language and auditory sensitivity. Just make sure to turn the volume down.