Tough one from a common-sense perspective. Sitar and rap music may sound like noise to me, but to someone else, it would be audio nectar of the gods.
From a purely logical standpoint, I think the statement is rational. Basically, the argument is that noise is not equal to music. If one accepts the definition of music as an "orderly progression of sounds," and if noise is not music, then noise is not an orderly progression of sounds. If it is not orderly, then it must, by definition, be disorderly. Since noise is in fact sounds, but it is not orderly, it therefore cannot be considered music. The weakness in the argument is accepting the definition of music.
Does that help? Give me time for three more beers (about 5 minutes) and I can shovel some more sh...I mean, stuff, that sounds even better.