Have you tried this:
Select the music file from the library and click teh DELETE key and that
will give you 2 options: to delete the song from the library only or from the
computer also.
If you don't have a thousand songs that will work just fine.