You're right there is no select all in the WMP 9 Library.
But u can use the shift-key to select all files in your
library.
Click on the first title in your library, then hold the
shift key and click on the last title in your library.
Release the shift-key and all your files should be
selected. Press 'Delete' and your problem is solved!