Try this:
Open the Default Programs applet, then click on "Set program
access and computer defaults." Expand the Custom selection, and
uncheck the "Enable access to this program" box next to Windows Mail.
Click OK.
Alternatively, you could simply delete all the shortcuts to Windows Mail,
and/or rename its folder under C:\Program Files.