In XL2007, select Office button >> Excel Options >> Advanced >> scroll down
to the Display section >> uncheck the "Show all windows in the Taskbar"
checkbox >> OK
I don't have XL2003 or earlier available at the moment, but I believe the
checkbox is under Tools >> Options >> (maybe on the General tab).