Hi Trevor,
If you know exactly what the name of the file is that is giving you
trouble, you can boot with the Windows XP CD, and go to the Recovery
Console typing R. Once there, select the Windows installation you want
to repair (usually 1) and enter the password you used during
installation (there might have been no password, if that is the case,
just press enter).
Once you have the prompt, go to the directory where the offending file
is and delete it.
If the directory is not in Windows, you have to type set AllowAllPaths
= TRUE in order to go to other directories.
More info about the recovery console here:
Microsoft Windows XP - Installing and Using Recovery Console
Before you install Recovery Console, you need to be aware of the
following disk and file system limitations.
http://www.microsoft.com/technet/prodtechnol/winxppro/reskit/prmb_tol_kfma.asp
Microsoft Windows XP - Using Recovery Console
If you cannot start your computer in safe mode or by using the Last
Known Good Configuration startup option, you can use Recovery Console.
http://www.microsoft.com/technet/prodtechnol/winxppro/reskit/prmc_str_bjid.asp
Microsoft - Troubleshooting Windows XP Professional Setup
Windows XP Professional includes Recovery Console, which you can use
to resolve problems that might occur during setup. This section also
includes a discussion about common setup problems.
http://www.microsoft.com/TechNet/prodtechnol/winxppro/reskit/prbd_std_mikn.asp
Good luck, hope this helps.