Sometimes if you disconnect during a download of a pile of emails, the ISP
server won't delete them and will resend them once you reconnect.
If it happens all the time, are you sure you have it set up for the ISP to
delete messages after they've been downloaded? Is is twice and only twice,
or sometimes can it be three or four times?
BTW, what version of Outlook and what OS?
