It didn't work for me probably because the bullets were added using a
different method but it will probably work for you.
I used
Delete the source file for the picture bullet.
Open the bullets > Picture Bullets dialog > Yellow X indicates unavailable
Double click it and eventually it will give up and offer the option to
remove thumbnail. Do this and then close and reopen the dialog and it should
be gone