In Outlook 2002 (XP), you can drag and drop:
1. a Contact item into the contacts field in a Task item
2. any text (including a phone number) from a Contact item into a text
field in a Task item.
I was able to demonstrate this to myself by trying it. Have you been
unable to do so ?