If it's empty, go ahead and try. Since it's an archive folder, two things
come to mind: first, Outlook will just create it again the next time archive
runs (but perhaps you'll be able to disable that if you turn off archiving
on the default Calendar) and second, since Outlook created it, I'm not sure
you'll be able to delete it.