The BIOS has nothing to do with Windows and everything to do with your
motherboard.
Reboot and look carefully at the screen and it should say something
like "Press ** to enter Set-up", you need to press because the message
is only visible for a few seconds.
F1, F2, Esc, Delete are some of the common ones.
Check your motherboard/computer manual or contact the manufacturer for
details.