Just the opposite for me? If I don't change that BIOS setting to off, my numlock is always on when I boot into Windows? I prefer it to be off. I haven't checked it lately, usually only ever have to...

Have a look in the BIOS, there is usually an option to enable numlock on boot up in there.