I know, that CCleaner removes WiFi password (section Windows Explorer - Network Passwords), but you would have to run it every time or at least create a shortcut to turn off computer with CCleaner's shortcut.

The other option is to use a password protected software to maintain network connections, like NetSetMan.
You would set it to start with non-existing network and in order to switch to WiFi, a password would be required.