I think I fixed this by setting the "roaming aggressiveness" to lowest in Device Manger. After I did this it been working and not breaking as soon as I enable the wifi adapter