Keep on having to restart Explorer.exe after switching displays

*I am not sure if this is the right place since It has to do when I am wanting to game, but not specifically game on my PC. When I game on my PC this issue does not exist*

Okay, so here is the deal, I have a gaming setup. 2 23" displays, one is ran through an HDMI switch which also has my ps4 and a couple other systems hooked up to it. So I will switch to which ever input signal for the console I am playing and my secondary monitor will become my primary display until I switch it back to the primary display making the second one an extended desktop.

Seems simple enough, but since I upgraded to windows 10 from 7, when I switch back to have my primary display and an extended display I have to restart explorer exe or I cant get the start menu to show unless I hit the windows key on the board. ( I have the start menu to auto hide for when I am editing photos)

All drivers are up to date, there are no viruses, scanned many times and this only started happening once I switched to 10. It drives me insane that I have to keep on restarting explorer each time I want to play on one of my consoles.

Also, when I switch it back to the primary display monitor all my desktop icons stay on the secondary displays screen.

Another detail, is this is not EVERY single time, but 95% of the time I have to restart explorer.

A little update. It is ONLY when google chrome is up or opened. With anything else, I do not have this issue, i can switch windows to something else, lets say notepad for an example and the start menu will show. The second I switch back to chrome..... I have tried firefox, Edge, other programs and after I switch back the display via the HDMI switch the start menu shows when I put the mouse cursor at the bottom of the screen. But when I use google chrome. I need to restart explorer. I might switch back to firefox.