Go to Settings > Ease of Access > Keyboard > Enable shortcut underlines and set to Off.

This annoys me, because I like shortcut underlines, but I can't stand the ugly white rectangles. Ah...