Rebuilding the icon cache worked for me (*).
Icon Cache - Rebuild in Windows 10 - Windows 10 Forums

I was mainly noticing the double blue arrows on Office 2010 document icons. This was happening...