QUOTE=Snipped and paraphrased. No offense intended to OP just a little fun rearranging on my first post.
<Snip, Snip .....>
...... overwritten by the xml file mentioned in StartLayoutFile registry.
So I opened the XML...
%AppData%\Local\Microsoft\Windows\Shell\LayoutModification.xml
....deleted entries regarding Edge and Store
<CustomTaskbarLayoutCollection PinListPlacement="Replace"><defaultlayout:TaskbarLayout>
<taskbar:TaskbarPinList>
<taskbar:UWA AppUserModelID="Microsoft.MicrosoftEdge_8wekyb3d8bbwe!MicrosoftEdge" />
<taskbar: DesktopApp DesktopApplicationLinkPath="%APPDATA%\Microsoft\Windows\Start Menu\Programs\System Tools\File Explorer.lnk" />
<taskbar:UWA AppUserModelID="Microsoft.WindowsStore_8wekyb3d8bbwe!App" />
</taskbar:TaskbarPinList>
</defaultlayout:TaskbarLayout>
</CustomTaskbarLayoutCollection>
....finally got rid of the reappearing taskbar icon
</..... Snip Snip >
Did you, or anyone, find anything about the Mail pin?