New
#1
Right click on Taskbar and click on Taskbar Settings. Go down to Notification Area and click on Select Which Icons appear on the Taskbar, turn off Outlook.
Thanks for your answer but not removed just hide
Right click it and select unpin from taskbar. It will still be there if you have Outlook running though.
I understand your frustration, took me a while but I got it in the end. Go to Settings -- Personalisation -- Taskbar -- Other system tray icons
Now turn off Microsoft Outlook and make sure you have Hidden icon menu turned off as well.
That way you will only have the apps that you selected showing, everything else will be removed