Guys I have an easy fix, go to the task manager (CTRL+ALT+ESC to open), then find "Windows Explorer", and finally hit reset. If done correctly, the taskbar should hide when going fullscreen.