I actually did this and rebooted. They did not come back.
Personally I think it's silly to have "Camera Roll" and "Saved Pictures" libraries when you could just have folders within the already...