I managed to solve the problem on my own.
I just removed nav-pills as the Menu Class Suffix and it worked.
Usually Google says what you should add nav-pills as the Menu Class Suffix for the menu to show horizontal, but in this case the opposite worked :)