For n = 3, 4, Alice seems to win. Also, the horizontal and vertical direction given to players are irrelevent as one can view the board with 90 degrees rotation.