I think it would look sort of strange to have a ladder end one meter below the floor, at least much worse than the trapdoor being slightly above the surface.
You could say "just jump", fair enough, but there's no point in making people need to jump to get up from ladders, is there?