Yes, you should include a vector of ones. The vectors of ones represents the constant term in the linear regression. In other words, it's the \beta_0 term below. The dimension is simply Nx1 where N is the number of observations.