Q&A not working in the service

I am working on a report where we want to use the new Q&A visual. Q&A works fine in desktop but after I upload it into the service I cannot ask any question apart from a bare measure.

It seems like if the linguistic schema or some other metadata is not uploaded or corrupted during upload, so any question that requires using the model relationships does not work. The suggested question does not contain anything that would require more than 1 table unlike in the desktop. It works the same with the Q&A in the Dashboard so it is not the new visuals issue.