What OS are your referring to on VMWARE, If you are using the Vertica VMware ready to use image installed on the VMware player / VMware workstation, then it will be CentOS 6.
But for Tableau as per date there is no Linux Version released, so you cannot install Tableau on this OS of VMware.

Workaround :- You can install Tableau on you Local OS / Host OS and then try connecting to Vertica on VMware, this works.

Hope this helps..

nnani........
Long way to go
You can check out my blogs at vertica-howto