You could certainly make the VPN connection itself via the command line. But the *actual* VNC connection requires the graphical client.
That said, if you just need command line access to a box, use Secure Shell.