git clone asking for password (multiple users)

I have setup a VM with multiple users. My primary users is VM-User and using that account I created another user called "Joe". I have cloned a git repo by loggin into the VM-User and everything works fine.

The problem I'm having is when I try to clone the same repo by loggin into the user "Joe" it asks me for a password for the git server.