I noticed while restarting the NetworkManager for the first time after making relevant changes, everything works as required, resolv.cfg contained the entry for both DNS servers. But again restarting the service updated resolv.cfg, and DNS entry for ipv6 was erased.