You can force apt to use only IPV4 networks with -o Acquire::ForceIPv4=true parameter.

Because of it is a long parameter which is hard to remember, it is better to set through a config file. To do this, create a config file named with /etc/apt/apt.conf.d/99force-ipv4 with following line included: