This is an opinion piece based on data and experience from Rwanda. The authors believe this opinion piece may help improve current programs on prevention of HIV transmission from mother to child in Africa taking into account the prevalence of HIV sero-discordance in couples. The authors recommend that if we want to ensure newborns stay HIV negative, PMTCT protocols should offer a series of HIV tests linked with antenatal visits and the lactation period as well as HIV testing of current sexual partners. Moreover, if the male partner is found to be positive and the woman is negative, programs should provide intensive counseling on the use of condoms. The lives of three individuals have the potential to be changed from HIV testing and counseling. Morally, this cannot be ignored.