NAIROBI—The outbreak of the Ebola virus in West Africa is hitting many African economies where they are most vulnerable—the tourism industry—as travelers reconsider trips to places as far away as Kenya and South Africa.

Fear of the virus is rattling would-be tourists to the continent and is underlining the risks some associate with travel to Africa. Anxious African governments have potentially amplified those worries with their own...