We exploit the carrier-envelope phase of near-infrared 1.4-cycle pulses with picojoule-level energy to control the probability and direction of single-electron tunneling across the 8 nm gap of an optical antenna at 80 MHz repetition rate.