Future information technology demands ever-faster, low-loss quantum control. Intense light fields have facilitated milestones along this way, including the induction of novel states of matter(1-3), ballistic acceleration of electrons(4-7) and coherent flipping of the valley pseudospin(8). These dynamics leave unique 'fingerprints', such as characteristic bandgaps or high-order harmonic radiation. The fastest and least dissipative way of switching the technologically most important quantum attribute-the spin-between two states separated by a potential barrier is to trigger an all-coherent precession. Experimental and theoretical studies with picosecond electric and magnetic fields have suggested this possibility(9-11), yet observing the actual spin dynamics has remained out of reach. Here we show that terahertz electromagnetic pulses allow coherent steering of spins over a potential barrier, and we report the corresponding temporal and spectral fingerprints. This goal is achieved by coupling spins in antiferromagnetic TmFeO3 (thulium orthoferrite) with the locally enhanced terahertz electric field of custom-tailored antennas. Within their duration of one picosecond, the intense terahertz pulses abruptly change the magnetic anisotropy and trigger a large-amplitude ballistic spin motion. A characteristic phase flip, an asymmetric splitting of the collective spin resonance and a long-lived offset of the Faraday signal are hallmarks of coherent spin switching into adjacent potential minima, in agreement with numerical simulations. The switchable states can be selected by an external magnetic bias. The low dissipation and the antenna's subwavelength spatial definition could facilitate scalable spin devices operating at terahertz rates.