We present and experimentally implement a real-time protocol for calibrating the frequency of a resonantly driven qubit, achieving exponential scaling in calibration precision with the number of measurements, up to the limit imposed by decoherence. The real-time processing capabilities of a classical controller dynamically generate adaptive probing sequences for qubit-frequency estimation. Each probing evolution time and drive frequency are calculated to divide the prior probability distribution into two branches, following a locally optimal strategy that mimics a conventional binary search. The scheme does not require repeated measurements at the same setting, as it accounts for state preparation and measurement errors. Its use of a parametrized probability distribution favors numerical accuracy and computational speed. We show the efficacy of the algorithm by stabilizing a flux-tunable transmon qubit, leading to improved coherence and gate fidelity. As benchmarked by gate-set tomography, the field-programmable gate array (FPGA) powered control electronics partially mitigates non-Markovian noise, which is detrimental to quantum error correction. The mitigation is achieved by dynamically updating and feeding forward the qubit frequency. Our protocol highlights the importance of feedback in improving the calibration and stability of qubits subject to drift and can be readily applied to other qubit platforms.