We study interaction effects on the orbital magnetism of diffusive mesoscopic quantum systems. By combining many-body perturbation theory with semiclassical techniques, we show that the interaction contribution to the ensemble-averaged quantum thermodynamic potential can be reduced to an essentially classical operator. We compute the magnetic response of disordered rings and dots for diffusive classical dynamics. Our semiclassical approach reproduces the results of previous diagrammatic quantum calculations.