Spectral sign inversion of photon drag at far-IR wavelengths