I have read that he apparently did not particularly like the song and performed it live after 1973-ish relatively rarely, I believe. Perhaps a symptom of his general preference for ballads in his late career.
He did it quite regularly in '75 and '76. In fact, in '73 he didn't play it as much as you'd expect a recent hit record to be.
It wasn't so much that he didn't like the song but that he wasn't in the mood to record it at the session in '72, just during the breakup of his marriage. You'll find that the other songs he recorded at that sessions were all broken-hearted love-gone-wrong tunes like "Always on my mind" and "Separate ways" a.o. So it took some convincing from his buddies and Felton Jarvis to make him record this.