Calling West Indies' Ambrose and Akram of Pakistan as "two outstanding quicks", Ponting said Harbhajan caused him "lot of grief."
Harbhajan had dismissed Ponting 10 times in Tests, the most by a bowler against the Australian batsman.
"I think Curtly Ambrose and Wasim Akram were probably the two outstanding quicks that I faced, and for different reasons. Ambrose for his ability to just make you feel like you couldn't score off him for long periods of time, never felt like he was going to bowl you a bad ball," said Ponting in his farewell press conference in Perth on Monday.
"Akram for the exact opposite, you could get a few runs off him, but you just knew there was an unplayable ball around the corner, be it with an old ball or with a new ball," he added.
On the Indian offpsinner, Ponting said: "Harbhajan's probably the other one who caused me as much grief as anything. He got me out a lot of times and caused me a lot of grief. Those guys through their careers can all put their hand up and say they had my measure."
Ponting retired from international cricket on Monday after the third Australia-South Africa Test at the WACA ground. South Africa won by 309 runs.