"I like David Graveney. He cares. He wants English cricket to do well. But he's too interested in protecting his own job. He tries to keep everybody happy and is too quick to worry about what the Press are saying," Hussain revealed in his book Playing With Fire, on sale from mid-October.
The former England skipper was also critical of the selection meetings conducted during his tenure as captain.
"There's no doubt the selection panel wasn't strong enough then and a lot of it was down to Graveney. He would listen to anyone, be influenced by too many people. I,m all for democracy, but you really have to draw a line and have the courage of your own convictions if you are chairman of selectors," he said.
Hussain also lambasted the input of Ian Botham and Mike Gatting, who also sat in on selection meetings. "There was never any consistency in his arguments," Hussain said of Botham.
"He'd say one thing one day and then suddenly he'd be saying that the same bloke he had been pushing for a year was now complete rubbish. By the end of his time advising the panel, I was listening to what he thought I should do and then doing exactly the opposite," Hussain disclosed.