The England and Wales Cricket Board (ECB) have assured players they will not face reprisals if they opt out of the five-match One-day tour like fast bowler Steve Harmison on moral grounds.
But Graveney said that they remain committed to sending a full-strength squad, and will not be using injuries as an excuse to leave certain players out of the tour.
"The side has not been selected. We will finalise our squad today," Graveney told BBC Radio Five Live's Sportsweek programme.
"Steve Harmison is the only player who has indicated he is not going to Zimbabwe. We will then announce the squad on Tuesday.
"In my period of being a selector we have always selected the strongest side. The only question with any team is subject to fitness.
"A lot of players have been carrying a number of injuries during the summer and it will be up to the medical staff to inform the selectors if a period of rest would be beneficial for the demanding programme they have ahead of them.
"We're not trying to conceal anything. These guys, particularly the core players who play both Tests and One-day Internationals, have been playing constant international cricket for a very long time.
"We're going to take the strongest team. That's the way we play international cricket but we'll take the fitness angle into account. The selectors were castigated for taking injured players to Australia and we're very conscious of that."
Players selected for Zimbabwe will be consulted and given a chance to express concerns before the squad is made public.
England are also due to name a squad for their tour of South Africa.
Harmison is expected to be included in that group but Graveney also said more players may be taken to South Africa anyway because of the more demanding nature of the tour.