"They're like animals," was the comment picked up by a stump microphone which apparently had not been turned off as normally happens soon after a ball has been bowled.
South African coach Mickey Arthur said the comment had been the subject of complaining e-mails, "some from as far afield as Pakistan."
He said: "The comment was not aimed at any Pakistan player."
Arthur said the incident was the subject of an internal investigation. A statement would be issued Monday. He said as far as he was aware it had not become a matter for match referee Chris Broad.
The comment was made shortly before lunch, soon after a complaint from the South African team about three spectators near the boundary who allegedly swore at bowler Paul Harris.
Terence Jacobs, head of security at the ground, said the three spectators, who were supporters of Pakistan, were questioned and two were asked to leave the ground after admitting that they had sworn at the players.
Arthur said he was not happy about the stump microphones.
"They are a bit intrusive," he said. "What is said on the field should stay on the field."