Captain Andrew Strauss was 37 not out, with Alastair Cook on 33 at the Oval.
Marcus Trescothick continued his wretched run of form, caught behind by a diving Kamran Akmal off Mohammad Asif for four.
The home side, despite a blundering performance in all departments, are sure of winning the four-match series after their victories in the second and third Tests.
Pakistan, replying to the home side's first innings 173, batted through the earlier rain interruptions before being bowled out for 504.
Mohammad Yousuf top-scored for the touring side with 128.