The men who guarded the gates were on the four sides of the temple. They were on the east, west, north and south sides.