וְעַל־יָד֥וֹ בָנ֖וּ אַנְשֵׁ֣י יְרֵח֑וֹ וְעַל־יָד֣וֹ בָנָ֔ה זַכּ֖וּר בֶּן־אִמְרִֽי׃
Next to him, a [work] party from Jericho built. Next to them, Zaccur son of Imri.
(The above rendering is the RJPS translation, an adaptation of the NJPS translation. Before accounting for this rendering, I will analyze the plain sense of the Hebrew term containing אִישׁ, by employing a situation-oriented construal as outlined in this introduction, pp. 11–16.)
The referring expression in question is אַנְשֵׁי יְרֵחוֹ. This label profiles its referents in terms of their participation in the depicted situation—namely, the reconstruction project—as well as their affiliation with the named clan or locale.
Gender is not at issue, because (given the nature of the building project) it goes without saying that women are not in view unless otherwise noted (as it is in v. 12).
As for rendering into English, the NJPS rendering “the men of Jericho” is nowadays construed more in terms of intrinsic qualities (adult maleness) than participation in the situation. More to the point is the revised rendering, which makes reference in terms of (role) participation via the English idiom “work party.” This approach works also in verse 7, below.