Responsa of Rabbi Moshe Feinstein Yoreh Deah 1: 144

In regard to the issue of giving a Kohen precedence over a Levi and a Levi over a Yisrael, this applies only when all of them have the same need for food or clothing. For this reason, the text does not just say “there are many poor before you and you do not have enough for all of them” but rather, it says “you don’t have enough to feed or to clothe all of them.” The reason for this phrasing is that if one of them needs food and another needs clothing, the one who needs food takes precedence over the one who needs clothing, even if the one who needs food is a Yisrael and the one who needs clothing is a Kohen. . . all discussions of precedence apply only when all of the poor people have the same needs. [Translation by Rabbi Jill Jacobs]