Nor is it as though all the banim of K'lal Yisroel are the ZERA of Avraham Avinu, but (as it is written) BEYITZCHAK YIKARE L'CHA ZERA ("In Yitzchak shall your seed be called, named, summoned" BERESHIS 21:12).