They are Israelites, not Jews. Hence the title, Bene Israel. They are descended from the House of Israel (the ancient northern tribes), NOT from ben Yehuda (i.e. Yehudim, Jews, ancient southern tribes). Tradition and ignorance often blinds most people from the truth.