It's because he grew up with them but he struggles to speak the actual language due to the accent. Plus if you listen the minions can speak little parts of English.
2:17 I guess Despicable Me style villainy is another universe where you can use the quote: "Don't underestimate old men in a profession where most die young."
