Title’s a bit misleading. He doesn’t want to get rid of them it’s just that A CERTAIN SOMEBODY gave him permission to marry one of them but his main problem is that the girls are too straightforward. He’s got that defense or HP at max which explains how he’s survived all the girls’ advances. They don’t have ill intentions it’s just that they forget to measure their own strength because humans are frail compared to them and Kimihito has survived them like a total chad. Choosing is hard because despite their flaws like Miia’s grip and awful cooking, Rachnera’s BDSM kink, etc the girls are good people. They love him because he treats them as ladies instead of their species