From what spoilers I have gotten, the mom of ludville is from a cult of body snatchers and approached the duke for that reason, but ludville was protected as the heir of the family. So when the duchess learned she was pregnant a second time, she left as she had fallen in love with the duke. The white haired girl is a body snatcher in the body of the daughter that came from the second pregnancy.