I think this meeting with the Duke is very important in establishing his character and the consequences of being Arisen.. It's not all fun and epic games.
Annoying gameplay wise, thought they could've done more with the castle and all... but it does add a bit to the story i guess ^.^ Besides, you get to throw a wicked old coward around