Hi, yes it's fine, the prison is a reasonable distance away from the castle (probably about half a mile) and from where I was stood I doubt I would have had the range to get there anyway, the castle is english heritage so I'm not sure they want flying over it so just be aware of that too, enjoy!!