Saying sorry is about the person who says sorry not about the other person who is addressed. Sorry means I am human so I feel it or understand the situation. That is what makes us different from dumb animals who just knock you down and move on as if nothing has happened. So Saying sorry is a mark of intelligence and civil behaviour.