The way I see it, the point of Roger wasn't the strength of his body. It's the strength of his legend, the stories that are told about him. He was certainly a freak of nature but the fact that he could clash with Newgate isn't as important as the fact that the entire world was talking about him. The tales of his adventures far outweigh how hard he could swing a sword.
