He's not saying "don't pet me". He seems relaxed and comfortable with you. He's saying "don't touch my belly" which is his private area. He looks like he would be very happy for you to stroke him on the top of his head (as long is it is with the grain of his hair, not against it) and maybe even rub even the side of his face.