Yes, indeed. He seems confused snd upset about his life. I think Tom understands Charles well so he doesn’t feel that Charles is mean to him. However, Tom seems to focus on his own thought in a positive way.
It is funny. I have watched this movie more times than I could say and this is easily my favorite scene. I never saw this as Charles talking down to Tom. And believe me I am much more Tom in real life than Charles (except for the money lol). Charles is saying that he and Tom were in the same boat. Notice he says "some of US are not going to get married." For me the important part of this scene is the gentle dressing down that Tom gives Charles. They portrayed Tom up to this point as sweet but a bit inept. I think they included this scene not only as a setup for the next wedding, but to show that Tom in many ways has his head in a better place than Charles does.