That’s just about right. Almost all math rock musicians are influenced by jazz. If you want even more extreme stuff, try mathcore. It’s like math rock did crack.
The song is about reminiscing about his old girlfriend’s and he’s arguing about it to himself about it. The logical part of his brain is saying to move on and let it go but his emotional side won’t let him and every time the logical part of the brain says “just let it go…”. He says “I know… I know…”, but then continues digging up his past.