I hadthe same issueand I found that the main problem was my arm was leading my hand astray instead of just letting my fingers do the work. I used some drummers rhythm drills where the hands practice different time signatures to get out of the habit. I can try and find the link but in case I can't post an active link it's pretty easy to find just search keywords like "drummers practice time signature drills" or something like that. It helps.
