Understandable. LOL. This area in general is very easy to forget about as far as backtracking goes cuz it's kind of hidden somewhat. I almost forgot it myself.
I noticed sometimes that when you hovered it over the emblem to move some objects it wouldn't work unless I played with it a little & just moved it around the area somewhat. If it's not glowing green like in my video, it may be a bug. I had a few times where I had to restart my game a couple of times for bug related issues for the prism puzzles.
In a previous video, a player was having a problem with another refract puzzle activating so he went through more of the main campaign and checked back and it worked for him so maybe try that.