They don't just have any time travel either, but omnipresent time travel where they can teleport anywhere at anytime. Whats the point of them even having spaceships if they can use that thing to travel anywhere. It might have been memory dependent. but all you need to do is give it to a sapphire, and then create a platoon of solders like jasper, or even just use one jasper, and then *Time duplicate* The jasper into a platoon, and then *Time duplicate* the platoon into a Regiment, and then *Time duplicate* all of the Regiments into a legeion. Then just put the Time thing into a pearl gem, and then put the pearl inside a topaz, and surround it with the command gems, and then next thing you know. you taken over the universe. Heck! they could of just used the time thing to snatch pink diamond back from the dead.
If only Steven hadn't smashed the magical time glass that could have solved everything, which we never had a proper explanation of and which nothing like has ever been seen again. Was it made by the Gems? Some other alien civilisation that visited Earth? Ancient humans? Who knows???