They are fine. Not a pest. Get a fish with a beak and they will eventually eat them for you. Arrow Crabs too, but they are a totally different story...
I'm pretty sure these are a developmental stage of a jellyfish and nothing at all to worry about. The jelly fish never gets past this stage without becoming fish food.