That might be some type of sponge, but thats just a guess.
I have seen something like that on some cultured frags before but did not see any polyps.
I scrapped them off as it was growing too close to the frag but I don't recall it having a hard base.