How to fix an allay to an area?

I gave an allay in the liked_player memories the uuid of a marker in the hope that it would stick to that place. But now it only follows me. My uuid is nowhere found in the allays nbt data but its only following me and ignoring the marker. What is the right way?