Change item frame loot table

I'm making an "Invisible Item Frame" item. When I place it, it works fine. When I break it, it becomes a normal item frame. Is there a way I can fix this?