Attribute modifier kinda broken

the attribute modifier doesnt really work for me because when I use it, it turns into something besides the base item. So for example when I gave it +20 attack damage the attack speed reset to as if I was hitting with a default block, and dealt as much damage as a default block