Regarding Loss of Counters
The rules state : "If your attack succeeds, it is your responsibility to remove counters from the victim's pile and put them in the lost counter pool". If I am a victim and my opponent fails to remove my counters do I still lose them?