This is the key part and could be different in every saga. All of us, I am sure have been forced to interact with people we don't like. What do you do? Generally be polite and courteous. While one may be a bit wary and more ready to find fault, there generally has to be fault before one responds.
If magi consistently step up, what chance does the penalty have to kick in?
"We were done for. There was a squad of archers about to fire, and then the whole hill just collapsed. The screaming, the rubble, I feel a bit sorry for the archers; but I'm not sorry I don't have arrows in me. That magi saved my life. Maybe he's not that bad."
"My wife was having problems. That arrogant prick marched in on the midwives. I went to hold him back, but with a gesture I was pushed away and held down. Less than a minute later he passed by, said "You're welcome" and walked off. While he is still an arrogant prick, my wife and child are alive because of him. I will not doubt him or stand in his way again."
Covenants are generally prosperous. In times of trouble magic can be used to resolve issues. Better healing rolls, extensive resource acquisition, fast message delivery asking for help, etc. Also, the magic aura means the area is just better. Prettier, food grows better, animals are healthier, etc.
Anyone in a covenant comparing their lifestyle to people in a middle ages large city, the covenant is just better. The city has poor waste and rat control, the associated diseases, poor life expectancy, etc.
At the end of the day, the Gift Penalty is magic, so one can apply it extensively. If a SG wants to downplay the Gift, at least in the covenant, there is an argument. When interacting with strangers, such as a random innkeeper, town guard etc, yes, the penalty should kick in hard.
Fae, it's about the story. Which stories have the people dealing with underlings? Not many. If the story suggests the fae interact with the magi, they should be unaffected by the Gift. if the story wants the fae to be annoyed by the magi, gift penalty kicks in.