I give out 7 points per session my 1st Crusade campaign, with a Tytalus who has a Confidence score of 2. It absolutely makes things swingy, and frankly, more "heroic" since he can get a roll of 8 on a good characteristic of 3, skill of 6 + specialty (1) = 18 then +6 lets him 24's for pulling off insane stunts easily.
I've never seen someone with a Confidence Score 3+ in any saga I've played. It would most certainly make for a very epic/legendary kind of game where "Confidence" is just as, or more important than actual skill. That said... It is a finite resource. The player in my game tries to hoard it in slower sessions so can burn through it more lethal sessions.