Yes, as per ArM5 p. 178 "The character suffers a penalty to all actions (rolls and totals) equal to the sum of all penalties due to his wounds*". For combat rolls, the penalty applies to your defense total (which is the same thing since it gives a bigger advantage to your opponent) while for non-combat rolls, this applies to your soak roll (soak + stress die).
See also this post by Christian Rosenkjaer Andersen: Do wound penalties affect soak totals?