I have a somewhat similar experience that would jive with it being prop-wash from the greater thrust. On my E-27 I installed an Indigo prop as part of repowering. The boat originally had an A4, when bought had an outboard, and I put an A4 back in. I selected the Indigo prop and absolutely loved it, but the one thing I did have was a fair amount of what I'll call torque steer when cranked up. I attributed this to the prop-wash. The Indigo prop has a lot of thrust based on other props I've experienced, and had no problems sustaining 6+ knots dead into 20+ wind with 2-3 foot chop (what we get on the Chesapeake if it's not flat). I have a friend with an E-27 and a YSB8 - little 8hp Yanmar and a three blade prop. He does not even begin to have the torque steer that I had with the A4 and the Indigo. He also doesn't even begin to have the thrust I had. I came away from this with the feeling that if you mount a high thrust prop in front of a hanging rudder, you're going to get torque steer from the prop-wash. Do you have any ability to shorten your prop shaft and increase the distance between the blades and the rudder. You don't want a bunch of shaft on the aft side of the strut anyway, and I've seen many boats with too much shaft hanging out the back of the strut. Perhaps increasing that distance, if it's an option, will help alleviate some of your affect. Do look at your hull to tip clearance when shortening the shaft. I'd have to double check my notes, but I believe on a sailboat you want no less than 10%, and really 15% (of diameter) tip clearance between the blades and the hull.