Dave,
Pulling on the helm under power seems common a lot of boats built over the decades. The old Ranger 33, a superb sailing boat, has an evil helm reputation under power. The ubiquitous Catalina 30 might also, as a Catalina dealer I know used to advise folks to buy the wheel model to reduce (!) helm feel.
Design wise, it seems to get down to how close the prop is to the rudder, and of course whether the angle of the shaft is other than on-center. C&C used to sharply angle their shafts off to port, for instance --- word on the docks is that it not only made the shaft easy to remove but got rid of torque steer as well. (I never owned one so have no first hand info.)
And then, the smaller the boat the closer the (inboard engine) prop wash is going to have to be to the leading edge of that rudder.
If the boat is listing, this will affect steering, as you have conjectured. Our Ericson-built Olson has a port list (as do all the O-34's) and we trim it out level for cruising with an enlarged (and filled!) water tank under our starboard settee... that and always piling duffles and the bag-o-Zodiac on that side when under way.
Does your prospective purchase have a three-blade prop? Rumors are that they worsen the effect...
Again, I have never used one.
Note that correct allignment of the engine will reduce vibration, will have no effect on the thrust vector of the prop.
Keep us posted,
Loren in PDX