Yeah, that looks like a rusted zerk fitting. I would drill it out, clean the area, add some epoxy if needed, then thread in a new zerk. And apply grease once or twice per year to keep the rudder turning easily inside the rudder tube.
If you look carefully you might also find a second zerk above...