I think moderation should be impartial, based on recognised firm set of rules.

Regardless of personal sway, however unfair on the moderator this is. A moderator is only a tool to enforce rules created by whatever party created them. As a tool it should serve impartially and efficiently.