Just raise motion to change the SOs then.
The council decides its processes not the locum clerk.
The trouble with the system you describe (which is non uncommon BTW) is that absolute power becomes invested in the same little cabal.
I have the opposite problem - finance and estates committees collapsed several years ago and nobody will step up to the plate to chair or commit to them.
Personally, I don’t have a massive issue with that (especially given the history of inactivity & incompetence amongst the committees) so now I am starting to delegate specific tasks to specific Cllrs - there may well be a howl of “no individual….. blah, blah, blah…” but when the whole group doesn’t function because certain elements prevent any realistic progress, what alternative is there? They are volunteers after all….