There is no mechanism to remove a councillor except for a few special circumstances. In normal circumstances, you have to wait for the four yearly elections - next in May 2015. It's possible to demand a parish meeting and votes can be taken there, but in almost all cases they are not binding on the parish council.
It is not actually possible to remove a chairman except at the annual meeting of the parish council in May, when the chairman automatically retires. Of course, a chairman may resign if faced with censure. As may a councillor.