Four councillors who represented the Conservative party in Mid Suffolk have turned Independent over the county council's devolution decision.