The party had commissioned a review of its internal electoral system, he said.
"The organisation, at all levels, must be consumed with the restoration of discipline within our ranks and ensure there are consequences for deviant behaviour," he told reporters in Johannesburg following a national executive committee meeting at the weekend.
"Preoccupation with internal challenges distracts the ANC from defining the type of society we envision and working together with our people, building it."
This comes at a time when there have been allegations of interference in the ANC Women's League and ANC Youth League congresses by a strong lobby group in the ANC dubbed the "premier league" which wanted to advance certain leadership ambitions in the mother body.
The "premier league" was said to be made up of three ANC provincial chairpersons who are premiers - North West Premier Supra Mahumapelo, Free State Premier Ace Magashule and Mpumalanga Premier David Mabuza.