They accuse him of undermining the PF after he claimed different members within the party are using tribalism to force him out.
"Since when did you have politics without a little bit of infighting? Show me a political party in which there is no contention, no differences of opinion, no struggle for succession? It will be a party no one has ever heard of," said Scott.
He also dismissed reports that he has formally resigned as the country's vice president.
Security minister Geoffrey Mwamba resigned after a fallout with the government. But some analysts say the administration will unleash state institutions, including the Internal Revenue Service, to intimidate and harass the former cabinet minister. Scott denied reports that Mr. Mwamba would be targeted.
"The specific threat to investigate the financial affairs of the former minister of defense, I have heard people talk about it saying it would be most unfair to be investigated or something like that," said Scott. "But I have heard any threat from the party because it is more of a party affair than the government affair. Again, this is just made up or inferred."
Scott also denied media reports that he has resigned his position as the country's vice president.