Hamza Khawa, the general secretary of the Uganda Rowing Association, says he will not quit, despite allegations that he is abusing the office.
Rowing was not represented at the Olympics 2012 in London not because there were no funds, but because of the federation's poor organisation.
"My mind is about the game, not the politics," Khawa said.
Khawa is accused of taking federation boats to Nalubaale beach from Miami beach, although he insists he explained the reason behind the move. But a petition note signed by the association vice president, Charles Batambuze, accuses Khawa of failure to convene a special general assembly to sort out some issues.
Khawa is also being accused of taking an untrained Susan Nabukenya to the African rowing championships in Egypt.
Batambuze says: "He took the girl who was untrained and she came last. And Khawa, in a bid to avert the shame, bought a bronze medal and said Nabukenya had been second."
Batambuze said he had already alerted the National Council of Sports and Uganda Olympics Committee about the issue.