The site has been found and construction work is ongoing.
"We will visit the site to ascertain for ourselves the quality of construction works," Byabarumwanzi said.
There are about 300 Genocide memorial sites in the country.
Meanwhile, another team led by MP Innocent Kayitare, the deputy chairperson of the committee, is in Rusizi District.
The legislators' tour, which will also cover various other issues such as human rights matters, comes at a time when the country is preparing to mark two decades since the Genocide against the Tutsi.
Kayitare said their wish is that by the time of commemoration activities kick off, all issues will have been addressed.
"That is mainly what is taking us to the field even though there are other issues to do with the human rights," Kayitare said.
"There could also be some other issues they [CNLG] missed out in their report; we are going to interact with pertinent people and look beyond the report for issues and how they are being solved."
In November, last year, John Rutayisire, the president of CNLG, told Parliament that during the 2012/2013 period, a total 13,784 new remains of Genocide victims were discovered and given a decent burial.
In the 2012/13 budget, CNLG was allocated Rwf1.6 billion. Rutayisire said 95 per cent of it was used. However, he noted that challenges like limited budget, Genocide denial, trauma cases, among others, still burden the institution.
Plans to tackle the obstacles, he said, include continued advocacy for an increased budgetary allocation, campaign against Genocide denial and advocacy to help improve the welfare of Genocide survivors.