If you do not want to use the MGT Banks, then you need to Gnd all those TX and RX pins (This will be mentioned in "GTX/ GTH transceivers user guide" of the selected FPGA Series) and you you don't need to MGT_AVCC/MGT_AVTT pins .
And you cannot use those pins (MGT Banks) as LVDS / LVCMOS IOs.