Well....what they want is for you to insure that low frequencies out of your band are below -55 dBm/MHz. i.e. you set a spectrum analyzer to a resolution bandwidth of 1 MHz, and sweep from 5000 to 5850, and you should not see the trace go above -55 dBm at any frequency.
So the first thing you do is set up your system to transmit normally (you might have to gin up some random data to send at the correct data rate), and do the above test. If you meet it by a few dB...you are good to go. If you do not meet that spec, you have to improve the lower spectral mask you are transmitting. You can do that by modifying the modulation (modulation type, complexity, data rate, chip rate, etc etc), adding filtering (both microwave and DSP type filtering), and sometimes increase the IP3 point of your transmitter components.