Because this is a Spectrum Analyzer application, that requires high front-end linearity, I would go even further with the design.
SBL, SRA, and almost all the diode mixers are very sensitive to the IF port termination, is good to place a diplexer at the IF port, before the high-pass filter.
The attached one provides low insertion loss and very good return loss.
In this way everybody would be happy. The mixer that see good return loss for most of the mixing products, and also the high-pass filter which see perfect 50 ohms on the mixer side.
The S21 characteristic of the diplexer have a kind of band-pass characteristic, which would reject even further unwanted mixing products.