Looks like phase detector says you are offset, and nothing is being
done about that.
Could be tuning range, could be that you flipped the logic and are
locking up, not locking-to. Could be that your loop filter is missing
and you just don't get proper tuning voltage for the VCO. And
generally you would have a divider stage between HF output and
the feedback clock, to get a frequency and phase match against
a low frequency high quality reference (these are not available
in GHz range, and granularity wants a low clock freq as the min
frequency increment I think?).
Maybe open the loop and see what VCO and @phaseDet freqs
you get from VTUNE pinned to either rail, and whether the UP/DN
result would then be trying to correct or worsen, as a start at debug.