It is because latch is level sensitive.
Meaning, as long as latch enable is active, any signal at input port will be captured at the output port.
Unlike Flip flop, it is an edge sensitive or edge trigger.
The output port will capture the input signal at edge trigger and it needs to pass the setup and hold time check.
Thus, latch based design is more prone to glitches.