it is not that simple, latency is not a 'single number', it is a 'range' because of variation.
say flopA has a latency of 5, meaning there are 5 inverters on the clock tree path that leads to flopA. Now say flopB has a latency of 5 as well, but the inverters are different. In theory, you would think the clock signal would arrive at the same time at both flops. In reality, all of these inverters will behave slightly different because of variation. You need best case and worst case scenarios for launch and capture.
that is why your goal should be to minimise latency and skew. they are both correlated and cannot be assessed individually.