Yes, you's want to move to a current-starved inverter
design with a master reference whose tempco and
supply_voltco produces a flat delay profile -at the
point of interest- (logic delay dead flat, plus driver taper
chain delay not-flat, would still not be uniform; your
logic delay might need to have a counter-slope for a
net flat result).
So following this train of thought, perhaps you only need
to have one delay-comp block and let the rest of the chain
be simple. That's a better outcome for routability and
such, if you can make it work.
Or, you could make a deadband (anti-shoot-through?)
scheme that is not "ballistic" but based on sensing the
transition further down the chain on the opposite leg,
then you will adapt to the situation without embedding
so much guessing or assumptions about tolerances and
environmentals.