It will depend upon the magnitude of your tran violations, if magnitude is above the library limits definitely it needs to be fixed, as your library is not characterized for such a transition, and the delay value calculated by tool corresponding to such transition may be inaccurate. So, actually you might be violating setup but shown non violated by the tool because of the inaccuracy.
It will also depend upon the setup margin you are having on the tran violating path.