Ok, so I checked the CA3140 and found this,
"Moreover, some current limiting resistance should be
provided between the inverting input and the output when the CA3140 is used as a unity gain voltage follower. This
resistance prevents the possibility of extremely large input
signal transients from forcing a signal through the input
protection network and directly driving the internal constant
current source which could result in positive feedback via the
output terminal. A 3.9kΩ resistor is sufficient."
So, that pretty much explains it. Sorry for wasting your time