All amplifers will contain contain noise in the bandwidth of the oscillator and even overtones of crystal oscillators. The harmonic with the highest gain will end up oscillating.
Both input transients on power up and random noise contribute signal that gets filtered. In the case of a balanced oscillator with exactly unity loop gain at 0 or 360 deg in noiseless system will not oscillate, so for sinusoidal ouput usually the gain is increased enough to start oscillating quickly and then limiting reduces the gain to full range sine wave output . But in any case some uV of input offset or random noise is needed for an initial condition
. Normally even with a large step input voltage on power up into a high Q oscillator , the time to full swing increases with higher stability , high Q oscillators. Thus low frequency watch crystals require a longer POR, power on reset time before a stable full logic output is reached than one > 1 MHz .
Again startup time depends on excess gain and oscillators with squarewave outputs have at least 10 dB of excess gain and usually more. Too much gain can sometimes lead to unpredictable resonance from internal buffered logic stages. E.g. 3 stage buffer logic inverter.