The main thing is the band gap.
Conductors have no band gap (overlap between the conductance and valence band), dielectrics have more than 2 eV band gap and semiconductors have band gap between 0 and 2 eV.
On the periodic table, a diagonal line drawn from boron (B) to polonium (Po) separates the metals from the nonmetals.