Why you want to use a full wave loop instead of a folded dipole with 1:4 balun, or just a half wave dipole with a 1:1 balun (ferrite bead/tubes around coaxial cable)?
No matter the balanced antenna, I would consider a balun.
You can connect the center of the coaxial cable at the connection of the telescopic antenna. Use your series capacitor to avoid any DC path.
The braid of the coaxial cable goes to the nearest ground connection with respect to the telescopic antenna connection. Keep the distance between the coaxial cable and the braid connection at the PCB as short as possible. First connect the braid and then the center conductor to avoid ESD (electro static discharge). Disconnect the telescopic antenna to avoid noise pick-up from man-made noise sources (power supplies, PC's, etc)