Yes, the (minus) pins of the S-parameter data all go to ground.
Now, the typical concern is: what happens to series inductance, series resistance etc. that might be physically in the ground path? Is it lost by shorting the grounds together? Answer: No, all this is included in the data and will show up in the "plus" path. This is possible because the currents in (plus) and (minus) are equal, with opposite polarity. Circuit designers who are used to nodes (not ports) have often difficulties to understand this, but it is perfectly valid because S-parameters are for ports (not nodes) where the currents in the (plus) and (minus) pin are dependent.