We observe strong collective coupling between an optical cavity and the forbidden spin singlet to triplet optical transition 1 S0 to 3 P1 in an ensemble of 88 Sr. Despite the transition being 1000 times weaker than a typical dipole transition, we observe a well resolved vacuum Rabi splitting. We use the observed vacuum Rabi splitting to make non-destructive measurements of atomic population with the equivalent of projection-noise limited sensitivity and minimal heating (< 0.01 photon recoils/atom). This technique may be used to enhance the performance of optical lattice clocks by generating entangled states and reducing dead time.Two modes are strongly coupled when the frequency Ω at which they exchange excitations exceeds the rate of interaction with the environment. Strong coupling enables one to generate large amounts of entanglement [1, 2], achieve efficient quantum memories [3], cool the motion of atoms [4] and mesoscopic oscillators [5], and explore collective self-organization and synchronization phenomena such as superradiant lasing [6][7][8][9] and the Dicke phase transition [10,11].In this Letter, we observe strong coupling between an optical cavity and the collective excitation of up to N = 1.25 × 10 5 strontium atoms in a 1D optical lattice. The strong coupling is achieved using the forbidden electronic spin singlet to triplet optical transition 1 S 0 to 3 P 1 in 88 Sr. The excited state 3 P 1 couples to the environment via spontaneous emission at the relatively slow rate of γ = 2π × 7.5 kHz.Despite operating on a transition with 1000 times smaller squared matrix element than transitions typically used in optical cavity-QED experiments, we observe a highly-resolved splitting of the normal modes of the coupled atom-cavity system, known as a collective vacuum Rabi splitting [12,13]. This observation demonstrates that despite the relative feebleness of the transition, the tools of cavity-QED can now be applied to a system of extreme interest for quantum metrology [14]. Example technologies include optical lattice clocks [15][16][17] and ultra-narrow lasers [6][7][8][9], along with their associated broad range of potential applications such defining the second [14,18], quantum many-body simulations [19], measuring gravitational potentials [20] and gravity waves [21], and searches for physics beyond the standard model [22,23].One relevant application of this newly achieved regime is for state-selective, non-destructive counting of strontium atoms. Such counting has been used to generate highly spin-squeezed states [1,24] that surpass the standard quantum limit on phase estimation [25][26][27]. More simply, but quite importantly, non-destructive readout methods [28] can reduce the highly deleterious effects of local oscillator noise aliasing [29,30] in optical lattice clocks. Here, we utilize the observed vacuum Rabi splitting to non-destructively count atoms with the equivalent of sub-projection noise sensitivity. We verify that this sensitivity is achieved with as few as 0.01 photon recoils imparted to e...