Cavity Quantum Electrodynamics With A Locally Addressable Quantum Gas