Quantum Gravity Beyond Equilibrium