The arm-m specific debugger structure really should live in arm-m code, so move it there to clean things up a bit.