The login provider doesn't store the service account itself, so it's possible to "eject" your account and use some other sign in mechanism as long as you have control over the email address.