They agreed he'd pull out.. but it was never their intention