Mom didn't stick around after Daddy lost his job