The demolition company was supposed to take down four chimneys and leave the fifth standing