If the Empire State building were to be demolished it would create a pile of debris 20 stories high and half a block wide, give or take. That pile of debris would in include concrete, dust, wood, asbestos, nails, metal supports, smashed office furnishings, plastics, electrical wiring, circuit boards, piping, air conditioning chemicals and so on.
Ok, now lets leave that debris hanging around for a billon years. I would bet that a billion years from now, it would not have assembled itself into anything resembling a building. Even more unlikely, it would not have grown legs, and created more little buildings walking around. That is the theory of evolution.