The flaw in our logic is that we think we are the first and most advanced civilization that has populated this planet. We can not be certain of it. There are plenty of threats out there in space that would wipe out our civilization in one instant life extinguishing event such as the one that put an end to the dinosaurs and most other species. There would be no trace of our civilization left in as little as 1000-1300 years (on the surface). Maybe some plastic here and there but nothing else.
Some hundreds of thousands or millions of years going forward, if life prevails and a human like civilization is once again populating this planet, they may once again think they are the first. In fact I know they will, it’s human nature
