> Recently I heard Neil Degrasse Tyson saying that people came up with averages more recently than with calculus. It's not something people find relevant naturally.

Whoa now. That may be true within a strict scope of the "arithmetic mean" definition of "average", however, the idea of average as a 'concept' is much older. As an easy example, early references to agrarian yields (crop farming and how much food they produce) talk about average size of crop harvests, etc. Early tablets from Mesopotamia talk about average yield size, and those are dated 700ish BC.