People can have rather serious strokes that kill large number of neurons without losing their sense of self. Sometimes we remove half the brain

https://en.wikipedia.org/wiki/Hemispherectomy

That gives me confidence that replacing neurons at a rate that counters natural aging does not significantly alter me.