Caloric restriction requires you to eat food that is denser in nutrients. Many who don't eat much do so because they're poor and can't afford enough food, let alone food that is denser in nutrients. That is why, on average, those with lower body weights have lower mortality. Those who assiduously follow a CR diet rich in nutrients may live longer, but they must be a tiny slice of the pie.