That's simple. If it is a model that was trained with only that person's data and is therefore connected to it, it is PII (personally identifiable data) and must be deleted.
If the model aggregates the data of multiple people and is disconnected from the individual it does not constitute PII and can be kept.