From what I have seen, people writing about linguistics do not usually bother specifying this distinction in this context. It is usually implied that an expression like "following a vowel" or "following a consonant" has nothing to do with orthography, but the actual phonetics. The orthography is not really considered a source of truth.