Yup! It depends a bit on the cell type (and how it's measured) but they're definitely on the order of 10s of milliseconds.
Here are some values mined from the literature: https://www.neuroelectro.org/ephys_prop/4/
Some very early work had estimated them as closer to 1 ms, but there were some technical problems with the measurement approach; I think that might account for some of the outliers there too.
Bear in mind that they're little bits of fat and water, so they're not going to be particularly fast. It's sort of amazing that the brain works at all!
[Also, no idea why your comment was dead, but vouched for it]
Interesting. I had no idea it was that long. I figured it was on the order of 10s of ns.