It is but these reactors use U235 which has a half-life of 700 million years. So yeah they will still be pretty much radioactive when they come down. Also, the decay products tend to be radioactive too and have their own half lives on top of that.