It's very useful if you need to get all the performance out of the CPU. Compilers are good for generating code for 10 year old CPUs. It's usually pretty trivial to get 2x improvement.

That said, typically you shouldn't bother.