I have to second Skiena's book. I had three books: the famous Cormen tome, "Algorithm Design" by Kleinberg and Tardos, and Skiena's "Algorithm Design Manual" available when learning advanced algorithms. I'm still amazed at how Skiena's book covers both the basics in a far better pedagogical way than the other two, as well as serving as a really nice lookup utility for tackling specific problems (the second half of the book is jammed packed with short problem description, as well as a overview of approaches and considerations). I kept looking up the same topic in all three, and ended up reading the Algorithm Design Manual.
That said, Cormen's book is famous for a reason, but more often than not, I felt it gave way for mathematical rigor than plain language.
Note: The second edition of Skiena's book is significantly improved over the first... well, besides the quality if the paper.
edit: Meant second edition of Skiena's book, not Cormen's. Sorry.
Skiena's is my favorite computer book of the last 5 years; it's radically different (and I think better) than CLR.
TAOCP is, considered on the whole, an even better work, but I end up using it way differently; I've consulted Skiena to solve problems, but TAOCP I more or less flip through and then read 10-20 pages of at random; I am never sorry I did.
Thanks for the link! Erickson's notes appear to be a treasure trove of insight into algorithms. I flipped to the section on dynamic programming and was impressed by how well the idea was boiled down. Also, sorry for the pedantry, but that link is to a 374 page PDF. For any one that is truly insatiable, peel back the link to algorithms and one will find an everything.pdf that is indeed over 800 pages!
Itching to buy Skiena's book for the practical examples (after perusing what amazon would show me of it)! Another very accessible algorithms book I highly recommend is: http://hetland.org/writing/python-algorithms/
The big difference between Skiena's book and others (Cormen, Knuth) I've seen is inclusion of his own war stories and real life experiences and less emphasis on rigourous proof.