I've just installed it (Chrome) but it doesn't seem to do anything, would you happen to know what I'm doing wrong?

Edit: Using the https version of news.ycombinator.com

I don't know, it "just worked" here. Click on comments page, close it and then it'll mark new comments when you return to it or see it on the stories list.