Kudos also to Transformer Explainer team for putting some amazing visualizations https://poloclub.github.io/transformer-explainer/ It really clicked to me after reading this two and watching 3blue1brown videos

This is hands down one of the best visualizations I have ever come across.

Hallucinations has made huge progress over last 3 years

Yep, now there are way more sophisticated. Same amount, though.

Nah they have definitely reduced massively. I suspect that's just because as models get more powerful their answers are just more likely to be true rather than hallucinations.

I don't think anyone has found any new techniques to prevent them. But maybe we don't need that anyway if models just get so good that they naturally don't hallucinate much.

That's because they're harder to spot, not because there are less. In my field I still see the same amount. They're just not as egregious.

Not in my experience. For example models often say "no you can't do that" now whereas they used to always say you could do things and just hallucinate something if it was impossible. Of course sometimes they say you can't do things when you can (e.g. ChatGPT told me you can't execute commands at the top level of a Makefile a few months ago), but it's definitely less.

> They're just not as egregious.

Uhm yeah, that's what I'm saying. The hallucination situation has improved.

They haven't reduced one bit in my experience.

This will destroy low margin business (ex Supermarkets?), they will be forced to increase prices. There is a million downstream bad consequences

Love this! Will give it a try

Thanks! In case you'd like to give any feedback, there's a link to my Discord server on the footer of the frontpage :)

yes?

"I'll go to India for my vacation! Sure, the beaches aren't anything like the Caribbeans, but you gotta realize: it's got WAY more people."

The beaches in the Andamans (near Thailand) and Lakshadweep (geologically part of the Maldives) can hold their own against any Caribbean beach.

https://www.eternalandamans.com/havelock-island/radhanagar-b...

https://www.gokitetours.com/top-beaches-in-lakshadweep-you-m...

India is a great place for a vacation, if you want to visit the historical sites and not just vegetate on a beach.

Author just choose a nice number and give no argument to it

Probably chose $100k/yr as an example of the salary of a developer.

Most comments here seems to be historical complaints. But I love this!)

You notice this quickly after working on codebases efficiency is important. Filter pushdown is one of the first database optimizations

Very smart!

Sadly, only HN users care about this kind of stuff