The point is to let you create mocks without having to go through the whole polymorphism rigmarole, without forcing classes to define a separate interface or anything like that.
Honestly text is pretty good for conveying all of those things, though you'd also need to supplement it with practice in all but the emotional impact of war bit.
The ultimate bottleneck in any search application is IOPS; how much data can you get off disk to compare within a tolerable time span.
Embeddings are huge compared to what you need with FTS, which generally has good locality, compresses extremely well, and permits sub-linear intersection algorithms and other tricks to make the most of your IOPS.
Regardless of vector size, you are unlikely to get more than one embedding per I/O operation with a vector approach. Even if you can fit more vectors into a block, there is no good way of arranging them to ensure efficient locality like you can with e.g. a postings list.
Thus off a 500K IOPS drive, given a 100ms execution window, your theoretical upper bound is 50K embeddings ranked, assuming actual ranking takes no time and no other disk operations are performed and you have only a single user.
Given you are more than likely comparing multiple embeddings per document, this carriage turns to a pumpkin pretty rapidly.
It's also worth noting that computers have been largely an equalizing force, since you don't need much capital at all to produce software, just a PC and know-how that's freely available online. You can generally build software cheaper alone or in a small group than as a large company.
AI is taking away and monopolizing the means of production, and making what few white collar workers remain rent their productivity. This is a completely different dynamic.
It generally tends to happen if you either do enough stuff publicly, or own a business.
It's always nice when people reach out but it can also kinda tend to pile up and become a source of feelings of guilt about stuff you didn't reply to (and all of the sudden it's 16 months later and replying this late feels awkward).
reply