You know, I didn't actually realise that. I had only glanced at it and assumed they were applying these ideas to deep models.
> Drop the number of dimensions in W2V and it's really pretty small, and still expressive.
I don't think it's crazy to want to be able to do get better performance with small memory targets though.
They're working on other directions too, but maybe this is useful for their product groups.
You know, I didn't actually realise that. I had only glanced at it and assumed they were applying these ideas to deep models.
> Drop the number of dimensions in W2V and it's really pretty small, and still expressive.
I don't think it's crazy to want to be able to do get better performance with small memory targets though.
They're working on other directions too, but maybe this is useful for their product groups.