Comment by fsmv
14 days ago
There are some that exist. The problem is you need at least some RLHF to make it follow instructions instead of just predicting sentences.
14 days ago
There are some that exist. The problem is you need at least some RLHF to make it follow instructions instead of just predicting sentences.
Instruction is not the only way to interact with an LLM. In tuning LLMs to the assistant persona, they become much less useful for a lot of tasks, like naming things or generating prose.