So imagine the language model can produce grammatically correct and semantically meaningful dolphin language, how does it translate that to a human language?
The reason LLMs can do this for human languages is that we have an enormous corpus of Rosetta stones for every language that allow the model to correlate concepts in each language. The training data for human to dolphin is going to be just these “behavioural notes.”
So the outcome is that the bullshitting machine will bullshit the scientists that it knows what they’re saying when it’s actually just making stuff up.
It’s a big problem with LLMs that they very rarely answer, “I don’t know.”
So imagine the language model can produce grammatically correct and semantically meaningful dolphin language, how does it translate that to a human language?
The reason LLMs can do this for human languages is that we have an enormous corpus of Rosetta stones for every language that allow the model to correlate concepts in each language. The training data for human to dolphin is going to be just these “behavioural notes.”
So the outcome is that the bullshitting machine will bullshit the scientists that it knows what they’re saying when it’s actually just making stuff up.
It’s a big problem with LLMs that they very rarely answer, “I don’t know.”