> So you can learn stuff from book, but suddently AI can't.
Yes. In fact, people sometimes take the same pattern matching approach as LLMs, and they get pretty good at simulating knowledge, especially in front of laymen. You can usually tell if you’re a domain expert when people using advanced terminology in a confident way, but what they say don’t make sense and they don’t seem to recognize and correct based on dialogue when you zoom in on the details. This is quite common, and also quite annoying. It may be part of the fake-it-til-you-make-it cultural zeitgeist.
> AI learn that usually people use 'is' after 'he', but this is not a discovery or a noval idea
Ah, yes this is probably just pattern matching which we aren’t really aware of but are exceptionally good at, especially children who learn their native language. This skill is doable by AI, it seems. Perhaps that’s just an indication that pattern-prediction is a somehow a different type of skill than general purpose reasoning. I’m inclined to think so, because reasoning can be done without language. It’s surprisingly controversial to say that, but I’m pretty convinced, based on both my own mind and also of experiments on animal intelligence.
Yes. In fact, people sometimes take the same pattern matching approach as LLMs, and they get pretty good at simulating knowledge, especially in front of laymen. You can usually tell if you’re a domain expert when people using advanced terminology in a confident way, but what they say don’t make sense and they don’t seem to recognize and correct based on dialogue when you zoom in on the details. This is quite common, and also quite annoying. It may be part of the fake-it-til-you-make-it cultural zeitgeist.
> AI learn that usually people use 'is' after 'he', but this is not a discovery or a noval idea
Ah, yes this is probably just pattern matching which we aren’t really aware of but are exceptionally good at, especially children who learn their native language. This skill is doable by AI, it seems. Perhaps that’s just an indication that pattern-prediction is a somehow a different type of skill than general purpose reasoning. I’m inclined to think so, because reasoning can be done without language. It’s surprisingly controversial to say that, but I’m pretty convinced, based on both my own mind and also of experiments on animal intelligence.
reply