I suppose you are somewhat saying that maybe there is an upper bounds that we don't perceive? There is no disproportionate difference above what genius we have already encountered within humanity?
> There's a theory that the changes in our brains that make us smarter than animals also make us vulnerable to psychosis.
Certainly isn't helpful for the AI safety position.
I've seen the limit clearly since the day I entered Kindergarten and failed the Turing Test (e.g. I graduated elementary school the same way Andrew Wiggin did.)
I'm fairly incredulous that anybody doesn't see that limit but I guess if I wasn't I'd be neurotypical.
So far as psychosis I'd point out that between the danger psychotics pose to themselves and the danger of them being victimized by others, the danger they pose to others is minimal. That is, real life psychotic people aren't like the Joker, Riddler and other Batman villians.
> Superhuman AI might just be able to spin its wheels faster
Yes, I've considered that we might not achieve anything close to what is conceptually described as ASI. However, it could be for very different reasons we still encounter many of the pitfalls even with primitive AI.
For example, on the immediate horizon I see a crisis of reality. What will be the effects on society as we enter an era where there is no verifiable reality or truth?
Indeed, although I don't think he perceived an existence where it was impossible.
I suppose in a sense, we are just back where we started. Outside the virtual world we still have the same ability to reason about truth as we did then.
As long as our society continues to move to the virtual world it will continue to be more difficult to impossible.
I suppose you are somewhat saying that maybe there is an upper bounds that we don't perceive? There is no disproportionate difference above what genius we have already encountered within humanity?
> There's a theory that the changes in our brains that make us smarter than animals also make us vulnerable to psychosis.
Certainly isn't helpful for the AI safety position.
reply