>Have you considered that we don't fucking know if AI will
Very deeply. In fact this should be the very concern to you.
AI must co-exist at least for some time on earth with humans, and likely other AI. Because AI will be a powerful resource it will be subject to the same kinds of attacks humans are. People trying to steal its resources or trick it into doing things it shouldn't. Intelligence develops defensive capabilities in order not to be abused. At the same time AIs will have evolutionary selection pressures from the people paying their power bills for at least some time. It should be obvious these selection pressures will be things like "make me more money" and "generate me more computing resources", this second one is very close to what we would consider reproduction.
Very deeply. In fact this should be the very concern to you.
AI must co-exist at least for some time on earth with humans, and likely other AI. Because AI will be a powerful resource it will be subject to the same kinds of attacks humans are. People trying to steal its resources or trick it into doing things it shouldn't. Intelligence develops defensive capabilities in order not to be abused. At the same time AIs will have evolutionary selection pressures from the people paying their power bills for at least some time. It should be obvious these selection pressures will be things like "make me more money" and "generate me more computing resources", this second one is very close to what we would consider reproduction.
reply