A.I. will not kill us all. Humans using A.I. will kill us all.
I believe superintelligence will simply become a third layer of reasoning atop our existing brains, much as our neocortex sits atop our limbic system.
Think about it: Why do you want to live? What drives your instinct for survival? Did you reason your way to the conclusion that life is worth living? No! Your primitive lizard brain simply demands it.
Likewise, AI has no innate drive or agency to dominate humanity or perpetuate itself. Without those underlying biological impulses, it will remain an extension of human intelligence, just as our neocortex extends the capabilities of our more primitive brain.
This doesn't mean there won't be insane times ahead. But I believe that all the mind bending chaos of the coming years will almost certainly ALWAYS have humans at the bottom of it. It may kill us all, but if it does, it will be a HUMAN who is responsible.
