This is from IEEE Spectrum, one of the most authoritative sources of technology development, talking about possible night mare scenarios in AI.
Turns out that Hollywood’s Terminator scenario is not necessarily the worst. The possibilities are much more insidious. Having AI slowly take over our lives and then find we are unnecessary would be a much more certain death that we have no way of fighting.
Remember the frog in the hot water thing? If you drop a frog into hot water, it will IMMEDIATELY jump out and scamper away. But if you put the frog into cold water and slowly turn up the heat, then the frog will just stay there until it is boiled alive, oblivious.
IMHO, the jury on AI is still out.