Question#1
In my opinion the most interesting fact is why and how humans should control superintelligence. Humans are the most intelligent living creatures on earth, and their actions will affect the life of the other creatures
(animals etc.) more. If a machine is built that is more intelligent and dominating than humans, then their action will affect the lives of humans to a great extent. For example, superintelligence may have values that do not align with the survival of human beings. If an artificial superintelligence does become goal-driven, it might develop goals incompatible with human well-being. Or it may pursue compatible goals via incompatible means. Hence the destiny of the human beings will depend on the wish of the super intelligent
…show more content…
So now the humans decide to halt all trucks that deliver materials to the factory, but it turns out that those trucks are driven by robots, and so on.
If developed completely, AI is a double-edged sword. Both could solve the complex issues in which humanity is put, as exterminate this same humanity for one simple reason: the human being would be redundant for a super intelligent AI. So it is crucial the problem of thinking in advance how to control this
AI and induce her to do what we want. But what we want may not be the best for us, and then everything is complicated. Thus the subject, let extends indefinitely.
It 's radical and perhaps frightening but our failure to comprehend the magnitude of the risks we are about to confront would be a grave error given that, when super-intelligence begins to manifest itself and act, the change may be extremely quick and we may not be afforded a second chance. Once machines surpass us in intelligence and progressively become even more intelligent, we will have lost our ability to control what happens next. Before this comes to pass, it is essential that we develop a strategy to influence what