評論
打印
Now, this is often caricatured, as I have here, as a fear that armies of malicious robots will attack us.
現在我們時常會看到這樣一些諷刺漫畫，我們總會擔心受到一些不懷好意的機器人軍隊的攻擊。
But that isn't the most likely scenario.
但這不是最可能出現的事情。
It's not that our machines will become spontaneously malevolent.
我們的機器不會自動變得邪惡。
The concern is really that we will build machines that are so much more competent
所以，我們唯一的顧慮就是我們將會打造比我們人類更有競爭力的機器。
than we are that the slightest divergence between their goals and our own could destroy us.
而一旦我們和它們的目標不一致，我們將會被摧毀。
Just think about how we relate to ants.
想想我們與螞蟻的關系吧。
We don't hate them. We don't go out of our way to harm them.
我們不討厭它們，我們不會去主動去傷害它們。
In fact, sometimes we take pains not to harm them. We step over them on the sidewalk.
實際上，我們經常會盡量避免傷害螞蟻。我們會選擇從它們身邊走過。
But whenever their presence seriously conflicts with one of our goals,
但只要它們的存在妨礙到了我們達成目標，
let's say when constructing a building like this one, we annihilate them without a qualm.
比如說當我們在建造這樣一個建筑，我們會毫不手軟地殺掉它們。
The concern is that we will one day build machines that, whether they're conscious or not, could treat us with similar disregard.
所以我們的顧慮是，終將有一天我們打造的機器，不管它們是否有意識，它們終將會以我們對待螞蟻的方式來對待我們。
Now, I suspect this seems far-fetched to many of you.
我想很多人會說這很遙遠。
I bet there are those of you who doubt that superintelligent AI is possible, much less inevitable.
我打賭你們中有些人還會懷疑超級人工智能是否可能實現，認為我是在小題大做。
But then you must find something wrong with one of the following assumptions. And there are only three of them.
但是你很快會發現以下這些假設中的某一個是有問題的。下面是僅有的三種假設：
Intelligence is a matter of information processing in physical systems.
第一，智慧可以被看做物理系統中的信息處理過程。
Actually, this is a little bit more than an assumption.
事實上，這不僅僅是一個假設。
We have already built narrow intelligence into our machines, and many of these machines perform at a level of superhuman intelligence already.
我們已經在有些機器中嵌入了智能系統，這些機器中很多已經有著超越普通人的智慧了。
And we know that mere matter can give rise to what is called "general intelligence,"
而且，我們也知道任何一點小事都可以引發所謂的“普遍智慧”，
an ability to think flexibly across multiple domains, because our brains have managed it. Right?
這是一種可以在不同領域間靈活思考的能力，因為我們的大腦已經成功做到了這些。對吧？
I mean, there's just atoms in here, and as long as we continue to build systems of atoms that display more and more intelligent behavior,
我的意思是，大腦里其實都是原子，只要我們繼續建造這些原子體系，我們就能實現越來越多的智慧行為，
we will eventually, unless we are interrupted, we will eventually build general intelligence into our machines.
我們最終將會，當然除非我們被干擾，我們最終將會給我們的機器賦予廣泛意義上的智能。
