評論
打印
Sorry, a chicken. There's no reason for me to make this talk more depressing than it needs to be.
抱歉，母雞的位置應該在這。這個演講已經夠嚴肅了，開個玩笑輕松一下。
It seems overwhelmingly likely, however, that the spectrum of intelligence extends much further than we currently conceive,
然而，很可能的情況是，智慧譜線上的內容已遠遠超出了我們的認知，
and if we build machines that are more intelligent than we are,
如果我們建造了比自身更聰明的機器，
they will very likely explore this spectrum in ways that we can't imagine, and exceed us in ways that we can't imagine.
它們將非常可能以超乎尋常的方式延展這個譜線，最終超越人類。
And it's important to recognize that this is true by virtue of speed alone. Right?
僅僅從速度方面考慮，我們就能夠意識到這一點。
So imagine if we just built a superintelligent AI that was no smarter than your average team of researchers at Stanford or MIT.
那么，現在讓我們來想象一下我們剛建好一個超級人工智能機器，大概和斯坦福或是麻省理工學院的研究員的平均水平差不多吧。
Well, electronic circuits function about a million times faster than biochemical ones,
但是，電路板要比生物系統運行速度快一百萬倍，
so this machine should think about a million times faster than the minds that built it.
所以這個機器思考起來會比那些打造它的大腦快一百萬倍。
So you set it running for a week, and it will perform 20,000 years of human-level intellectual work, week after week after week.
當你讓它運行一周后，它將能呈現出相當于人類智慧在20000年間發展出的水平，而這個過程將周而復始。
How could we even understand, much less constrain, a mind making this sort of progress?
那么，我們又怎么能理解，更不用說去制約一個以如此速度運行的機器呢？
The other thing that's worrying, frankly, is that, imagine the best case scenario.
坦白講，另一件令人擔心的事就是，我們考慮一下最理想的情景。
So imagine we hit upon a design of superintelligent AI that has no safety concerns.
想象我們正好做出了一個沒有任何安全隱患的超級人工智能。
We have the perfect design the first time around.
我們有了一個前所未有的完美設計。
It's as though we've been handed an oracle that behaves exactly as intended.
就好像我們被賜予了一件神物，它能夠準確的執行目標動作。
Well, this machine would be the perfect labor-saving device.
這個機器將完美的節省人力工作。
It can design the machine that can build the machine that can do any physical work,
它設計出的機器能夠再生產其他機器，去完成所有的人力工作，
powered by sunlight, more or less for the cost of raw materials.
由太陽能供電，而成本的多少僅取決于原材料。
So we're talking about the end of human drudgery. We're also talking about the end of most intellectual work.
那么，我們正在談論的就是人力勞動的終結。也關乎腦力勞動的終結。
