評論
打印
So don't get me wrong here.
別誤會我的意思。
I'm not talking about space travel, merely about humanity's metaphorical journey into the future.
我不是在談論太空旅行，只是打個比方，人類進入未來的這個旅程。
So one option that some of my AI colleagues like is to build superintelligence and keep it under human control,
我的一些研究人工智能的同事很喜歡的一個選擇就是打造人工智能，并確保它被人類所控制，
like an enslaved god, disconnected from the internet and used to create unimaginable technology and wealth for whoever controls it.
就像被奴役起來的神一樣，網絡連接被斷開，為它的操控者創造出無法想象的科技和財富。
But Lord Acton warned us that power corrupts, and absolute power corrupts absolutely,
但是艾克頓勛爵警告過我們，權力會帶來腐敗，絕對的權力終將帶來絕對的腐敗，
so you might worry that maybe we humans just aren't smart enough, or wise enough rather, to handle this much power.
所以也許你會擔心我們人類就是還不夠聰明，或者不夠智慧，無法妥善處理過多的權力。
Also, aside from any moral qualms you might have about enslaving superior minds,
還有，除了對于奴役帶來的優越感，你可能還會產生道德上的憂慮，
you might worry that maybe the superintelligence could outsmart us, break out and take over.
你也許會擔心人工智能能夠在智慧上超越我們，奮起反抗，并取得我們的控制權。
But I also have colleagues who are fine with AI taking over and even causing human extinction,
但是我也有同事認為，讓人工智能來操控一切也無可厚非，造成人類滅絕也無妨，
as long as we feel the the AIs are our worthy descendants, like our children.
只要我們覺得人工智能配得上成為我們的后代，就像是我們的孩子。
But how would we know that the AIs have adopted our best values
但是我們如何才能知道人工智能汲取了我們最好的價值觀，
and aren't just unconscious zombies tricking us into anthropomorphizing them?
而不是只是一個無情的僵尸，讓我們誤以為它們有人性？
Also, shouldn't those people who don't want human extinction have a say in the matter, too?
此外，那些絕對不想看到人類滅絕的人，對此應該也有話要說吧？
Now, if you didn't like either of those two high-tech options,
如果這兩個高科技的選擇都不是你所希望的，
it's important to remember that low-tech is suicide from a cosmic perspective,
請記得，從宇宙歷史的角度來看，低級的科技如同自殺，
because if we don't go far beyond today's technology, the question isn't whether humanity is going to go extinct,
因為如果我們不能遠遠超越今天的科技，問題就不再是人類是否會滅絕，
merely whether we're going to get taken out by the next killer asteroid, supervolcano
而是讓我們滅絕的會是下一次巨型流星撞擊地球，還是超級火山爆發，
or some other problem that better technology could have solved.
亦或是一些其他本該可以由更好的科技來解決的問題。
