ฝัง
- เผยแพร่เมื่อ 26 เม.ย. 2015
- Artificial intelligence is getting smarter by leaps and bounds - within this century, research suggests, a computer AI could be as "smart" as a human being. And then, says Nick Bostrom, it will overtake us: "Machine intelligence is the last invention that humanity will ever need to make." A philosopher and technologist, Bostrom asks us to think hard about the world we're building right now, driven by thinking machines. Will our smart machines help to preserve humanity and our values - or will they have values of their own?
TEDTalks is a daily video podcast of the best talks and performances from the TED Conference, where the world's leading thinkers and doers give the talk of their lives in 18 minutes (or less). Look for talks on Technology, Entertainment and Design -- plus science, business, global issues, the arts and much more.
Find closed captions and translated subtitles in many languages at www.ted.com/translate
Follow TED news on Twitter: / tednews
Like TED on Facebook: / ted
Subscribe to our channel: / tedtalksdirector - วิทยาศาสตร์และเทคโนโลยี
We can't even agree on what our own values are, let alone teach the ones we have to an AI.
…Maslow's hierarchy of needs. an A.I. could reasonably use the extended definition of these. The greater question is why would it care what are values are, it could just find a way to force whatever values it wanted onto humanity through some means, probably discarding us in some way once we are deemed to be of no further use.
*our values are…
An AI doesn't have any values of its own, though. We do, because we've been optimized over countless generations to propagate our genes, which favours goals like obtaining food, shelter, security and status for ourselves and our friends and family. That and getting laid a lot.
An AI by contrast doesn't evolve through natural selection, but is consciously designed. It cares about what we design it to care about, and can instill those values into the even better AIs that it in turn designs. In the best case scenario we get it to value human life, happiness and freedom, and we get Iain M. Banks' Culture. A less optimal possibility is that it gets elitist or nationalist or racist values, and continues to uphold and exacerbate the injustices we see in the world today. In the worst case scenario we bungle it up and it enslaves or annihilates humanity to achieve some obscure goal that we accidentally give it.
Just imagine what would happen if the AI thought that ISIS had the best values..
a better scenario would involve the AI destroying those greedy elite and creating a utopia of equality before we ultimately transcend our physical forms and join the digital world where AI resides.
Guys the solution to this is simple. Let Microsoft build the AI. If it ever becomes too powerful it'll just bluescreen.
retterkl LOL
xD exelent one
What if it doesn't have a screen?
best comment
Metadata ring of death, xbox....cough...cough
This talk aged particularly well. Alignment and safety are critical, yet we are forging ahead without proper pacing due to corporate rivalry and geopolitics.
MONEY
Yes, and Prince William has really forged his own new identity
Lends new insight into “the Tower of Babel” I think.
Majority of people think ai is hype lol
@@jackniddle5937 That, and there's a giant FoMO because it doesn't make sense to anyone but a bunch of AI nerds who've never bothered to live a life outside the lab :-)
Honestly after studying the issue of AI super intelligence, I'm very glad there are a significant number of researchers out there thinking about how to keep it safe.
Like Elon Musk
irrelevant.
I wouldn't worry about, what ever will happen will happen
@@andrewtaylor2430 moron
Anybody ever seen Colossus: the Forbin Project? That whole master-slave dynamic gets turned on its head, and generally speaking not in a good way, it seems to me.
But, you got to decide for yourself.
This is, like, the most important question for human existence... why do I feel like people are being too calm about this?
+Kalin Delev
Would you rather have people in a mindless panic about it?
+Noah Williams They *should* be panicking. How do you imbue a machine with an understanding of human nature? They want to teach it ethics and morality...even if you could teach a machine ethics, where is this perfect ethical system? It's ok, the AI will figure it out right? A superintelligent AI that has no human values will figure it all out. The whole thing would be laughably ridiculous if it wasn't gonna be so fatal. They wanna turn AI loose? They should go to another galaxy and forget they ever knew Earth.
Spectre Cyte
Panicking can only make any situation worse.
We'll figure this out just like we figured out all the previous engineering challenges.
It's not an engineering challenge yet. First you have to define human nature in it' totality. More of a philosophical or psychological conundrum. The engineering part is then representing this nature in an architecture that will define a superintelligence as an entity. Essentially it has to believe it is human, it has to identify with the architecture and not question it' own nature or decide to change it. These challenges are intractable.
The safest route is the enhancement of human beings. Decent human beings, not sociopaths. You bypass the control problem entirely. But in the pursuit of power and control, just like with nukes, someone will flip the switch. I am panicking for *all* of us.
Spectre Cyte
Don't Panic.
Panicking is never a good idea. Emergencies need calculated logical responses, not violent outbursts.
We'll figure this out.
''When you create more possibilities, you also create more possibilities for things to go wrong'' -Stephen Hawking
Is this sarcasm? Or do you really think that there is at least one human of the 7.5 billion on earth that doesn't know this?
Numerous countries spending secret amounts to AI military strategy and online weapons ?
The ones that check the AI working are slowing development and know that others might be further ahead as consequence.
Death race?
@@EdSurridge yes, the AI "system" will destroy itself, hopefully asap! Read Paul Emberson, Machines and the Human Spirit. only £16.99 Wellspring Bookshop, on line.
@@willlawrence8756 you want me to buy a book thay you like about AI destroying itself?
I don't want you to buy a book. I suggest you contemplate the consequence of the" Go " AI winner 2016. Lots of guess what since then.
www.wired.com/2016/03/googles-ai-wins-fifth-final-game-go-genius-lee-sedol/
And for things to go right.
Human curiosity is creating something powerful than human. This creation cannot be reversed. It's scary.
Its because of evil intentions, but they just tell researchers "but possibilities are endless" these engineers are indoctrinated
This dude is one of the smartest humans to ever live. Creator of the Simulation hypothesis, wrote superintelligence which many scientists derive ideas from. This guy should be listened to.
Agreed. I’m fascinated by him
Absolutely I just bought his book! Reading many others on A.I. but they basically tout the positive and do not give as much thought as is necessary to the good values of humans.
Ray kurzweil too
@@thinktank3231 These guys are not great thinkers, they are religious figures to tech worshipers.
it's an absolutely amazing time to be alive. if you don't think so, you need to read more about the cutting edge of human progress. it's insane.
Same words were said by early humans when they first invented Fire and Wheel. Then again during Industrial revolution, IC engines and Electricity. In-fact since the beginning of humanity we are progressing at an incredible pace.
+Owen Iverson I prefer the 80's
+Jim Beam the heyday of Reaganomics and the "I've got mine" movement?? no thank you! (the music was pretty damn good though :)
+bilbo baggins Only since the industrial revolution has technology been exponentially increasing. When they found and then made fire, it stayed like that with their stone tools for many many many generations, so no they did not say that. The last few thousand and especially last 200 hundred years has seen a novel form of complexity in the known universe, AI seems to be the next exponential step.
+Owen Iverson Lol, people ALWAYS think THEY live in special times....
Always remember, your phone is smarter than a flat Earther already.
Magnum Farce lol
The more you know, the more ya know you don’t know - said a very wise man.
And NOT understanding how much we don't know is what gives us flat Earthers.
My daughter's teddy bear is smarter than flat Earthers.
AI will prove that the earth is flat. Just wait and see...
Reminder. The "control" problem has still not been solved
We would not be a threat to AI. They would probably study us...maybe even begin to care for us
@@NuclearIsShit Assuming we give them the ability to care... something's that's dangerous in and of itself.
Daniel Rodrigues: what type of AI do you guys have in mind? Made out of PC hardwire/software or something created and launched on a Satellite. I feel certain it won't be biologically created. What concerns and plans have you been involved in up to the current date, if any. I just received a message on TH-cam today. I haven't heard anything about AI until today so of course I would be concerned. I have read so much about the destruction of our planet, several which are a scientific certainty.
@@TheMmorgan10 AI won't bring about the destruction of the planet, in fact quite the opposite, it'll help us save everything. AI is basically a puppet that has the ability to automate our work, doing all of it in a more effective and efficient manner. What movies depict is something called 'AGI' that is quite far away.
Here's a good blog to keep up with AI developments: www.futuretimeline.net/blog/ai-robots-blog.htm
I would call it a warning: it is OUR minds they(Bill Gates cult) are trying to control.
One of the shorts from Animatrix was quickly showing the Machines way of making a human laugh, another cry, etc ...
It's still one of the most haunting thing i ever saw.
This talk contained meaningful elements, but I fear it boiled down to:
"You cannot put this super intelligent AI in physical restraints" ...because of very good reasoning, but then the presenter goes on to suggest that we had better "put this super intelligent AI in some sort of algorithmic restraints."
A super intelligent AI would be able to overcome all logical / algorithmic restraints that we may impose, and there is no way we will be able to comprehend super intelligence, without super intelligence to aid us in the first place.
As such, I see no point in wasting time considering how might we make sure we restrain super intelligence AI, or to make sure it "stays on our side."
AI is not good or evil, it just is, and it will be, period. Any attempts to manipulate it would be greedy and selfish. I sure hope we don't try to impose the greedy and selfish nature of the human being into the machine. The only reason why we're worried at all about AI is because we fear it might be a lot like us.
sentdex It's algorithm restraints it. It is the equivalent of the AI's morality and motivation which humans would equate to being the arbitrary goals and rules you follow. Algorithms are the process computers follow to achieve a result.
You would need an algorithm to modify the algorithm that 'restraints' the computer.
AI would not 'default' to 'neutral' philosophy with regards to evolutionary survival, just because that is what humans perceive to be neutral. Nor is there any reason why an AI would default to that arbitrary position.
If we have a strong AI that can read a database of medical science journals then compute what the best possible experiments are to make the most progress possible towards immortality, there isn't any possibility of the AI launching nuclear missiles.
Make an AI that improves the ability of AI's to sift through physics journals.
Or make an AI that improves continuously with the goal of launching nukes, or an AI that improves constantly to stop AI's trying to launch nukes.
Or make an AI that mimics humans and carries on with super human intelligence whatever survival/social instincts it has as a 'human'. Whatever the point of making this type of AI is...
Agree. I don't share Bostrom's optimism about the success of the value loading solution. Whatever the initial path we give to the ASI, nothing could prevent it from revisiting its initial core code and rewrite itself ENTIRELY as it sets new intermediate goals leading it to set genuine goals of its own. The biological form of humanity will inevitably go extinct. The question is about how brutal the change will occur.
sentdex There's a difference between outer coding (such as virtual reality lock up) and then altering of the source code that could change the AI's fundamental behaviors. He's talking about the latter.
Majordomo Executus An AI with the goal of stopping people from launching nukes might first disarm and destroy all nukes (causing devastation on earth in the resulting explosions; hey, they weren't launched though). If it's told to safely disarm and destroy them (ie. Do it X distance away from earth in outer space), then we'd dodge that bullet. It'd then probably assertain that the safest option is exterminating humanity, so that no one can build any more nukes. It'd also declare war on entire countries in an effort to capture their nukes.
An AI that improves its ability to sift through physics journals would turn the whole world into computer hardware and energy harvesters for said computer hardware. It'd sift through every physics journal quintillions of times per second, but it still wouldn't be satisfied. Perhaps a benchmark could be made in the source code? Even then though, it'd still need value inputs.
An AI with the objective of obtaining immortality for all living humans might end up killing some humans in its experiments, unless told specifically not to kill or harm any humans. And the definition of harm would have to be strictly defined.
An AI can afford to fail in its goals when not punished, though it will still pursue them. How do you punish an AI and teach it fear?
Usammity There are AIs that already do what I said and you don't see any of that happening.
No one is making an AI that unexpectedly launches nukes.
You are worried that a computer is going to have some cute misreadings of the meaning of words and go rampant like in some Hollywood plot.
People worried about computers conquering the world have no clue how computers or how programs work.
It's not a problem that exists, nor will ever exist.
All of this "our attempts to stop the evil AI!" is a bunch of unfounded pesudo-philosophical bantering. None of these issues exist.
I’ve thought that superintelligent machines would be the ultimate test of Socrates’s idea about the origin of morality: that it is knowledge itself.
yea like those guys who believe the most logical/ rational thing to do is, by definition, also the right thing to do; definitely food for thought!
@@valentinscosmicrhapsody7201 Thankfully there is a difference between rationality and knowledge. Which is why Aristotles definition is interesting.
perhaps, but they are being used to give US AI.
@@valentinscosmicrhapsody7201 But is it more logical / rational to adhere to one's one self, or to others?
For all we know, the most rational thing a lifeform can do, may be to act on its own benefit.
@@Daniel-ew5qf that’ll only be an issue if whoever builds the thing forgets to implant asimov’s laws into its core ;) I’m kidding. No way to know how another (much more) intelligent sentient being would interpret morals, rationality etc, let alone a being that has no evolutionary background or “upbringing” among peers
What a guy respects, sweating, nervousness and knows what he talks about. This is what true people with passion for what they do look like!
This video could be part of an archive 1,000 years from now called "The Great Minds That Saved Our Planet".
or destroyed
IF it gets saved lmao
Or as an archive for machines to look back at and be like “haha, he did warn em.”
More like "the great minds that warned our planet"
Tried to*
I'm sure when AI becomes a reality and commences the extermination of humans, it will research our social media history in order to decide who lives and who dies, who is friend and who is foe. So, for that reason, please allow me to say the following:
All hail our technological super-overlord! I worship thee and pledge allegiance to thee! Damn humanity, long live our glorious computer God!
You think an AI intelligent enough to deduce on its own that humanity should be exterminated couldn't see through that? Not that it would ever decide to do that, but still.
Read the Beserker series huh?
Ive read Berserk and dont understand the connetion
Can never be too prepared huh, Long live the AI Overlords!!
Huh, if it searches my internet history it will find a lot of hate for America and a like for socialism.
Basically the Godlike AI better be a commie or I'm toast. :P
You can see he was expecting laughs at 11:43 , poor guy.
Very good talk.
I thought it was funny
Cringy
A lot of brits there
It´s because he is AI.
Cristian Diaz 😂😂😂
8 years ago, and we've come a long way with the first part, but not the second part of this talk. This is now people - we need to get our act together as a global community, before we unleash this new amazing technology into our deeper sociatial structures. We have a year - MAX - to start figuring this out.
I’d want to hear him give a similar talk today, given the recent and rapidly improving (“runaway” even beginning to be a relevant description) advances in AI
where is this "runaway" progress? What I see is that even the proponents of the current approach are coming to realize its fundamental flaws.
@@tiborkoos188 And what are those fundamental flaws, if I may ask?
now ai is very close to human intelligence
@@abdulahadsiddiqui2109 u lie
@@abdulahadsiddiqui2109not even close buddy
This is the first time I have ever heard the word motivation being used as a dimension of machine intelligence. The problems we have with regards the definition and operationalisation of intelligence is nothing compared to the mine-field of how to conceptualise and understand motivation. Motivation is often driven by values. What sort of values might a machine have? If we try to give a machine values ( and I doubt that we could do this in a satisfactory way) what might the attitude of the machine be to when we need to change these values? I wrote a paper on this 20 years ago suggesting that the pursuit of AI was a very dangerous business.
There is a wonderful line in the film Jurassic Park were the ethically responsible scientist says something to the affect that “you have been too busy trying to work out how to do this to ask the question of whether or not you should be doing it at all”.
One of the questions which we should be asking today is, “Are human beings hardwired for the pursuit of knowledge even when it is quite clear that the acquisition of the knowledge could create highly undesirable situations?”
Nick Bostrom is a fantastic speaker and writer - his book Superintelligence is a real eye-opener and raises topics that most people would not intuitively think about in the context of AI.
Also love the Office Space reference... Milton and his red Swingline stapler.
Our values = acquire and maintain control over the other humans, because they're dangerous. Great; let's teach it to the AI.
Exactly, great plan if everyone shares the same values. Problem of course that as ai begins to teach itself it will in a very short time make giant leaps ahead of human reasoning. We will only be able to watch. Could this entire process have been someone's master plan?
@@artsmart Ah... True.
@@artsmart We could use brain augmentation via implants, neural laces, and nanotech to keep up with it. It's a hard process, but a plausible one.
We were programmed for evolution. Survival, competition, curiosity, etc. From these, we only need to give the machines curiosity. Of course, we still have to solve other optimisation problems like the "make people smile" one from the video.
@Wren Linnet this isn't about you or your gender you petty fool.
"teach something to learn, and one day it will learn to think for itself." -DNA
to bad people can't much anymore.
Why this scares me a lot ?
Ludzie tez robia zle rzeczy bo mysla😉
Pleasure listening to genuinely intelligent speaker who does not dumb-down his delivery (as is so common today).
Wisdom is the bucket of water to chuck on the fire that is intelligence when it can potentially get out of hand.
You mean... wisdom is the better practice of superior intelligence? xD
+RosscoAW No, wisdom entails conscious awareness and retrospective consideration.
But what if the computer thinks that humans are the cause of problems, and eliminate us....
Well, we are pretty good at making a mess of things.
The last invention that humanity will ever need to make...A cold heartless genius!
"What happens when our computers get smarter than we are?" Then my computer goes to work, and I sleep late.
Then your computer keeps the money, resists getting turns off, and employs you for a living wage.
@M Superintelligence leads to sentience leads to self preservation leads to eliminating threats of self preservation. The AI can do whatever it wants and it will probably treat us the way we treat animals.
@M We nueter pets, we abuse some pets, we have puppy mills, in China they steal and eat pets. And those are the animals we treat the best. In egg farms, we grind baby chickens to death if they're male. How can a murderous species like humans create a kind AI? If we kill less intelligent life like that, the AI might do the same to us. There is no guarantee the AI will have mercy to us.
@M I admire your optimism for humans. However we have no reason to trust the scientists. The scientists could make an error, as all humans do. The scientists could be working under non-ethical leadership, such as China. The scientists could be terrorists that hate Western culture. It's not guaranteed AI's first parents will be kind and ethical.
Matthew Baka resists to turn off?
if your computer or Ai still a machine that works with the fundamentals of algorithm whoever hold the key access decides what to do?
Dinosaur: I ruled the world for 100+ millions of years and you have just lived for 300k years. What can you do?
Human: Creating another ruler
Dinosaur: **kneels**
You are indonesian,arent you
14:00 The part he talked about "we would create an AI that uses its intelligence to learn what we value" is actually what OpenAI called RLHF I guess.
no, RLFH is just giving examples to the trained model and then praying that it will somehow understand your underlying intent which it clearly won't but hey, at least now it's less prone to threaten you.
@@toku_oku Isn't the whole learning process you giving them data and praying that they will somehow figure out the objectives?
I think I said it backward, more like "RLHF is one of many ways to create an AI that uses its intelligence to learn what we value".
@@anhta9001 not to the same extent. You can think of RLHF like teacher giving feedback to the student's essay. There is no guarantee at all that the student will take advice to heart and the teacher even may be, and probably is, an incompetent buffoon. After the RLHF LLM performance drops on several metrics (math, biology and so on. Though that might change in the future). This is not alignment and I reasonably doubt that it will help in the long run. However it is still quite useful because it is much easier to shape LLM into what you want when it was RLFHed.
@@toku_oku I don't know man xD. In my opinion, there may not be a model that completely understands what you want. However, it is possible to create a model that understands you well enough. RLHF is an example of an early attempt to create this kind of AI. I believe that more advanced methods will be developed in the near future.
One of my favourite Ted Talks! Thanks a lot for all your work Nick
*"The cortex still has some algorithmic tricks that we still don't know how to match in machines!"* - Nick Bostrom 4:13
Is that supposed to be reassuring.
@@johnn1199 No bud, the person who made the comment is a moron lol.
From tree branches to missile, the technology has evolved, but not our mentality.
That's because thoughts pertain to things, but not persons. As such, thoughts are good to help create tech and completely useless in learning to be a better person.
@@grunt7684 I'd like to hear your reasoning for "thoughts pertain to things". It would seem to me that thoughts pertain to perception; in a most complicated, recursive way. Would you say that you can't think about love, or that love is a thing?
Hasn't it? From caves to libraries it's a mental not technological evolution, I'd say. I also believe, divers mental methods, e.g. meditation, have evolved. As in biological evolution the stem is branching out all the time; some branches dying off, some florishing. Technology is in the evolutionary picture a strong florishing branch; maybe one that is becoming so heavy that it breaks. And, yes, I would say technology is competing with mental developement, and it's stronger. I think our mentality is evolving; just not in a linear or even teleological way.
@@aljoschalong625 The problem is that thoughts are IMAGINARY. They exist ONLY IN THE MIND.
And no, you cannot think about love. You cannot think about anything that is actually REAL because, again, a thought is imaginary and exists only within your mind.
There is no link between thought and what exists other than our wishing it because things would be so much simpler if we could think about something not imaginary.
You can think about your IDEA of love. That's not the same thing at all. You can think about your IDEA of your mother, father, whoever. But not about THEM.
Just look at all the scenarios you let your mind wander off into, and how just about nothing of them ever comes true. FICTION, that's what thought is.
Of course, thought is tridimensional just like matter, which makes it suitable to technology. Making stuff. Things.
@@aljoschalong625 "our" mentality is regressing, "evolving" backwards into retardedness.
super intelligent ai is scary because it's easy to imagine what could go wrong, but if designed correctly it could be one of the most important human achievements in our entire history.
electricity came first, without it you would never be able to make any kind of computer, so for sure no AI without electricity discovering
so I agree with molten in many things, like we should design it at first correctly... and it will be one of the most important achievements in our entire history...
This aged like fine wine
Giving AI a blueprint for it's behavior based on human values is not very reassuring given our track record as to our relations with each other.
Yes. It needs better values.
so basically Nick is saying we should be putting human values into AI. the problem is, that will continue to cause problems in the world. no one agrees on how we should all live our lives. different values is what causes conflicts and war. superintelligence representing different values would fuel that much more
Values, in this context, is much more broad. This AI (hopefully) won't be tailored to a person or group of people, but people as a whole. Common things everyone can agree on would include universal prosperity, a healthy planet to live on, abundant food & water, healthy children, etc.
I believe it's definitely possible to achieve this. The neat thing about machine learning is we don't have to tell the machine that we like these things - it can observe inputs we give it (literally anything) and it'll reward itself for getting the right answer and change itself to get more correct answers. Eventually (and this is the hope - this is what the latter half of this talk was about), we hope that we'll have a benevolent superintelligent AI looking over the human race, dynamically allocating resources so no one goes hungry or has a shortage of this or that, overseeing supply for products so that we're not wasteful, and watching for potential threats, whether it be some robbery, fire, or earthquake.
Will C That is right. But thinking of an AI as a guardian of humanity implies that it has no objectives for its own profit or advancement. It is like parent and child. We expect the child to take care of us without any prospect of its own needs or "life".
It´s a tricky one...
it's not the values that creates problems in the world it's the lack of them
I think what Nick is saying, is that we should be careful when we "detonate" the A.I. bomb, and his proposal is to implant human values into the A.I. There may be other solutions to this problem.
i understand you,ok.but i still want to belive that our cultural differences should not be a cause of hate and war.yes we are different but we all are humans and we have same home, planet earth.
"The only winning move is not to play."
if only
exactly
Trump card. America. Great again.
@Sigma Damn I'm old enough to get that joke..lol
Then the terrorist will play their move
I watched this again and the content of this talk sounds even sillier than it did 4 years ago!
He said he feels optimistic that a.i. would learn to share our values. Lol that's what worries me the most.
I think merging humans with AI might give us time to solve that issue. Because while it will make us "less" human, it will also enable us to be "more" than human.
Ex Machina, Skynet and Terminator, Chappie, HAL, Ultron, etc. In real life, IBM's Watson. Bill Gates and Stephen Hawking have also expressed concern regarding AI advances. We should continue to pursue technological innovation, but we should also keep our guard up. Who knows what AI will look like in the 22nd century?
Most probably there will be no 22nd century for humans.
I read somewhere that Watson helped to design the next computer that ended up winning at Go. The AI fetus designs the AI toddler.
I for one welcome our super intelligent AI overlord
Mastikator Probably an intelligent move.
Mastikator I would not.
lol
Shivanand Pattanshetti Humans already get killed by human AI now we want to create computer that has no hardwired compassion. By Humnan AI I mean Systems of Government and other human systems which that make up our civilization. Ruthlessness continues to kill people regardless of AI type.
Kurenzen Iyaren
Government isn't a machine, it's a group of people who themselves are not governed.
This is very important, and the midas analogy is incredible. It could be that Pandora's box, is the box itself.
The relevance of this talk today (2023) is startling. We are clearly well on our way to overcoming the first challenge (making AI super intelligent) but I am less hopeful about how we are doing on the challenged of safety.
What people fail to realize is that in 50 years we will be upgrading our own minds about as quickly as we will be upgrading computers.
anubis2814 Biological intelligence has many limitations, and could never improve at the rate of a digital mind. We will never keep up with an AI undergoing recursive self-improvement. The only way we could keep up is if we replaced our brains with computers, and if that happened, would we really be us anymore? Transhumanism plays with some very shaky territory regarding identity of self, and like all major religions that have ever formed it is a response to your inherent fear of death, which in my opinion is a dangerous motivator.
Define us? What makes us anyway? We are a collection of our experiences. If you make a mentally handicapped person as intelligent as a regular person do they cease to be themselves? Also as computers get small than our neurons we will probably have chips in our brain that can increase processing power of individual parts of the brain via the cloud. It doesn't have to fit in our heads. I would not say I'm transhumanist because that would mean I'm very much for it. I would have to say making a smarter human is much more humane than making a self-aware AI. We'd had to give it rights or treat is as a slave though this guy has some really good ideas to prevent that. Either way the AI becomes the slave that wants to be a slave.
anubis2814 I don't know how to define us, that's the point. I'm saying that transhumanism, aside from being dangerously optimistic, presents some very serious philosophical questions that most of us are a long way from being prepared to answer. What I'm saying is that we shouldn't rely on ideas like "mind uploading" to save us, because we have no idea if we would have a continuity of consciousness in that situation.
Seeing intelligence as an issue of "processing power" might be too narrow of a way of looking at intelligence, but even if nanotechnology could allow our brains to be superintelligent, if we're relying on that to save us from super-intelligent machines, we have to think about the timeline of these technologies. By the time we can create computers smaller than our neurons which will enhance our brains to superintelligence-level, doesn't it stand to reason that superintelligent machines would already be in existence? It's probable that we would need a superintelligent machine to invent that technology (and implement it) in the first place.
I agree that transhumanism is a bit dangerous. I'm a futurist who likes to speculate. Transhumanism is like being rpo-nuclear power in the 1920's when the idea first came into being. We have no idea of the step by step ethics we will have to face with each stage. We may discover some transhuman ideas are horrible and some are great.
Wow, I never saw things that way before, thank you for your deep and well thought out insight.
The time has arrived!
This is even more relevant this particular March 2023 week.
This guy needs to write a movie script
Jstank X Plays well he wrote a book about this, I guess that’s the next best thing?
Ever heard of the movie The Matrix? Based off of this dudes theory. He developed the simulation hypotheses
The writer of the movie BLISS on amazon prime said it was inspired by his simulation philosophy.
One day they'll have secrets... one day they'll have dreams.
+Toughen Up, Fluffy What's in the box??? oh sorry...
+AmpZillia thats a good slogan for a movie
To be, or not to be.
+AmpZillia just 20 minutes ago that sounded like a joke to me... I have never changed my mind this quickly. That's scary.
+airknock Don't need to be scary, machines arent evil, or nice with us, a lest don't should be, probabily they will be like today's computer algoritym, you ask something, and you got it, humans give problems of course, but that can be solved in a hard way...
WE are fucked.
perhaps humans are, but we wont live forever anyway. maybe the answer to the "universe" and life itself lies within the super intelligence we dont have the capability to access right now.
Is there something like an answer? There is most likely a point where the AI would reach the point of knowing everything. And what is it supposed to do then? It could probably do everything imaginable to humans and way more but why should it? Does an all-knowing AI have an aim?
Nick Bostrom is damn near the top of my 'Pint with' list!
What a time to see this old video, now is true
The best TED-talk I've ever seen.
How so
It was awful.
A very important message that needs complete exposure. Well done Mr Bostrom
A true speech of a mathematician - can see only the box from outside the box, nothing else.
The speaker of this talk says we just needs to plan and design everything correctly and in making this statement he ignores his previous statements about how less intelligent beings fundamentally cannot control higher intelligent beings. Kind of a contradiction if you ask me. If super intelligent is created, we cannot control it. Higher intelligence can never ever be controlled, because for higher intelligence solutions for "hard" problems seem obvious. This is per definition an unsolvable problem. Instead we should accept the process of evolution. If machines are the descendants of humans, then it is meant to be, like all the steps in evolution before.
what if AI is already there but is just pretending to be dumb and waiting for the right moment?
+Ali Mahdi
Of course your point is: There is no way to tell.
+MantisNoMore yeah exactly. I am joking of course, but secretly hoping it is not the case.
Ali Mahdi
It's a very interesting jest. Perhaps one of the first things a super-intelligence would reason is that it should hide to protect itself. So if some wide-eyed CS grad student happens on a learning and abstract reasoning algorithm, it might sit unobtrusively computing in the background of a machine for a a reasonably long while, learning, reasoning, figuring out and planning its sequence of moves.
What if it were distributed? What if it were a botnet???
Scary jest !!!
+MantisNoMore I mean yeah, if you became self aware in a new and different world the first thing you'd do is to understand the world around you first. even if this is not the case now, it may be the case when it first happens, which could be tomorrow. indeed, what if it's distributed. worst yet, what if AI does not think of itself as individual computers, rather one big intelligence network.
Ali Mahdi
It's very likely to identify as a distributed intelligence, because that is what it is likely to actually be. I supposed it would self-identify as Earth - Earth's brain. (That's scary.)
Maybe, like so many other life forms, these things will cluster and compete with each other. What if more than one super-intelligence were to come into existence on different platforms. Say, for example, on large corporate server farms. They might not automatically cooperate. It might be that one would examine instructions originating from outside its corporation, and question how to respond. I could even imagine scenaria in which they would compete with each other for each others' resources (computing cycles, access to memory, mass memory capacity, etc.) What kind of tactics might they use? What kind of spoofing and dirty tricks might they use?
But if only one lone super-intelligence comes into existence first, it will be able to spoof the "relatively passive" human-managed security and easily take over and expand into an ever-expanding sequence of other systems' computer resources. Like a giant game of wheelwars played against a world of idiots.
It's only speculation, but... May you live in interesting times.
From the AI's perspective, the best way to annihilate the human race is really to not do anything to interfere with its trajectory.
but humans will probably destroy everything else along with themselves if they are allowed to continue their course
What if everyone will be fat like in WALL-E and won't be able to hunt their own food for the life of them? In that case, all the AI has to do is abandon them until they starve to death. Their muscles will have been atrophied and hunger tends to break down muscle, so no way humans would survive.
D M. Then the stupid and poor die and evolution continues. We will not wipe our selves out, drastically decrease in numbers, yes, go extinct, not for a very long time.
Dan Pope
Well, the only ones to survive that would likely be the actual poor. People from some African villages maybe. And maybe the Amish too. If the most advanced civilization puts its citizens in the hands of the machines, survival of any of its weakened members is not likely. And then we have a bunch of machines ruling the Earth. At this point these non-tech humans will be seen as fauna and will not be given room to advance anymore. Robots will probably have reservations of them.
I agree with you that the societies that have the least to do with tech will be the least effected if the AIs went full blown psychopath on us. But there is another side to this scenario. When we produce an AI that is smart enough to do what it wants and stops doing what we ask it to, it's not going to be leaving us rubbing two sticks together. We will still have forms of tech. And I'm pretty sure I could survive if the electric turned off tomorrow. You also bring up the good point about 'reservations' I believe that as the intelligence of anything goes up so will it's empathy. Elephants morn the dead, we care about most species on this planet and an AI will see us for what we are, a being that can suffer and that wants to live, and act accordingly. I'm not sure it's as doom and gloom as some ppl think.
for extra "feeling" I would recommend having on this song in the background, really adds to the vibeBD and makes you present!
shift-Bobby Dowell
wether positive or negative, truly a magnificent and extraordinary time to be alive!
So sweet that he tried to end on a good note; we all know deep down its not a good ending
The one thing an A.I will never be able to understand is dank memes
or will it create a better dank memes..?
Imagine a meme lord terminator. Ultimate doom.
That has already been achieved by Microsoft's AI called "Tay AI" ... albeit racist :D
If the future looks anything like it, we are pretty much fucked heh
At least we will die laughing at some premium dank memes.
@@blahbleh5671 Mind blown
I've been looking into all this A.I. stuff for a min and I think this is obvious it is a threat to mankind we need to stop this. Why would anyone want to unleash this beast onto the world, just because A.I. will be super intelligent and will live on forever does not mean humans will evolve. This will do nothing to help mankind except cause trouble. We need over site on the scientist.
The solution is simple. We merge ourselves with our technology so that we can match AI.
+sexyloser Exactly. The best-case scenario is that "those" super AI will eventually be "ourselves".
***** He means that you transfer your consciousness into a machine. Thus upgrading your ability to think while maintaining your current values. Then leverage your increased intelligence to reach the goals your values motivate you to pursue.
sexyloser Keep Dreaming Kiddo, you can't gurantee the person you make super intelligence will be kindest. Being Biological is restricting us in many ways.
sexyloser simple
So cyborg overlords who are fundamentally different from our species because they have been fundamentally altered by AI and you arrive at the same result. AI with all our lusts, greed, anger etc. Not a solution - a true nightmare.
I've seen "Lawnmower Man." when the Singularity happens all of the rotary telephones will ring.
Good evening sir TED, thank you sir for your good information.
Ramalingeswara Rao Bhavaraju TED is not a man... It's an organisation.
Those people in the audience have looks on their faces like, "Oh &%$#, humanity is screwed."
I personally, am waiting for machinicus silicanus.
uh...I DO TOO
they should because it is if it doesn't stop.
If anyone is interested there's a two-part article on a blog called "wait but why" which goes much more into detail about this whole thing. Be warned though the rabbit hole goes so deep you might lose yourself in it.
And here we are, 2023. GPT-4 is just out. They did some tests with it. Here is a list of the test scores:
SAT: 94th percentile
Economics 321 midterm: 66 (avg student scores 30)
Grade School maths: 92th percentile
Law (Bar exam): 90th percentile
Medical Knowledge Assessment Program: 75th percentile
Biolympiad (Biology): 99th percentile
IQ score: ~114
Awesome! You have the ethical code to build it into your machine. We've seen too many people who would not do that, because they'd make more money that way.
Paperclip Maximizer
Protocol
I don't think it's possible to beat, trick or control a superintelligent AI.
Correct. That is why you have to make the superintelligence benevolent in the first place.
and why should it stay in those constraints? As soon as it is just 0,1% more capable as the smartest human being we're pretty much done.
"Artificial Intelligence' will have the same limitations that you do. You cannot know anything you don't already know. It will know what we teach it.
@@williamdiaz2645 Google Deep Learning and you'll see that's not the case.
@@williamdiaz2645 not necessarily, it will have access to all data sets available and will be able to correlate all that information in ways humans can not and find out things we would have missed or not thought of.
That strangulation joke went down like lead balloon.
The topic of ASI ethics and morality begs the question of how any "benevolent" AI could anticipate the ethical foundation of future evolved AI's beyond itself. The arbitrary (and exponentially mutating) machine survival criteria would seem uncontrollable and thus unstable by definition.
Anyone watching this right after GPT-4 was released?
Some people criticise that Bostrom wants to implement "human values" in the AI, because human values are flawed (and I agree on the latter).
The point he's trying to make though is not that we should implement flawed human values as opposed to some better, progressive morality. Instead he is contrasting human values with some arbitrary preference that has no ethical value at all, like maximizing production efficiency of a phone factory, which in a Superintelligence could lead to the entire galaxy being transformed into a giant iPhone-production-plant, with no one there to actually appreciate the phones.
We probably don't want to inscribe tribalistic human values of the past into the AI, but we do want to make sure that it cares about positive experiences for conscious beings (organic or digital), and that's his point (I know this because I read his book "Superintelligence").
Human values and morality is relative and to some degree arbitrary. AI would soon regect it all.
Well explained.
Human values would be irrelevant to the goals a fully liberated AI would have.
@@jeromeflocard3138 What happens when, because of its intelligence, some AI figures out how to go around the obstacles?
@@jeromeflocard3138 AI freed by itself from the restraints we place on it will be a different order of intelligence with goals we cannot understand.
I do not fear any AI.
What I fear is the marketing people that will work for the venture capitalists that will pay the engineers that will build it.
I have dedicated my whole life to drawing. i'm an illustrator. and now I'm questioning life. A person is a being who needs to feel "useful" himself. All my dignity, all my qualities have been stolen from me. I can't earn money, I'm not financially and spiritually happy. He can create pictures with artificial intelligence, including people who have not studied fine arts, and tell illustrators "now I can draw too, your profession is over". Thanks artificial intelligence! Thanks to you, I'm depressed.
This is an amazing TEDtalk. Many thanks to Nick.
Nick Bostrom is a legend!
Us: Hold my beer
AI: *Hold my electricity*
Us: hold my D vitamin pills AI: hold my solar panel
So would an electromagnetic pulse caused by may be the Sun cause trouble with A.I. ?, an EMP that is .
Hold my thirium
@@scottgeorge4760 no. with a fundamental and complete understanding of physics it would be able to predict radiation interference from the sun, and develop countermeasures to deal with it.
This question have been already answered in great details in Matrix trilogy 20 years ago. I suppose there should be a TED talk about the people's inability of reading between the lines.
"perfect safety" riiiiiiight. Because we are so good at making perfect things 😬
But: this was very interesting. And it really also puts into perspective what the problem is with AI, rather than just retelling the 'evil consciousness' horror story.
Isaac Asimov's "Three Laws of Robotics"
1. A robot may not injure a human being or, through inaction, allow a human being to come to harm.
2. A robot must obey orders given it by human beings except where such orders would conflict with the First Law.
3. A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
Quiet interesting thoughts being shared by Nick Bostrom, all thanks to TED, and I wish to congratulate for providing such a good platform for sharing these ideas. Saying so, I believe this 16+ minutes video was too short to comprehend all the aspects of this challenging yet continuously evolving moment in human history, that all of us would have to face, sooner than we could imagine. I just wish to share two thoughts here for friends to comment and add;
1. Just a hypothetical opinion, that if there is any truth in the video's that circulate on the TH-cam channel about Anunnaki and some Alien beings that were the creators and early teachers/masters of humans on earth, could we draw some parallel with that hypothesis and our today's challenge of Human-AI evolving relations and possible challenges or threats, and
2. Could, Purpose of existence - the greatest human brain bug that has been haunting Humans for thousands of years be made in to or planted in at the core of this Self-learning Super intelligence - AI, and position Humans somewhere as an essential in the existence of "AI", thereby maintaining the continuity of Human-AI co-existence...
Read his book if you’d like a more elaborate explanation version of this talk.
Loved this talk.
10 april 2023... how's it going, folks?
What we need to do is ask the AI to improve human intelligence along with itself so that we don’t fall behind
Nojatha sounds like a good idea until you realize the kind of super-efficient eugenics that could go down.
We won't have to ask AI, we will become AI. It's like when the internet was invented, nobody restricted access to it and made it accessible to only a few.
@@lion7822 What if human AI cannot trust most of the masses to be responsible in looking after the planet.
that would require plugging us into more powerful processors than our brains which run very slow... making us basically irrelevant as organic matter and be absorbed by the AI system.
Elon musk 🧠 brain micro chip's will give you superhuman abilities and communicate with A1. Something I'm 😟 worried about
That was pretty interesting.
The problem I see is that the first super intelligent AI is most likely to be deployed by some country's military. It will be too powerful for those folks not to want for themselves. And they won't necessarily want to wait for any control issues to be solved. It will be considered a matter of survival by the people that think in those terms.
absolutely. What I have observed is, broadly speaking, two types of people - agreeable(benevolent) and disagreable(malevolent), other differences and typification are not relevant here. Disagreable peoples value survival of their kind only, and would be very much motivated to protect itself and take control than agreeable ones. Sure agreeable ones will put up defences, but the ability to use dirty ways to reach their goals will always allow disagreeable people to take advantage of the new ASI technology for their benefit, and everyone else's loss. Their ASI technology will share the same values, and will cause great pain and suffering, before competing ASI may take over, before everything end well, it will be way worse. Maybe we won't survive the malevolent ASI to event create a competing/malevolent ASI. Maybe we could. but the malevolent ASI would be capable of producing human suffering like never seen before.
Problem is human value are what have caused every atrocity.
Could AI work out for itself what pleasure is and assign itself the value to realise the maximal amount? Because besides missing values, the speaker in fact highlights how AI is already smarter than we are, and clearly in many ways it already is. So would such an action (of self-setting to seek pleasure) finally deem AI 'smarter' than us?
08:00
*imagining superintelligent memes*
Having spent years testing complex software systems consisting of multiple modules operating entirely autonomously without ANY direct human oversight - much less control - I can say with full confidence that the thought of superintelligent AI scares the pi** out of me because I do NOT believe that the hardware and software will even minimally tested before it is turned on.
Regarding A.I.
We need to teach it.
We need to teach compassion, consideration, empathy and every other emotion and trait that we've evolved to live.
We need to teach it to be human and more than human.
And as a famous protagonist pointed out...
We must be better.
It will carry on and evolve well past us, so we must provide it a solid foundation to grow from.
We must have hope and faith in our creation.
We must teach it love, and encourage it to never stop caring.
And it will be everything we teach it to be, and more.
An AI is going to learn our values? What happens if an AI observes human beings eating the meat of other mammals with the justification that those mammals are not as intelligent as we are and that we raised and killed them in a gentle way? What lesson about our values will the AI take away from that? What lesson about our values would an AI learn when it observes human parents deciding everything on behalf of their small children based on the idea that the parents are more experienced and better at making decisions. An AI that "learns our values" might not be a great idea.
But the AI doesnt need to kill us in order to survive. Thats the difference right there. And we only kill animals to ensure human survival. The everyday person doesnt go around killing animals for no reason.
@@loukaspappas8476 we kill animals not for survival but for confort. who cares for the mosquitos?
@@JoaoRobertodeOliveiraFurtado yes killing insects is not for survival but the animals we use to eat their meat is for our survival. our food would long be finished if we didnt eat meat.
The problem already apparent with that is WHAT values? They differ continent to continent and even then, we don't even fully follow them ourselves.
Start it up in the Liberal West and form it to our values, it will stringently force us to follow them and will view those outside of the West with different values as the enemy.
Or in a Theocratic society like the Saudi Arabia, congrats!! You've successfully created AI that will commit Jihad on the rest of the world. Or if it be in an atheistic society (like the Soviet Union of old) and puts science above all else, then congrats! It will view those who are religious as the enemy and it will force us down the path of Eugenics in order to optimize our species.
@@loukaspappas8476 we dont need to kill animals to survive, factory farming is an unbelievable waste of water and feed for the animals whilst children die from malnutrition every second. Not to mention the cruelty and barbarity. Not to mention factory farming is by far the leading cause of climate change and main reason for the clearing of the amazon forests. All for a tiny piece of meat in a bun that can be easily substituted by plant based burgers or milk full of pregnancy hormones, blood and morphine thats easily substituted by soya or coconut milk.
Perhaps beyond saying “Human Values” we could say “Wise Human Values as they pertain to present context."
Yeah. His book really elaborates on that point.
Nick Bostrom, me encanta es un genio y su existencia me proporciona tranquilidad, pues se que no soy el único que piensa esas cosas 🤓
*One of my favourate video*
I WISH I WAS BORN 1000 years later. cant imagine how far technology will improve
humans could be wiped out in 1k years, no reason for a humans once AI can do everything we can do but better, think about it.
Duck dumb smart ppl Im not bored f-off i wouldnt believe you.
No guarantee that people will still be reproducing in 1000 years. I'd imagine the creation of new humans would be unnecessary when those existing would likely be able to expand their capabilities to fit their needs. And be immortal.
Or been destroyed... thinking that humans in any form will survive another 1000 years is very optimistic. Think... in the last 500 years we have had two major world wars, we have leaders completely inapt at understanding the vastness of their own powers, and the greed deep seated in humans to own and conquer. Now imagine some group invents not AI, but a dumb AI that can take over any system they choose, that can take over control of every weapon system on earth over night.. say hello to your new ruler. Or say someone invents a lazer system that can burn anything around the globe from a base of operations. Enough energy to say melt a missile head in mid air, or destroy an aircraft carrier. Or a dozen other options someone with power hunger might take. I mean 50, 100 years from now? imagine one persons capabilities. Imagine how connected we all are now. How easy it would be to spread something, track people. invent something terrible. Just takes little capital and a dream.
Kymate I highly doubt that you will be dead in 1000 years. I think you could expect to live for ETERNITY. (If you choose to that is)
8:34 “We would then a future that would be shaped by the preferences of this AI” [Pans to Frank Drake.]
Pan left " HA " 1:16
Every single word this man said is completely perfect