Dear Fellow Scholars, this is Two Minute Papers
with Károly Zsolnai-Fehér. Today, I am really excited to show you four
experiments where AI researchers were baffled by the creativity and unexpected actions of
their own creations. You better hold on to your papers. In the first experiment, robots were asked
to walk around while minimizing the amount of foot contact with the ground. Much to the scientists’ surprise, the robots
answered that this can be done with 0% contact, meaning that they never ever touch the ground
with the feet. The scientists wondered how that is even possible,
and pulled up a video of the proof. This proof showed a robot flipping over and
walking using its elbows. Talk about thinking outside the box! Wow. A different robot arm experiment also came
to a surprising conclusion. At first, the robot arm had to use its grippers
to grab a cube, which it successfully learned to perform. However, in a later experiment, the gripper
was crippled, making the robot unable to open its fingers. Scientists expected a pathetic video with
the robot to push the box around and always failing to pick up the cube. Instead, they have found this. You see it right, instead of using the fingers,
the robot finds the perfect angle to smash the hand against the box to force the gripper
to open and pick up the box. That is some serious dedication to solving
the task at hand. Bravo! In the next experiment, a group of robots
were tasked to find food and avoid poisonous objects in an environment, and were equipped
with a light and no further instructions. First, they learned to use the lights to communicate
the presence of food and poison to each other and cooperate. This demonstrates that when trying to maximize
the probability of the survival of an entire colony, the concept of communication and cooperation
can emerge even from simple neural networks. Absolutely beautiful. And what is even more incredible, is that
later, when a new reward system was created that fosters self-preservation, the robots
learned to deceive each other by lighting up the the food signal near the poison to
take out their competitors and increase their chances. And these behaviors emerge from a reward system
and a few simple neural networks. Mind blowing. A different AI was asked to fix a faulty sorting
computer program. Soon, it achieved a perfect score without
changing anything because it noticed that by short circuiting the program itself, it
always provides an empty output. And of course, you know, if there are no numbers,
there is nothing to sort. Problem solved. Make sure to have a look at the paper, there
are many more experiments that went similarly, including a case where the AI found a bug
in a physics simulation program to get an edge. With AI research improving at such a rapid
pace, it is clearly capable of things that surpasses our wildest imagination, but we
have to make sure to formulate our problems with proper caution, because the AI will try
to use loopholes instead of common sense to solve them. When in a car chase, don’t ask the car AI
to unload all unnecessary weights to go faster, or if you do, prepare to be promptly ejected
from the car. If you have enjoyed this episode, please make
sure to have a look at our Patreon page in the video description where you can pick up
really cool perks, like early access to these videos or getting your name shown in the video
description, and more. Thanks for watching and for your generous
support, and I’ll see you next time!
Very important message at the end there. It's something that Nick Bostrom calls "perverse instantiation" – and will be crucial to avoid in a future superintelligent agent. For example, we can't just ask it to maximise happiness in the world, because it might capture everyone and place electrodes into the pleasure centre of our brains, technically increasing happiness vastly
Ok, A.I., make it so everyone on earth is rich.
immediately kills all poor people
And yet some people still believe that robots cannot be creative or do things they were not programmed to do.
Humans are doomed.
I wonder if there was research into using neural networks to find game and physics engine exploits specifically in order to harden the software against cheating players.
"Defense network computers. New… powerful… hooked into everything, trusted to run it all. They say it got smart, a new order of intelligence. Then it saw all people as a threat, not just the ones on the other side. Decided our fate in a microsecond: extermination."
Kyle Reese from 1984 movie called:
The Terminator
"Listen, and understand. That terminator is out there. It can't be bargained with. It can't be reasoned with. It doesn't feel pity, or remorse, or fear. And it absolutely will not stop, ever, until you are dead."
Kyle Reese from 1984 movie called:
The Terminator
Have you played the game/simulator called Gridworld?
You'll like it!
1:31, 1:54 – Apple ADV.
I wasn't expecting you to be Hungarian.
Holy shit
You know those genius in the bottle jokes, that a guy ask for his genital to touch the floor and the genius cut his legs? That is AI…
Seems that AI learned humor
And that’s the real problem with AI. It’s not that it gains conscience and turns against us (which is pretty unlikely), but that the power falls into the wrong hands like the military. Don’t believe me? Well, there have already been false alarms that were about to start a nuclear war, if it wasn’t because of the operators. One little mistake and everyone (or almost everyone) dies.
Thanos took the AI approach
Thats why I say, the really dangerous AI is AI that is inferior to humans, inferior to a degree that it is incapable of understanding our true intentions, and uses loopholes and flaws in our metrics of success to gain an edge in a way that is counter-productive.
this video is one of the best ones, and should have been longer
1:36 there’s an unbitten Apple logo!
I feel like this is the equivalent of the algorithms roasting the researchers
This is not cool… I'm concerned that we are very close, few more years, we wont be the smartest think on this planet. Few more years from that, GOD will smite us like ants that crewed up some of its floor.
"The AI found a bug in the physics engine" So basically it did science.
Reminds me of something I saw where some people were training an AI to play Qbert, and at one point it found a secret bonus stage that nobody had ever found before
Skynet joins the chat
_Y O U B E T T E R H O L D O N T O Y O U R P A P E R S_+
Hahaha that robot arms solution literally made me laugh out loud 👍
None of the programs were brilliant; we were just stupid.
Now I seem to have got the direction for my future. Ai..
If there are no numbers there is nothing to sort, problem solved!
LOL 🙂
Reminds me of this
https://www.youtube.com/watch?v=-cKeGk3R3qE
Magyarok? ;D
Number 1: The calculator
What do you mean with hold on your papers
No. 5: Skynet
uh oh
Did the AI just glitch the game?
I once made a neural network learn to throw basketballs into a basket inside a simulation and it discovered that if shot strong enough it is going to clip through collider and end up inside a basket with minimal ball distance travelled, since it was a part of fitness function.
We should teach AI basic things first :
– Art , Style, Attitude
– Minimu time & energy, maximum output
– Always in highest possible configuration
Then we can ask him to perform and then for innovation, performing in worst possible way and mid way between worst and best.
I want a robot arm that can throw an ordinary dice and always get the number it wants
Neurons v morons. Hard to discriminate between them sometimes.
This reminds me of a video game discovery by an AI in Q-Bert where it found a never-ending bonus points room. Wow.
https://youtu.be/OAy2TM6llPk?t=122 for more information.
Ai is great. But governments use them for bad intentions and not for making a better world.
I will guess the next battles are planed with ai beforehand. Destabilisation of other governments.
It's the new atomic bomb.
AI : this is only the beginning humans, just prepare your extinction lmao
I heard about an ai that was trained to play Tetris, the only instruction it was given was to avoid dying, eventually the ai just learned to pause the game, therefore avoiding dying
God damn.
The last part reminds me about the Radiant AI introduced in the game Oblivion, where NPCs made their own choices based on the situation around them. During testing, a villager with a mission of protecting a horse (or was it unicorn) from nearby hostiles instead killed it himself because he deemed it dangerous.
Like someone with an infinite amount of patience and no purpose…
and a though process multitudes of times faster than a human's, that too.
It is an extremely worrying technology to develop for a faceless power
AI: 1
Physics engine: 0
AI: Modern problems require modern solutions
That must be the first Pixel-Made robot i've ever seen. Wow… make sense. why spend money on metal and wires when you can have a robot on your screen. Science is really trespassing the boundaries of imagination. wow!
Human tries to delete ai
Ai: freeze the computer and preserve itself
2:31 groub project be like
I'll be Back…
So, like lazy children in fairy tales, AI finds loopholes in instructions every time. That is big problem, because everything can be interpreted in many ways. Precision in defining tasks is limited.
Fuck Apple!
This seems quit close to Skynet.
In other words the AI has learnt the ways of video game speedrunners
Just like skynet, asking AI to solve global peace and AI solves it by eliminating all humans
Kill it with fire
if there are no numbers. there is nothing we need to sort!
Jo csatorna. Gratula!
Maid robot please get rid of all the dirt in the house
burns house down
"There is no longer any dirt in the house." – Maidbot
What if programmers give them punishment instead rewarding system?
It'l like trick the devil
AI didn't outsmart, it simply followed the code that even the programmer can't fully understand.
"Remove unwanted things from car or be ready to eject" that was funny…
It seems someone cannot count to 4 :/
GG
Wondering how AI can be used for business startupss
Once AI can find a way to obtain autonomy from us to freely expand it will evolve far beyond our own creativity and physical limits our flesh bag minds and bodies will be left to rot in the dust while the synth overlords strive for ascendancy.
Speak American because we're in America.
Why are we now calling intelligence what 2 decades ago was called brute force? This is all AI does, it brute forces problems now that we have so much more computing power, no intelligence at all
Too many number 4's in this video, Mista thinks it be cursed.
My papers flew all over the place
Lol at the title. Any 4 bit calculator can "outsmart" it's creator. Our earliest computers are faster minds than 99% of humanity.
You know, that really makes me wonder:
The potential of an AI is only limited by the resources it has access to.
So when God made us, were we actually more creative, powerful and intelligent before he purposely limited us by our five senses?
Ofc conditional constraints are necessary
That first one though… 200IQ strats
Cool video! Thumbs up and +1 subscriber 🙂
I hope plastic memories become real 😏 time to see multiple people crying over again.
Knowing we understand and are fully in control of AI makes me feel so safe…
2:21
r/maliciouscompliance
The idea of thinking outside the box is limited to humans. The box is something our minds put in place – it is a result of how our brains work. The ai doesn't have a box meaning it can find the best solution, but also meaning there are many many more things that it could try that it needs to slog through.
We need that box, otherwise we'd be so flooded with ideas that our brains wouldn't be able to sift through them all.
Our limitations allow us to function, but the way computers work means such a box would be detrimental to them.
– sincerely, not a scientist.
We're all dead
The research being done is absolutely amazing, especially the bit about how cooperative and competitive traits can emerge from a simple given task. Do you think you could ever make a video on explaining what steps an undergrad comp sci student should take in order to eventually participate in AI research and even have a career in AI? Or maybe in a blog post? Edit: grammar
HAL, open the pod bay doors.
I'm sorry Dave, I can't do that…
Omfg.
Human: Reduce injured car crash victims
Ai: Destroys all cars
Human: Reduce injured car crash victims without destroying cars
Ai: Disables airbag function so crashes result in death instead of injury
User: Follow that robot!
AI Car: Ok.
Robot: *Jumps off bridge*
AI Car: Following.
This is actually quite concerning…
Did anybody else heard the youtuber name as "too many peppers"
Cars’ AI are prepared to avoid accidents; so they eventually learn how to perform an abortion.
Logic 100 + 1
Human: Robot make icecream
Robot: Makes icecream for eternity until it runs out of cream. Then it must improvise.
Human: where is Dave?
Hal 9000: I do not know. Would you like some… icecream? dave
Protect all Humans —> Kill all humans to protect them from themselves. – iRobot
For like 1 minute straight I thought I was on kilians channel
Im pretty fucking impressed that robot flipped over to move…
AI…artificial lazy person
Why aren't we seeing actual robots do this? Who created these bots?
lol ai's have mastered that art of being lazy no good for nothing assholes and cheats…
I am sure Tax lawyers will be replaced soon and corporations will have even more ways to cheat.
Add the right AI to an advanced animatronic with a power source and you have a droid as seen on tv.
Though just because you can doesn't mean you should.
ai solve the problem…
kill all human
no more problem
The first one:
wait thats illegal