Crazy that you can beat a Mario level in, what was it, 8 or 9 neurons?
One thing I was hoping he'd touch on is how trained the neural net got to that one specific level, rather than being able to play Mario in general. If you were to take the winner of generation 34 and suddenly stick in a brand new level, how far would it get? How long would it take to train a neural net that was seeing a different level for each generation?
Crazy that you can beat a Mario level in, what was it, 8 or 9 neurons?
I would have found it a lot more impressive if it had learned how to complete the level with the most points or in the fastest time. It missed out on all the fun!
Yeah, I'd be interested in how many neurons it would need to beat a few different levels, or even to see how much of the game it could beat. Tempted to write something of my own to try and do that, or maybe modify their source.
SethBling is awesome, I'd love to have this running for like 10 years on a crazy powerful build with the emulator running as fast as the CPU can take it, to see just how smart it can get
Considering how smart it got after just a few hours of learning, you probably wouldn't even see a noticeable difference between a week of training and a year of training because a week of training would be so good. There was a similar research project that came out of Google DeepMind (I think) a few months that involved a similar idea, but with lots of different games for an old Atari console that I can't remember the name of. I downloaded it and left it running on one game for three hours and it became incredible at the game. I left it running some more for two whole days and it wasn't much better, mainly because there really wasn't any room for improvement after a few hours.
If the software in this video is as good as it looks, then there (probably) isn't much room for improvement after a week of training the model. That said, a year of training on a computer with a super fast processor would still be fun, just in the shits-and-giggles department.
Hadn't even considered that! You won't find any interesting bugs for a while. Leaving it running for a few months could show us some interesting stuff!
Now imagine pointing this kind of AI at regular software and trying to find security vulnerabilities! The more I read about it, the more I realize that neural networking and machine learning really could be the future!
That's actually quite a neat idea... I did not think about that, but what if the AI goes rogue and starts defacing public websites or hacking the NSA or some stuff!? It would have to be physically isolated (like, can't even be in a VM, has to be on a dedicated, isolated from every network, machine) to keep it contained
Yeah, in case it finds a security vulnerability in the VM managing software (like Virtualbox or something that) and ends up going too far. It'd really need a real no-Internet-connection-at-all air gap between the Internet and the computer. But in general, it'd be interesting if Microsoft could just put a Windows box on a network and have another machine on the same network just keep trying to get in with whatever it can think of. If there's even a single security vulnerability, then it'll eventually find it, and the engineers can then figure out what happened patch it up. Given enough time, they could (hypothetically) weed out every security vulnerability.
This kind of thing could get really exciting! The only thing that's ever held machine learning and neural networking back from the rest of computer science is that we didn't have hardware that was powerful enough for it. Now our computers are starting to get powerful enough for it! Things are going to start getting very exciting in the next few years, mark my words!
And think about the malicious applications, imagine AI getting so optimised that someone could a Raspberry Pi with a pentesting AI and just plugged it into a corporate network and watch it wreck havoc!
It would probably take a major deviation in order to find a glitch like that. It would most likely continue to refine itself instead of looking for new methods, unless it was specifically programmed to.
I would love to do something similar but instead of playing Mario he plays the game of life. To see how a machine can manipulate a humans senses and conscious to being as Rich as possible or to complete a life objective. Ex machina in REAL LIFE!
18 comments
4 u/Oeoeoeoeoeoeoe 14 Jun 2015 21:17
This same program is currently learning a new level on stream, Donut Plains 4. http://www.twitch.tv/sethbling
3 u/mofoburrell 14 Jun 2015 16:03
Crazy that you can beat a Mario level in, what was it, 8 or 9 neurons?
One thing I was hoping he'd touch on is how trained the neural net got to that one specific level, rather than being able to play Mario in general. If you were to take the winner of generation 34 and suddenly stick in a brand new level, how far would it get? How long would it take to train a neural net that was seeing a different level for each generation?
0 u/fluffingtonthefifth 14 Jun 2015 20:42
I would have found it a lot more impressive if it had learned how to complete the level with the most points or in the fastest time. It missed out on all the fun!
0 u/DansGame 17 Jun 2015 03:36
Yeah, I'd be interested in how many neurons it would need to beat a few different levels, or even to see how much of the game it could beat. Tempted to write something of my own to try and do that, or maybe modify their source.
2 u/faissaloo 14 Jun 2015 13:21
SethBling is awesome, I'd love to have this running for like 10 years on a crazy powerful build with the emulator running as fast as the CPU can take it, to see just how smart it can get
2 u/aurora 14 Jun 2015 13:52
Considering how smart it got after just a few hours of learning, you probably wouldn't even see a noticeable difference between a week of training and a year of training because a week of training would be so good. There was a similar research project that came out of Google DeepMind (I think) a few months that involved a similar idea, but with lots of different games for an old Atari console that I can't remember the name of. I downloaded it and left it running on one game for three hours and it became incredible at the game. I left it running some more for two whole days and it wasn't much better, mainly because there really wasn't any room for improvement after a few hours.
If the software in this video is as good as it looks, then there (probably) isn't much room for improvement after a week of training the model. That said, a year of training on a computer with a super fast processor would still be fun, just in the shits-and-giggles department.
1 u/faissaloo 14 Jun 2015 13:54
Yeah, but it might even discover bugs like the credits warp if given enough time which could be quite interesting
0 u/aurora 14 Jun 2015 14:00
Hadn't even considered that! You won't find any interesting bugs for a while. Leaving it running for a few months could show us some interesting stuff!
Now imagine pointing this kind of AI at regular software and trying to find security vulnerabilities! The more I read about it, the more I realize that neural networking and machine learning really could be the future!
0 u/faissaloo 14 Jun 2015 14:04
That's actually quite a neat idea... I did not think about that, but what if the AI goes rogue and starts defacing public websites or hacking the NSA or some stuff!? It would have to be physically isolated (like, can't even be in a VM, has to be on a dedicated, isolated from every network, machine) to keep it contained
1 u/aurora 14 Jun 2015 14:10
Yeah, in case it finds a security vulnerability in the VM managing software (like Virtualbox or something that) and ends up going too far. It'd really need a real no-Internet-connection-at-all air gap between the Internet and the computer. But in general, it'd be interesting if Microsoft could just put a Windows box on a network and have another machine on the same network just keep trying to get in with whatever it can think of. If there's even a single security vulnerability, then it'll eventually find it, and the engineers can then figure out what happened patch it up. Given enough time, they could (hypothetically) weed out every security vulnerability.
This kind of thing could get really exciting! The only thing that's ever held machine learning and neural networking back from the rest of computer science is that we didn't have hardware that was powerful enough for it. Now our computers are starting to get powerful enough for it! Things are going to start getting very exciting in the next few years, mark my words!
1 u/faissaloo 14 Jun 2015 14:38
And think about the malicious applications, imagine AI getting so optimised that someone could a Raspberry Pi with a pentesting AI and just plugged it into a corporate network and watch it wreck havoc!
1 u/aurora 14 Jun 2015 21:12
Oh, I can see this going crazy in all kinds of ways. It's going to be a scary future, but it's going to be fun!
0 u/Uni 15 Jun 2015 00:29
It would probably take a major deviation in order to find a glitch like that. It would most likely continue to refine itself instead of looking for new methods, unless it was specifically programmed to.
1 u/ragnamoo 14 Jun 2015 14:38
I would love to do something similar but instead of playing Mario he plays the game of life. To see how a machine can manipulate a humans senses and conscious to being as Rich as possible or to complete a life objective. Ex machina in REAL LIFE!
1 u/yotamN [OP] 14 Jun 2015 14:41
Damn Ex Machina was scary, we our not far from there
0 u/Herbert_Von_Karajan 16 Jun 2015 17:10
It would be cool if this was adapted to play fighting games. The singularity wont happen until AI can beat Isai in smash 64