How AI Pacman players will change the world
If you haven't seen the classic documentary King of Kong, do yourself a favour and watch it. It delves into the bizarre and hilarious world of professional arcade gamers. It shows the immense level of dedication and obsession involved in mastering an old arcade game. It's impressive then that the AI of today is able to easily beat the best in the world at many of these arcade games.
Recently there have been quite a few headlines about AI computers beating world champions at various games like chess, DoTA and GO, but it's hard to see how this has any real significance. What does this mean for the world today?
The answer is: quite a lot.
Think about it. If an AI that knows nothing about a game can, in a matter of hours, learn how to play it as well as a human that has practiced for many years, then by taking real world tasks and framing them like a 'game', the same AI can learn to do these tasks at a superhuman level.
Take the example of pacman, a favourite in the fish and chip shops of the 80's. There are many real world problems that can be framed like pacman. First lets consider the key elements of the task:
- The goal is to get a top score by moving pacman around the screen
- Pacman must collect various items in the most efficient way possible while avoiding ghosts
- At times the rules change and pacman can also eat ghosts for more points
The best players learn advanced strategies and routes that maximise their score. AI's have been observed to emulate these strategies.
Consider a second 'game': GarbageMan. The rules are simple:
- The aim is to achieve the best score by moving GarbageMan around and collecting garbage from bins.
- The longer a bin is full, the lower the score when it is collected.
- When the truck is full, it must return to the tip to be emptied.
Sounds like fun right?
Imagine if you had someone with the dedication of a pro arcade gamer spend hours every day playing GarbageMan. He would learn every route, the rates at which bins become full and strategise about when to empty his truck.
In case you hadn't realised, GarbageMan is not a real game. It's an optimisation problem faced by many cities around the world. The fact that it can be framed like a game is what's so exciting, because the same AI player that mastered pacman in minutes can also master GarbageMan.
That's one example, here's a few more 'games':
- AmbulanceConrolCentreMan
- ParkingInspectorMan
- SupplyChainPlannerMan
You get the idea...
The field of teaching AIs to play 'games' is called reinforcement learning. It's one of the most exciting areas of applied AI and one of our main focuses here at Piccard.
If you're interested in finding out how AI can achieve outstanding results in your industry, please get in touch.
Writer and environmental engineer, recycling, regeneration to heal landscapes and people, forming community
5yAI is going to be hugely important in waste. The internally optimised game fed by sensor data and a series of simple rules will achieve vast complexity, and vastly optimise over current arrangements which, because they are pretty too complex to optimise by a human, are stripped by to set runs with people fitting the run. Once you have AI optimisation based on fill rate, then you level up with further sensors to detect and predict bin composition (thinking especially of waste from businesses rather than households). This can be done using photos that an AI looks at and "guesses" the composition of the bin, something that is already done in Materials Recovery Facilities by Re.Group. The AI both warns people contaminating the bin and checks when the bin is ready for collection by a particular vehicle type (organics, metals, paper etc). You shrink the size of the collection vehicles to progressively smaller and smaller vehicles, eventually autonomous, and you effectively have AI informed smart swarming waste collection that optimises for collection efficiency, recovery. The analogy is bees, sipping at waste bins around the collection area. All of which evolves out of GarbageMan and a bit of boldness.
Systemic Designer | Comedian | Teacher
5yLove the write-ups Tim, keep 'em coming. Tagging GarbageMan Adam Johnson
Strategic Design & Innovation | Integrated Water, Transport & Energy
5yTim, you have got me thinking about sports. What's the role for coaches when AI can access historical performance data, track real-time ball and player movements and prompt game-changing decisions based on predictive analytics? Could we see a shift towards AI determining game tactics while coaches focus on leading the team? For example, how does AI go at inspiring effort?