Outsmarting humans just one step for AI video game players

26 days ago Fremont Tribune

Speed around a French village in the video game Gran Turismo and you might spot a Corvette behind you trying to catch your slipstream.

The technique of using the draft of an opponent's racecar to speed up and overtake them is one favored by skilled players of PlayStation's realistic racing game.

But this Corvette driver is not being controlled by a human — it's GT Sophy, a powerful artificial intelligence agent built by PlayStation-maker Sony.

Gran Turismo players have been competing against computer-generated racecars since the franchise launched in the 1990s, but the new AI driver that was unleashed last week on Gran Turismo 7 is smarter and faster because it's been trained using the latest AI methods.

“Gran Turismo had a built-in AI existing from the beginning of the game, but it has a very narrow band of performance and it isn’t very good," said Michael Spranger, chief operating officer of Sony AI. “It’s very predictable. Once you get past a certain level, it doesn’t really entice you anymore.”

But now, he said, “this AI is going to put up a fight.”

Visit an artificial intelligence laboratory at universities and companies like Sony, Google, Meta, Microsoft and ChatGPT-maker OpenAI and it’s not unusual to find AI agents like Sophy racing cars, slinging angry birds at pigs, fighting epic interstellar battles or helping human gamers build new Minecraft worlds -- all part of the job description for computer systems trying to learn how to get smarter in games.

But in some instances, they are also trying to learn how to get smarter in the real world. In a January paper, a University of Cambridge researcher who built an AI agent to control Pokémon characters argued it could “inspire all sorts of applications that require team management under conditions of extreme uncertainty, including managing a team of doctors, robots or employees in an ever-changing environment, like a pandemic-stricken region or a war zone.”

And while that might sound like a kid making a case for playing three more hours of Pokémon Violet, the study of games has been used to advance AI research — and train computers to solve complex problems — since the mid-20th century.

Initially, AI was used on games like checkers and chess to test at winning strategy games. Now a new branch of research is more focused on performing open-ended tasks in complex worlds and interacting with humans, not just for the purpose of beating them.

“Reality is like a super-complicated game,” said Nicholas Sarantinos, who authored the Pokémon paper and recently turned down a doctoral offer at Oxford University to start an AI company aiming to help corporate workplaces set up more collaborative teams.

In the web-based Pokémon Showdown battle simulator, Sarantinos developed an algorithm to analyze a team of six Pokémon — predicting how they would perform based on all the possible battle scenarios ahead of them and their comparative strengths and weaknesses.

Microsoft, which owns the popular Minecraft game franchise as well as the Xbox game system, has tasked AI agents with a variety of activities — from steering clear of lava to chopping trees and making furnaces. Researchers hope some of their learnings could eventually play a role in real-world technology, such as how to get a home robot to take on certain chores without having to program it to do so.

While it ”goes without stating" that real humans behave quite differently from fictional video game creatures, “the core ideas can still be used,” Sarantinos said. “If you use psychology tests, you can take this information to conclude how well they can work together.”

Amy Hoover, an assistant professor of informatics at the New Jersey Institute of Technology who’s built algorithms for the digital card game Hearthstone, said “there really is a reason for studying games” but it is not always easy to explain.

“People aren’t always understanding that the point is about the optimization method rather than the game,” she said.

Games also offer a useful testbed for AI — including for some real-world applications in robotics or health care — that’s safer to try in a virtual world, said Vanessa Volz, a researcher and co-founder of the Danish startup Modl.ai, which builds AI systems for game development.

But, she adds, “it can get overhyped."

“It’s probably not going to be one big breakthrough and that everything is going to be shifted to the real world,” Volz said.

Japanese electronics giant Sony launched its own AI research division in 2020 with entertainment in mind, but it's nonetheless attracted broader academic attention. Its research paper introducing Sophy last year made it on the cover of the prestigious science journal Nature, which said it could potentially have effects on other applications such as drones and self-driving vehicles.

The technology behind Sophy is based on an algorithmic method known as reinforcement learning, which trains the system by rewarding it when it gets something right as it runs virtual races thousands of times.

“The reward is going to tell you that, ‘You’re making progress. This is good,’ or, ‘You’re off the track. Well, that’s not good,'" Spranger said.

PlayStation players will only get to try racing against Sophy until Wednesday, on a limited number of circuits, so it can get some feedback and go back into testing. Peter Wurman, director of Sony AI America and project lead on GT Sophy, said it takes about two weeks for AI agents to train on 20 PlayStations.

“To get it spread throughout the whole game, it takes some more breakthroughs and some more time before we’re ready for that,” he said.

And to get it onto real streets or Formula One tracks? That could take a lot longer.

Self-driving car companies adopt similar machine-learning techniques, but “they don’t hand over complete control of the car the way we are able to,” Wurman said. “In a simulated world, there’s nobody’s life at risk. You know exactly the kinds of things you’re going to see in the environment. There’s no people crossing the road or anything like that.”

Copyright 2023 The Associated Press. All rights reserved. This material may not be published, broadcast, rewritten or redistributed without permission.











* I understand and agree that registration on or use of this site constitutes agreement to its user agreement and privacy policy.
Continue reading...

Read On "Fremont Tribune"
More News On "Fremont Tribune"
25 days ago - Alameda County landlords owed thousands in rent, call for an end to eviction moratorium 25 days ago - Monday Feb. 27 COVID-19 update: 4 deaths in Douglas County 25 days ago - State basketball preview: 6A, 5A tournaments return to Weber State’s Dee Events Center this week 25 days ago - One Wealth Advisors LLC invests in Enovix Co. (NASDAQ:ENVX) 26 days ago - Uncommon length makes Pleasant Valley’s 2-3 a no-scoring zone 26 days ago - Study: Back-to-back hurricanes likely to come more often 26 days ago - What’s Happening Vegas? – March 2023 26 days ago - Osceola County community events calendar for 03/01/2023 26 days ago - North Adams, East Clinton, Unioto still alive 26 days ago - North Korea holds rare meeting on farming amid food shortage 26 days ago - 'Dilbert,' Scott Adams lose distributor over racist remarks 26 days ago - Soap or phone call? Colo. lawmakers want to make prison phone calls free 26 days ago - EXPLAINER: Windstorm was likely a derecho. What is that? 26 days ago - What's Happening in Las Vegas for this Year's March Madness 26 days ago - Outsmarting humans just one step for AI video game players 26 days ago - 'Cocaine Bear' gets high with $23.1M, 'Ant-Man' sinks fast 26 days ago - 'Everything Everywhere All at Once' dominates at SAG Awards 26 days ago - Digital Transformation: The Revolutionary Impact of Technology in Africa 26 days ago - ShotSpotter (NASDAQ:SSTI) Price Target Increased to $44.00 by Analysts at Lake Street Capital 26 days ago - Season 3 of Outer Banks disappoints critics; watch only if you were a die-hard fan of earlier seasons, they suggest 26 days ago - Board Game and Card Game Market Size in 2023 with [ STATISTICS FIGURES] Future Development Status and Forecast up to 2029 26 days ago - Tabletop Gaming Market Size in 2023 NEW TECHNOLOGICAL DEVELOPMENT and Latest Innovation in Analytics Sector till 2029 26 days ago - Celona Offers Most Comprehensive Private 5G Solutions for U.S. and Foreign Markets 26 days ago - ShotSpotter, Inc. (NASDAQ:SSTI) to Post Q1 2023 Earnings of ($0.03) Per Share, Northland Capmk Forecasts 26 days ago - Asian shares track Wall Street decline on hot economic data 27 days ago - Final Nebraska high school swimming and diving season leaders 27 days ago - Girls BB: Saluting Section Champions 27 days ago - Tens of thousands protest Mexico electoral reforms 27 days ago - Third finals appearance the charm for Hortonville's Skebba; Stoffel makes history for Appleton North 27 days ago - Medical Blades Market Business Opportunities, Top Players and Forecast 2030 27 days ago - Central College Dutch Sports Update – 2/26/2023 27 days ago - Buhro takes individual crown as Oak Harbor earns sectional championship 27 days ago - Nebraska conservatives set sights on education takeover – Associated Press 27 days ago - Back-to-back: Minico successfully defends 4A state wrestling championship 27 days ago - Here are Saturday's high school sports results 27 days ago - Farewell, Fontana: NASCAR's last weekend at a racing gem 27 days ago - Kansas Democrats pick Repass as their new chair despite campaign baggage 28 days ago - Tesla’s Global Engineering HQ in Palo Alto — Opening Party Highlights (Pics, Videos, Quotes) 28 days ago - San Ann'as Pizza and Mexican celebrating 45th anniversary 28 days ago - L.A. on the Record: The Senate takes one more look at Garcetti 28 days ago - Dodge County real estate transfers 28 days ago - How UNL instructors are tackling the emergence of ChatGPT and other AI in higher education 28 days ago - Some Democratic-led states seek to bolster voter protections 28 days ago - Casey Vaughan: Only rain should go down a storm drain 28 days ago - Nebraska conservatives set sights on education takeover 28 days ago - West Michigan Conference basketball: Girls and boys roundup from Feb. 24, 2023 – CatchMark Sports 28 days ago - Jeff Yost: Look Upstream 28 days ago - Brokers Set Expectations for ShotSpotter, Inc.'s Q4 2023 Earnings (NASDAQ:SSTI) 28 days ago - Building affordable homes in Fremont 28 days ago - Local chef to open farm-to-table eatery in Fremont 28 days ago - Jeanna Wilcoxen Murder: Where Is Jeremiah Connelly Now? 28 days ago - More than 70 soldiers killed in Burkina Faso, extremists say 28 days ago - Clyde Council to consider citizens raising chickens in town 28 days ago - Wilhelm: More on Jacksons, Willow Hill and efforts to share insight into African American history 28 days ago - STATE HIGH SCHOOL WRESTLING TOURNAMENTS: Crowded at the top ... Trojans third, but well within striking distance in 5A tournament 28 days ago - Bulldog wrestlers have solid day at state 28 days ago - High school boys basketball: 6A/5A second round recap 28 days ago - Head-To-Head Analysis: Amprius Technologies (NYSE:AMPX) & Novanta (NASDAQ:NOVT) 28 days ago - Here are Friday's high school sports results 28 days ago - It’s Official: California Will Be Tesla’s Engineering & AI Headquarters
free geoip