His group decided to find out. They built the new, diversified version of AlphaZero, which includes multiple AI systems that trained independently and on a variety of situations. The algorithm that governs the overall system acts as a kind of virtual matchmaker, Zahavy said: one designed to identify which agent has the best chance of succeeding when its time to make a move. He and his colleagues also coded in a diversity bonusa reward for the system whenever it pulled strategies from a large selection of choices.
When the new system was set loose to play its own games, the team observed a lot of variety. The diversified AI player experimented with new, effective openings and novelbut sounddecisions about specific strategies, such as when and where to castle. In most matches, it defeated the original AlphaZero. The team also found that the diversified version could solve twice as many challenge puzzles as the original and could solve more than half of the total catalog of Penrose puzzles.
The idea is that instead of finding one solution, or one single policy, that would beat any player, here [it uses] the idea of creative diversity, Cully said.
With access to more and different played games, Zahavy said, the diversified AlphaZero had more options for sticky situations when they arose. If you can control the kind of games that it sees, you basically control how it will generalize, he said. Those weird intrinsic rewards (and their associated moves) could become strengths for diverse behaviors. Then the system could learn to assess and value the disparate approaches and see when they were most successful. We found that this group of agents can actually come to an agreement on these positions.
And, crucially, the implications extend beyond chess.
Real-Life Creativity
Cully said a diversified approach can help any AI system, not just those based on reinforcement learning. He has long used diversity to train physical systems, including a six-legged robot that was allowed to explore various kinds of movement, before he intentionally injured it, allowing it to continue moving using some of the techniques it had developed before. We were just trying to find solutions that were different from all previous solutions we have found so far. Recently, he has also been collaborating with researchers to use diversity to identify promising new drug candidates and develop effective stock-trading strategies.
The goal is to generate a large collection of potentially thousands of different solutions, where every solution is very different from the next, Cully said. Sojust as the diversified chess player learned to dofor every type of problem, the overall system could choose the best possible solution. Zahavys AI system, he said, clearly shows how searching for diverse strategies helps to think outside the box and find solutions.
Zahavy suspects that in order for AI systems to think creatively, researchers simply have to get them to consider more options. That hypothesis suggests a curious connection between humans and machines: Maybe intelligence is just a matter of computational power. For an AI system, maybe creativity boils down to the ability to consider and select from a large enough buffet of options. As the system gains rewards for selecting a variety of optimal strategies, this kind of creative problem-solving gets reinforced and strengthened. Ultimately, in theory, it could emulate any kind of problem-solving strategy recognized as a creative one in humans. Creativity would become a computational problem.
Liemhetcharat noted that a diversified AI system is unlikely to completely resolve the broader generalization problem in machine learning. But its a step in the right direction. Its mitigating one of the shortcomings, she said.
More practically, Zahavys results resonate with recent efforts that show how cooperation can lead to better performance on hard tasks among humans. Most of the hits on the Billboard 100 list were written by teams of songwriters, for example, not individuals. And theres still room for improvement. The diverse approach is currently computationally expensive, since it must consider so many more possibilities than a typical system. Zahavy is also not convinced that even the diversified AlphaZero captures the entire spectrum of possibilities.
I still [think] there is room to find different solutions, he said. Its not clear to me that given all the data in the world, there is [only] one answer to every question.
Original story reprinted with permission from Quanta Magazine, an editorially independent publication of the Simons Foundation whose mission is to enhance public understanding of science by covering research developments and trends in mathematics and the physical and life sciences.
Read the original post:
Google's Chess Experiments Reveal How to Boost the Power of AI - WIRED
- What We Learned From Big Tech's Earnings Reports - Investopedia [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Google Maps: It's getting a new generative AI feature - Mashable [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Amazon made an AI bot to talk you through buying more stuff on Amazon - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI creates what Europeans think Americans from every state look like and it may hurt your feelings - UNILAD [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Samsung's Galaxy S24 Ultra Could Be Doing So Much More With AI - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Fact Sheet: Biden-Harris Administration Announces Key AI Actions Following President Bidens Landmark Executive ... - The White House [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Google Maps is getting supercharged with generative AI - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI chatbots tend to choose violence and nuclear strikes in wargames - New Scientist [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Police Turn to AI to Review Bodycam Footage - ProPublica [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Apple Just Teased Its AI Plans. You Really Should Take Notice - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- In the AI science boom, beware: your results are only as good as your data - Nature.com [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Tim Cook confirms Apple's generative AI features are coming later this year - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- I Tried Google Bard's New AI Image Generator. Here's How It Turned Out - CNET [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- 'Year of AI' Faculty Recruitment Initiative Aims to Bring More World-Class Professors to UT - The University of Texas at Austin [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI Learns Through the Eyes and Ears of a Child - New York University [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Amazon Introduces Rufus, an AI Shopping Tool, and Reports Earnings - The New York Times [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- I Tested a Next-Gen AI Assistant. It Will Blow You Away - WIRED [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI afterlife, robot romance, and slow-burn slashers: the best of Sundance 2024 - The Verge [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Is Jumping on the AI Bandwagon Prudent? - Catholic Exchange [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- This AI learnt language by seeing the world through a baby's eyes - Nature.com [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Arc Search's AI responses launched as an unfettered experience with no guardrails - Mashable [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Generative AI is hot, but predictive AI remains the workhorse - CIO [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- Nvidia Stock Just Got Amazing Artificial Intelligence (AI) News From These Trillion-Dollar Tech Giants - The Motley Fool [Last Updated On: February 4th, 2024] [Originally Added On: February 4th, 2024]
- AI Briefing: How Priceline and other e-commerce companies are approaching generative AI - Digiday [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- OpenAI Unveils A.I. That Instantly Generates Eye-Popping Videos - The New York Times [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Technology industry to combat deceptive use of AI in 2024 elections - Stories - Microsoft [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Meeting the moment: combating AI deepfakes in elections through today's new tech accord - Microsoft On the Issues - Microsoft [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- These Are the Jobs That AI Is Actually Replacing in 2024 - Tech.co [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- AI company developing software to detect hypersonic missiles from space - SpaceNews [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- How are AI Systems Assisting Architects and Designers? - ArchDaily [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Artificial intelligence is making critical health care decisions. The sheriff is MIA - POLITICO [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Why the only way to ride the company AI wave is experimentation - Big Think [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- What Are the Best AI Stocks in February 2024? Our Top 3 Picks - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Media Buying Briefing: Agencies' AI efforts lead to aliens and Whoppers - Digiday [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- C3.ai Stock Warning: Don't Get Carried Away With AI Euphoria! - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- The State of A.I., and Will Perplexity Beat Google or Destroy the Web? - The New York Times [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Donald Trump's father resurrected by AI to tell him he's 'a disgrace' - Euronews [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Google Cloud CEO On Huge Investments, AI And Challenges In 2024 - CRN [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Another Big Question About AI: Its Carbon Footprint Mother Jones - Mother Jones [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Reddit sells training data to unnamed AI company ahead of IPO - Ars Technica [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- ChatGPT Stock Predictions: 3 Artificial Intelligence Companies the AI Bot Thinks Have 10X Potential - InvestorPlace [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Chinese entrepreneurs express awe and fear of OpenAIs Sora video tool - South China Morning Post [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- Google's AI Boss Says Scale Only Gets You So Far - WIRED [Last Updated On: February 20th, 2024] [Originally Added On: February 20th, 2024]
- World's largest computer chip WSE-3 will power massive AI supercomputer 8 times faster than the current record-holder - Livescience.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Is generative AI truly making disinformation worse? - Euronews [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Your Kid May Already Be Watching AI-Generated Videos on YouTube - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Free Legal Research Startup descrybe.ai Now Has AI Summaries of All State Supreme and Appellate Opinions - LawSites [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Google's new AI will play video games with you but not to win - The Verge [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Regulators Need AI Expertise. They Can't Afford It - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- CBP wants to use AI to scan for fentanyl at the border - The Verge [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Rely on the Spirit when using AI, Elder Gong encourages - Church News [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Video Game Made Purely With AI Failed Because Tech Was 'Unable to Replace Talent' - IGN [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Among the A.I. Doomsayers - The New Yorker [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Self-docking spacecraft could be built with AI system similar to ChatGPT - Space.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- AI books are crowding the marketplace on Amazon - NPR [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Hackers can read private AI-assistant chats even though they're encrypted - Ars Technica [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- EU Presses Big Tech Companies on AI Threats - PYMNTS.com [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- AI fear and excitement are lucrative mix for online training industry - Marketplace [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Craig Martell, the Pentagon's first-ever Chief Digital and AI Officer, to depart in April - DefenseScoop [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Startup Interloom raises $3 million seed round to take on UiPath and RPA market - Fortune [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Forget Chatbots. AI Agents Are the Future - WIRED [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- SXSW audience boos AI sizzle reel - Quartz [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Look beyond Nvidia to ride the AI wave there are other potential winners, Fidelity says - CNBC [Last Updated On: March 15th, 2024] [Originally Added On: March 15th, 2024]
- Sony Pictures Will Cut Film Costs 'Using AI, Primarily' - IndieWire [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Anthropic's AI now lets you create bots to work for you - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- VCs are selling shares of hot AI companies like Anthropic and xAI to small investors in a wild SPV market - TechCrunch [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Google Eats Rocks, a Win for A.I. Interpretability and Safety Vibe Check - The New York Times [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Lenovo and Cisco Announce Strategic Partnership to Simplify Path to AI Innovation - Cisco Newsroom [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- This Week in AI: Can we (and could we ever) trust OpenAI? - TechCrunch [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Microsoft AI screenshots everything you do on your computer and privacy experts are concerned - New York Post [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Tribeca to Screen AI-Generated Short Films Created by OpenAI's Sora - IndieWire [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Report: Apple and OpenAI have signed a deal to partner on AI - Ars Technica [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- An image calling for 'All Eyes on Rafah' is going viral. But it seems AI-generated. - The Washington Post [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Viral 'All Eyes on Rafah' Post Prompts More AI Images - TIME [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Research vs. development: Where is the moat in AI? - VentureBeat [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- All the Apple AI features we're expecting to be announced in iOS 18 - 9to5Mac [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Prediction: This "Magnificent Seven" Artificial Intelligence (AI) Stock Could Be a Better Investment Than Nvidia Over the ... - The Motley... [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Meta's AI is summarizing some bizarre Facebook comment sections - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- ElevenLabs' AI generator makes explosions or other sound effects with just a prompt - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]
- Google defends AI search results after they told us to put glue on pizza - The Verge [Last Updated On: June 2nd, 2024] [Originally Added On: June 2nd, 2024]