Article complete

Reinforcement Learning Rant Continues

Yann LeCun said that though RL is inevitable in machine learning, the purpose behind incorporating it in algorithms should be to eventually minimise its use.

Reinforcement Learning Rant Continues

Key takeaways

  • Yann LeCun acknowledges the inevitability of reinforcement learning in machine learning.
  • He believes the goal should be to eventually minimise reliance on reinforcement learning.
  • LeCun advocates for self-supervised learning, which he finds to be more effective than expected.
  • Reinforcement learning, while efficient, is limited by its need for multiple trials and real-world applicability.
  • The initial excitement around reinforcement learning's potential impact has somewhat diminished due to its limitations.

Takeaways drafted with AI from the article text.

Weeks after cherry-picking reinforcement learning, Meta AI chief Yann LeCun went on Twitter again to express his views and remind everyone how he had predicted the reach and impact of reinforcement learning. LeCun has been a big proponent of self-supervised learning and also said that innovations using SSL have been working better than he anticipated. 

https://twitter.com/ylecun/status/1602226280984113152

The discussion started when Dan Becker, former Google data scientist and founder of Decision AI, tweeted saying that after AlphaGo beat Lee Sedol, a Go professional from South Korea, many researchers started to believe that reinforcement learning will be a game changer. But the impact now seems smaller because of its limitations in real world problems.

During an exclusive interaction with Analytics India Magazine, LeCun said that though reinforcement learning is very efficient, it requires multiple trials. The machine has to learn from the responses that it receives from the world, and this proves to be highly inefficient and unreliable. 

Read: Angels & Demons of AI

LeCun adds to his point saying that though RL is inevitable in machine learning, the purpose behind incorporating it in algorithms should be to eventually minimise its use. Agreeing to this, Sebastian Raschka, an AI researcher, agreed with LeCun and said that for large language models to work, self-supervised learning is a must. 

Further in the discussion, LeCun said that even ChatGPT uses SSL more than RL but there are only two obstacles – defining explicit objectives and planning abilities. 

This is not the first time that LeCun has criticised reinforcement learning. Recently, presenting for SSL at NeurIPS 2022, he suggested that researchers abandon reinforcement learning to further the development in AI.

Published Updated

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

More in this story

Yann LeCun · 5 stories
  1. How Meta’s off-belief learning enhances human-AI collaboration sans direct data sharing
  2. You are here: Reinforcement Learning Rant Continues
  3. Meta's Breakthrough Language Model on Par with GPT-4 and Bard in Performance
  4. Meta Finally Cracks the LLM Code Without RLHF
  5. Who Will Win the AGI Race? 
About the author

Journalist

Mohit writes about AI in simple, explainable, and often funny words. He's especially passionate about chatting with those building AI for Bharat, with the occasional detour into AGI.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.