Skip to content
AIMAIM
NewsFeaturesGCCStartupsEnterprise AIDeep TechLists
LatestEvery storyLiveLive blogsMagazineMonthly print editionResearchReportsAI CompassWith NeysaEventsMLDS and moreNewslettersBelamy, Sector6VideosAIM TVInfographicsVisual storiesGlobal TechIT ServicesPeopleCompaniesGames

Events

CypherMLDSDESAIM GCC SummitMachineCon USACIO VisionAll events

Products and media

GCC ExplorerADaSciBest FirmAIM ResearchDeployedAIM Leaders Councilaim.media

Theme

Events

CypherIndia's largest AI conferenceMLDSGenAI summit for developersDESData Engineering SummitAIM GCC SummitMachineCon USACIO VisionAll events

Products and media

GCC ExplorerGCC intelligenceADaSciAssociation of Data ScientistsBest FirmWorkplace certificationAIM ResearchResearch and advisoryDeployedEnterprise AI, USAIM Leaders Councilaim.mediaAIM Media House
Subscribe
NewsFeaturesGCCStartupsEnterprise AIDeep TechListsLatestMagazineResearch

Tag · 5 stories

SGD

Every AIM story tagged SGD, newest first: reporting, analysis and interviews.

Deep Learningstochastic gradient descentADAMgradient descentMachine Learning
A beginner’s guide to stochastic gradient descent from scratch
Deep Tech

A beginner’s guide to stochastic gradient descent from scratch

Stochastic gradient descent is also a method of optimization. The objective function which needs to be optimised comes with suitable smoothness properties and this suitable smoothness makes the stochastic gradient descent different from th…

Yugesh Verma13 Mar 2022

Just in

  1. What is momentum in a Neural network and how does it work?

    4 Jan 2022, 05:30 IST

  2. Does Deep Learning Suffer From Too Many Optimizers?

    6 Mar 2021, 05:30 IST

  3. A Lowdown On Alternatives To Gradient Descent Optimization Algorithms

    9 Dec 2019, 05:30 IST

  4. How Stochastic Gradient Descent Is Solving Optimisation Problems In Deep Learning

    21 Sep 2018, 05:30 IST

AIMAIM

India’s newsroom for artificial intelligence, data science and the people building them.

App StoreGoogle Play

Sections

  • News
  • Features
  • GCC
  • Startups
  • Enterprise AI
  • Deep Tech
  • Global Tech
  • IT Services
  • People
  • All sections

Read

  • Latest
  • Newsletters
  • Magazine
  • Research
  • Lists
  • Live
  • AI Compass
  • Videos
  • Archive
  • RSS

AIM

  • About AIM
  • Authors
  • Editorial standards
  • Contact
  • Advertise
  • Subscribe
  • Reprints and permissions

AIM network

  • Cypher
  • MLDS
  • DES
  • GCC Explorer
  • ADaSci
  • Best Firm
  • AIM Research
  • Deployed
  • aim.media
© 2026 AIM Media HousePrivacyTermsRefundsCancellationsinfo@aimmediahouse.comBengaluru · Sunnyvale