Article complete

Meet The Data Scientists Who Cracked The ‘Detecting Anomalies in Wafer Manufacturing: Weekend Hackathon #18’

Meet The Data Scientists Who Cracked The ‘Detecting Anomalies in Wafer Manufacturing: Weekend Hackathon #18’

Key takeaways

  • The eighteenth MachineHack weekend hackathon focused on detecting anomalies in wafer manufacturing, attracting significant interest from data science enthusiasts.
  • Over 280 participants registered, with about 180 actively engaging in the hackathon.
  • Manoj Batra emerged as the top competitor, employing advanced techniques like a cost-sensitive LGBM model and AutoGluon for his solution.
  • Batra expressed gratitude for the opportunity and hopes future hackathons address real-life issues.
  • This hackathon served as a platform for practitioners to enhance their skills in classification and machine learning.

Takeaways drafted with AI from the article text.

Out of the 280 competitors, three topped our leaderboard. In this article, we will introduce you to the winners and describe the approach they took to solve the problem.

#1| Manoj Batra

For building the model in this hackathon he used a cost-sensitive LGBM model to train initially then moved on to the AutoGluon package with Stacking and Hyperparameter optimization. His journey with data science started in 2015 when he joined IIIT Bangalore. At IIIT he started learning and exploring ML, post which he joined Amazon as SDE and had a break from ML. Last year he again started with ML, when he joined the ML team at Amazon and started working on ML projects which have a direct impact on people around us, buyers, and sellers on Amazon.

He would like to thank Machine Hack for giving him a chance to keep himself updated with the trend.

“This is my first hackathon on MachineHack. Overall experience was good, I hope in future we see hackathons solving real-life issues. A bit disappointed with discontinuation of Goodies :P ” - Manoj shared his opinion about MachineHack

#2| Neptune

To create a robust anomaly detection model Nepture stacked 3 different models to generate a final model using the AutoGluon package.

Some of the quick insights are as follows:

  • Model 1 -Train AutoGluon with AutoStacking, 5 folds, and 5 bagging folds
  • Model 2 - Overriding Model 1 outputs with overlapping training data points
  • Model 3 - AutoGluon with hyperparameter tuning + outlier detection outputs as features
  • Final model - Average the outputs from models 1, 2 & 3

He has always been excited about math and numerical computing which naturally led him to a career in data science. He has been in this space for more than 10 years now and has worked on a variety of ML problems across industries. However, He lost touch with hands-on modeling over time. But now he is trying to dust off his programming skills and play with ML recipes over the weekends, which is great fun!

“Machine Hack has provided the perfect platform for me to practice hands-on ML with interesting problem statements that are byte-sized and can be tackled in a short period of time. Also, a competitive setting is best suited to tune pipelines that would give robust and high performing models. Appreciate AIM for this great service to the learners in ML community” - Neptune shared his opinion.

#3| Nacir Bouazizi

Nacir explains his solution approach as follows.

  1. Eliminating features with a low sum of ones. 
  2. Applying gradient boosting classifiers but none of them gave a +90 score
  3. Applying logistic regression which gave better results (+91 score) 
  4. Feature ranking with recursive feature elimination (RFECV) but the score didn't improve.
  5. Trying Tabnet and that got me the best public score +93. ( the key was using AdamW + 15 StratifiedKfold) 

His journey in data science started 5 months ago. Back then, he had no clue what a dataframe is, so he started digging in this great field, a course a day, learning everything he came across. Starting with statistics, machine learning, and moving to deep learning and learning how to use different frameworks. For the first time in his entire life, he feels like he is doing something he loved and he can't get enough doing it. After having a bigger picture of what data science is he moved to participate in different competitions in different platforms to apply what he has learned, in real-life problems. 

“MachineHack is one of them. I met great minds and skilled people who helped me in different ways. I learned a lot from each one of them. Without your help, this would not have been possible.! I still have too much to learn, a lot of competitions to participate in, and a long way to go, but "it's all about the journey, not the destination". ” - Nacir shared his opinion.

Published

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

More in this story

Hackathon Winners · 5 stories
  1. How These Winners Cracked The GitHub Bugs Prediction Hackathon
  2. You are here: Meet The Data Scientists Who Cracked The ‘Detecting Anomalies in Wafer Manufacturing: Weekend Hackathon #18’
  3. The Solution Approach Of Winners Of Fake News Content Detection Hackathon
  4. Data Visualisation Hackathon Ends On A Scrumptious Note. Here Are The Winners
  5. Meet The Top Finishers Of MachineHack’s Buyer’s Time Prediction Challenge
About the author

Contributor

Experienced Data Scientist with a demonstrated history of working in Industrial IOT (IIOT), Industry 4.0, Power Systems and Manufacturing domain. I have experience in designing robust solutions for various clients using Machine Learning, Artificial Intelligence, and Deep Learning. I have been instrumental in developing end to end solutions from scratch and deploying them independently at scale.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.