Whoever Said Machine Learning Is All About Statistics Is Wrong

It is often said that machine learning requires a strong background in statistics. While it is true that statistics is a must for ML engineers, but machine learning itself is not only about statistics.

A machine learning expert requires a basic understanding of statistics and that is because of the data. Statistics is a branch of mathematics that deals with analysis, whereas ML is a subsidiary of computer science. Both contribute to data science at large.

Why Are Statistics And ML Thought To Be The Same

People often ignore the blurred borders between the two fields. One major reason is that both use data to solve problems and both have an application in mathematics. Also, both ML and statistics work on models to solve problems. There are many things that ML cannot do alone and has to rely on statistics. Both the spheres here deal with model and both deal with predictions, and are therefore under a constant debate.

AIM Daily XO

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

ML and statistics have many similar terms, which is why a lot of people think it to be the same. Larry Wasserman, a Canadian Statistician explains in his blog:

Table with terms of machine learning and Statistics. Image source: KDNuggets.

The Fuzzy Line Between The Two

1. Rules: ML relies on learning from past data with no strict rules. ML learns from data and does not have to rely on strict rules or standard programming practices like the object-oriented design. Most of the work is done on computing and so it provides strong predictive ability with minimal human efforts. Statistics, on the other hand, has a set of rules to follow and it does not involve any learning from data. It strictly follows the program algorithm and gives a result. Statistics does provide the best estimate but with a more human effort as it demands the understanding of the relationship that the variable has on an equation.

Download our Mobile App

2. Applications: We need to identify what factors to consider in case of statistics. But in ML models, we only need to have more data and the model learns from it. More the data more will be the accuracy of the model. So, all that the model needs is data. ML works with large sets of data and its models are applied to high dimensional datasets. Statistical modelling is a lot about studying the relationships between variables in the form of mathematical equations for the purpose of predicting relevant outcomes. Statistical models are suitable to low dimensional datasets and it takes fewer attributes. ML is a very new subject compared to Statistics, which is a work originated in 1760s, and hence it has better applications as it is an advanced branch.

3. Assumptions: Statistics involves many assumptions. ML models do not need assumptions. It only learns from the input data. In ML fewer assumptions are made due to a better accuracy from the predictive models in comparison to statistical models which is more mathematically based.

4. Building block: ML is governed by algorithms and Statistical models are fundamentals of mathematical equations, which is obvious from the fact that the former is a branch of computer science and later that of Mathematics.

5. Result: One of the most fundamental difference between the two is that, Statistics gives us inferences based on the data that it receives, while ML gives us predictions based on the data.

John Rauser’s gave a very good example in his keynote Statistics Without the Agonising Pain. He gave a brief example to establish that if one can program a computer, he has direct access to the deepest, most fundamental ideas in Statistics. It in itself shows that the two fields are very closely related, but calling machine learning is all about glorified statistics would be completely incorrect.

Concluding Note

It is indeed true that ML, in a lot of ways, is an inspiration from statistics but it is not all about statistics. It takes help from statistics right from understanding the data to modelling. But it has used statistics as its support, took all the best outcomes of it and and progressed its own way. Statistical models are needed to work through an ML predictive model. It provides the basis and compliments the ML models. Statisticians and ML engineers have different paths to travel to conquer their goals and even are suitable for different work a lot of times. But it is also true that the two worlds overlap in many applications and compliment each other in remarkable ways.

Sign up for The Deep Learning Podcast

by Vijayalakshmi Anandan

The Deep Learning Curve is a technology-based podcast hosted by Vijayalakshmi Anandan - Video Presenter and Podcaster at Analytics India Magazine. This podcast is the narrator's journey of curiosity and discovery in the world of technology.

Disha Misal
Found a way to Data Science and AI though her fascination for Technology. Likes to read, watch football and has an enourmous amount affection for Astrophysics.

Our Upcoming Events

24th Mar, 2023 | Webinar
Women-in-Tech: Are you ready for the Techade

27-28th Apr, 2023 I Bangalore
Data Engineering Summit (DES) 2023

23 Jun, 2023 | Bangalore
MachineCon India 2023 [AI100 Awards]

21 Jul, 2023 | New York
MachineCon USA 2023 [AI100 Awards]

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox

Council Post: The Rise of Generative AI and Living Content

In this era of content, the use of technology, such as AI and data analytics, is becoming increasingly important as it can help content creators personalise their content, improve its quality, and reach their target audience with greater efficacy. AI writing has arrived and is here to stay. Once we overcome the initial need to cling to our conventional methods, we can begin to be more receptive to the tremendous opportunities that these technologies present.