Subscribe
Article Complete
Global Tech

Does Microsoft Cognitive Toolkit Really Lag Behind TensorFlow And PyTorch In Deep Learning?

Published

Does Microsoft Cognitive Toolkit Really Lag Behind TensorFlow And PyTorch In Deep Learning?

Key takeaways

  • Microsoft Cognitive Toolkit, rebranded in 2015, shows strong performance in accuracy and speed compared to TensorFlow.
  • Originally aimed at the speech research community, CNTK has evolved to support advanced neural network models efficiently.
  • Compatibility with Keras enhances the toolkit's usability for various workloads, including text, image, and speech processing.
  • Despite its efficiency, Microsoft Cognitive Toolkit lacks the extensive community support that TensorFlow enjoys due to Google's marketing efforts.
  • PyTorch offers dynamic model development, allowing for greater control during the creation of new architectures.

Takeaways drafted with AI from the article text.

The arrival of deep learning frameworks in the public domain has kick-started a framework war of sorts. In this article, we discuss how Microsoft Cognitive Toolkit, previously known as CNTK, stacks up against the ever-popular TensorFlow and PyTorch. While Google’s TensorFlow is immensely popular among developers and is also known for its better documentation, Microsoft open-sourced its own ML frameworks with LightGBM. CNTK, rechristened Microsoft Cognitive Toolkit in 2015, has now cornered a strong market performance in both accuracy and speed even when compared to TensorFlow. It was initially geared at the speech research community. In 2017, the tech giant launched the second version of Cognitive Toolkit 2.0 which allows implementing advanced neural network models efficiently. Even though Microsoft Cognitive Toolkit started later than Google, it has gained popularity and is linked to Azure toolkits as well. According to a section of users, Microsoft Cognitive Toolkit has been voted for its efficient implementations for LSTMs and CNNs.

Microsoft Cognitive Toolkit vs PyTorch vs TensorFlow

Data scientist Max Woolf said that one of the key features of the Microsoft Cognitive Toolkit 2.0 is its compatibility with Keras. It works well for RNN, CNN for text, image and speech workloads. Designed for speed and efficiency, it scales well in production, in fact, it has the ability to scale across GPUs. It also has a tighter integration with numpy. However, Microsoft Cognitive Toolkit has limited support from the community as compared to TensorFlow which is widely popular, thanks to Google’s heavy marketing. On the other hand, PyTorch enables users to develop their model dynamically, thereby lending more control over the development of new architectures. The common workflow is to develop and research with PyTorch, but the final production code is done in TensorFlow and finally deployed on TensorFlow as well. As PyTorch is developed by Facebook, it leverages dynamic graphs that implies developing a new computational graph on each forward pass. In fact, the main driver of PyTorch is the dynamic computational graphs. Just like PyTorch, it is deeply integrated with Python and follows an object-oriented paradigm. In fact, dynamic graph frameworks are less invasive and easily integrate with the programming language used. Users emphasise that in PyTorch it is easy to write clean code which is debuggable. Meanwhile, even though TensorFlow doesn’t scale as well as Microsoft Cognitive Toolkit, it is over-engineered (as pointed out by users) and doesn’t have the most flexible library, it nonetheless enjoys a great community support, thanks to being heavily marketed. Microsoft Cognitive Toolkit scales better than TensorFlow, it can even scale to 2000 GPUs, but what it lacks is a great community support like TensorFlow or PyTorch. Even though Microsoft Cognitive Toolkit framework is more mature and has a better interface, TensorFlow wins hands down, thanks to fanboyism. According to AI Scientist Jesus Rodriguez, no single DL framework is good at all the tasks. For example, TensorFlow works well on NLP tasks and image analysis models while Microsoft Cognitive Toolkit is efficient at speech recognition. Other frameworks like Caffe are immensely popular among computer vision researchers.

Deep Learning Market Size

A recent market report by Grand View Research, the deep learning market size is expected to touch $10.2 billion by 2025. What is fueling this growth is chip advancement and the increasing GPU-accelerated applications that have led to the widespread adoption of open-sourced DL frameworks. Another key area is that organisations are realising the need to extract valuable insights from data and develop better customer-centric products. Another research firm, Stratistics MRC, indicated that DL has exponential growth opportunity and the technology will be heavily utilised in mobile devices and healthcare sector, specifically for medical image analysis. In fact, deep learning technology will also play a pivotal role in the manufacturing industry with the DL being leveraged for powering machine vision systems, industrial robots and improve production cycle. By 2023, deep learning technology is set to see the highest growth in manufacturing.  

Published

Corrections: AIM corrects errors of fact and notes the change on the story. Spotted one? Tell the editors. Read our editorial standards.

Follow AIM
Preferred SourceGoogle NewsWhatsAppTelegram

More in this story

deep learning frameworks · 5 stories
  1. You are here: Does Microsoft Cognitive Toolkit Really Lag Behind TensorFlow And PyTorch In Deep Learning?
  2. Why Tech Giants Are Pinning Their AI Strategy On Deep Learning Frameworks
  3. Difference Between PyTorch And PySyft
  4. How PyTorch Is Challenging TensorFlow Lately
  5. PyTorch vs TensorFlow - Which is Better Deep Learning Library
About the author

Contributor

All stories
Belamy · Daily

The day’s AI news, before your first meeting.

Related