Will The Latest IBM Proposal For Supplier’s Declaration Improve Transparency in AI Algorithms?

Deep learning has had enormous impact on the fields of computer vision, natural language and many other fields. But deep learning models have also been plagued with unexplainability and lack of transparency. The black box nature of DL models is the chief cause for non-interpretability. Now, to overcome these shortcomings, researchers are focusing on ‘Explainable AI’ wherein scientists can understand DL models and trace how the output was achieved. So far, DL models have achieved near human accuracy in image recognition, but through brute force techniques wherein they are fed terabytes of data.

This a cause of concern, specifically for two sections of audience — AI vendors who care about the accuracy and reliability of their models and the parameters and consumers who would like to understand the accuracy and reliability. They also care about parameters like safety, transparency and security.

AIM Daily XO

Join our editors every weekday evening as they steer you through the most significant news of the day, introduce you to fresh perspectives, and provide unexpected moments of joy
Your newsletter subscriptions are subject to AIM Privacy Policy and Terms and Conditions.

Now, researchers from IBM have put forth a proposal which would state how AI solutions/algorithms  fare in terms of purpose, performance, safety, fairness and risk factors. IBM has proposed a supplier’s declaration of conformity (SDoC) for AI services. This is with an aim to help increase trust in AI services and the service providers. According to the researchers, “We envision an SDoC for AI services to contain purpose, performance, safety, security, and provenance information to be completed and voluntarily released by AI service providers for examination by consumers. Importantly, it conveys product level rather than component-level functional testing. We suggest a set of declaration items tailored to AI and provide examples for two fictitious AI services.”

Naftali Tishby, one of the foremost thinkers and scientists in the field of understanding deep learning models, strongly believes that the black box of  deep learning should be opened.  He says, “The most important part of learning is actually forgetting.” This is quite appropriate since his ideas suggest that leaving some details behind can help us build models which learn better and are easy to understand.

Download our Mobile App

Supplier’s Declarations of Conformity

An SDoC is a declaration that asks supplier to explain the steps they have ensure performance, safety and security in the machine learning models. Every aspect have been well defined. As the researchers put it:

  1. Performance covers the issues of appropriate accuracy or risk measures along with timing information.
  2. Safety, entails the minimization of both risk and epistemic uncertainty, will include explainability, algorithmic fairness, and robustness to concept drift.
  3. Security will cover the aspects of robustness to adversarial attacks.

IBM researchers also proposed that clients should know how the supplier created the machine learning model. The supplier also should give out information regarding the training data used and how it may react in scenarios that are not known to the model. IBM researchers also propose that this declaration should be voluntary but there will obviously some trust attached with the supplier who undertakes the declaration because of peer and market pressures.

One of the main effects will be that enterprises will now get information about the AI service and vendors will improve their business performance. The researcher also compare similar regulation and declarations in other markets and industries. They talk about regulations and standardization organizations IEEE  and ISO which, define standards for many products and services. In the USA, researchers cite the example of United States Consumer Product Safety Commission (CPSC). The organisation requires a manufacturer to make a declaration in written or electronic form which says the product is compliant of all the standards.

Trust And AI Systems

According to researchers, specific measures can help improve trust in AI:

  1. Applying safety and reliability engineering methods in AI services.
  2. Identifying AI specific issues and solving them very fast.
  3. Building good tests and transparent reporting mechanism.

The research also listed specific factors that can be listed in SDoC:

  1. What is the intended use of the AI service?
  2. What algorithms or techniques does this AI service use?
  3. Which are the dataset on which the AI service is tested?
  4. Describe the testing methodology.
  5. Describe the results in detail.
  6. Do you know about about possible biases or ethical problems with the AI service?

These questions are not at all exhaustive and many questions can be added to the list.


It remains to be seen how AI suppliers take notice and implement these kind of regulatory actions and how they cope up with the efforts and investments that will be needed to produce the declaration. The size of the declaration may also keep expanding and it might also discourage many AI suppliers from strict consumers and clients. But on the other hand it is really important to think forward and have such policies to produce AI that is more understandable. It is clear that without such requirements AI suppliers would be happy to build black box AIs and ship them to their customers. Hence IBM’s proposal is obviously a good step in this conversation. AI service SDoCs ushering in a new era of trusted AI end points and bootstrapping broader adoption.


Sign up for The Deep Learning Podcast

by Vijayalakshmi Anandan

The Deep Learning Curve is a technology-based podcast hosted by Vijayalakshmi Anandan - Video Presenter and Podcaster at Analytics India Magazine. This podcast is the narrator's journey of curiosity and discovery in the world of technology.

Abhijeet Katte
As a thorough data geek, most of Abhijeet's day is spent in building and writing about intelligent systems. He also has deep interests in philosophy, economics and literature.

Our Upcoming Events

24th Mar, 2023 | Webinar
Women-in-Tech: Are you ready for the Techade

27-28th Apr, 2023 I Bangalore
Data Engineering Summit (DES) 2023

23 Jun, 2023 | Bangalore
MachineCon India 2023 [AI100 Awards]

21 Jul, 2023 | New York
MachineCon USA 2023 [AI100 Awards]

3 Ways to Join our Community

Telegram group

Discover special offers, top stories, upcoming events, and more.

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Subscribe to our Daily newsletter

Get our daily awesome stories & videos in your inbox

Council Post: The Rise of Generative AI and Living Content

In this era of content, the use of technology, such as AI and data analytics, is becoming increasingly important as it can help content creators personalise their content, improve its quality, and reach their target audience with greater efficacy. AI writing has arrived and is here to stay. Once we overcome the initial need to cling to our conventional methods, we can begin to be more receptive to the tremendous opportunities that these technologies present.