Google AI introduces Shift-Robust GNNs to improve generalisability in models

The study states that the distribution shift between training data and unlabeled data was reduced using a shift-robust regulariser.

Google AI research scientist Bryan Perozzi and research intern Qi Zhu have released a study that offers an answer for using Graph Neural Networks on biased datasets. Called ‘Shift-Robust GNNs: Overcoming the Limitations of Localized Graph Training Data,’ the research shows how a new method can measure the distributional differences between biased data and a graph’s true inference distribution. The largeness of the shift between two probability distributions also helps account for the amount of bias. 

Machine learning models face issues with generalising from the biased training data as the shift grows wider. This affects the generalisability of a model adversely. When a dataset’s accuracy was tested using a statistical analysis called the F-score, it was found that domain shifts led to a decrease in performance by 15-20 per cent. 


Sign up for your weekly dose of what's up in emerging technology.

As the distribution shift increases, the classification accuracy of the dataset decreases, which makes it hard for GNNs to generalise models as the difference between the training dataset and test dataset also increases. The study states that the distribution shift between training data and unlabeled data was reduced using a shift-robust regulariser. This technique assesses the domain shift during the training and then penalises it. This forces the model to ignore the training bias as far as it can. 

Results from the research showed that SR-GNN was more effective on biased training datasets and beat GNN outcomes in terms of accuracy. It also reduced the negative impact caused by biased data by 30 per cent to 40 per cent. 

More Great AIM Stories

Poulomi Chatterjee
Poulomi is a Technology Journalist with Analytics India Magazine. Her fascination with tech and eagerness to dive into new areas led her to the dynamic world of AI and data analytics.

Our Upcoming Events

Masterclass, Virtual
How to achieve real-time AI inference on your CPU
7th Jul

Masterclass, Virtual
How to power applications for the data-driven economy
20th Jul

Conference, in-person (Bangalore)
Cypher 2022
21-23rd Sep

Conference, Virtual
Deep Learning DevCon 2022
29th Oct

3 Ways to Join our Community

Discord Server

Stay Connected with a larger ecosystem of data science and ML Professionals

Telegram Channel

Discover special offers, top stories, upcoming events, and more.

Subscribe to our newsletter

Get the latest updates from AIM

What can SEBI learn from casinos?

It is said that casino AI technology comes with superior risk management systems compared to traditional data analytics that regulators are currently using.

Will Tesla Make (it) in India?

Tesla has struggled with optimising their production because Musk has been intent on manufacturing all the car’s parts independent of other suppliers since 2017.