Article complete

Researchers from China Release ChemLLM for Chemistry

It is built on top of InternLM-2.

Researchers from China Release ChemLLM for Chemistry

Key takeaways

  • Launch ChemLLM, the first language model specifically designed for chemistry tasks.
  • Outperform established benchmarks, including GPT-3.5, in molecule recognition and reaction prediction.
  • Utilize innovative template-based methods to convert structured chemical data into dialogue-friendly formats.
  • Demonstrate versatility across related mathematical and physical disciplines while focusing on chemistry.
  • Collaborate among multiple Chinese universities and laboratories to advance chemical AI research.

Takeaways drafted with AI from the article text.

​​Researchers from Fudan University, Shanghai Jiao Tong University, Wuhan University, The Hong Kong Polytechnic University, The Chinese University of Hong Kong, and Shanghai Artificial Intelligence Laboratory have jointly developed ChemLLM, a revolutionary Chemical LLM engineered to address a wide array of chemical tasks through fluent dialogue interaction.

ChemLLM, the inaugural language model explicitly tailored for chemistry, has surpassed established benchmarks, including outperforming GPT-3.5, on pivotal chemistry tasks such as molecule recognition, property description, and reaction prediction. It is built on top of InternLM-2.

This pioneering model not only showcases exceptional adaptability across various chemical disciplines but also demonstrates proficiency in specialised NLP tasks within the domain.

Traditional language models have encountered challenges in effectively utilising structured chemical data, often leading to compromised coherence in dialogue. To overcome this hurdle, researchers have devised a template-based instruction construction method, seamlessly transforming structured chemical knowledge into a dialogue-friendly format for model training. This innovative approach ensures ChemLLM's ability to maintain fluent dialogue while handling diverse chemical tasks with precision.

In addition to its core competency in chemistry tasks, ChemLLM demonstrates remarkable versatility in related mathematical and physical domains, despite its primary training on chemical-centric data. 

Furthermore, the model exhibits proficiency in specialised NLP tasks within chemistry, such as literature translation and cheminformatic programming, highlighting its comprehensive utility within the domain.

While ChemLLM represents a substantial leap forward in text-based chemistry applications, it is imperative to acknowledge inherent limitations. Challenges include integrating molecular graph modalities crucial for understanding molecular structures and interactions. 

Additionally, concerns regarding adherence to scientific ethics, particularly in generating responses under extreme conditions, necessitate ongoing refinement to enhance functionality and ethical governance.

For those eager to delve deeper into ChemLLM, codes, datasets, and model weights are publicly accessible for reference and utilisation, fostering collaboration and innovation within the scientific community.

Read: India vs China vs US in Open Source AI

Published Updated

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

LLMs · 5 stories
  1. You are here: Researchers from China Release ChemLLM for Chemistry
  2. Microsoft Backs Sarvam AI to Scale Indic LLMs
  3. ‘Attention is All You Need’ Author Suggests LLMs ‘Reflect’ in Pre-Training
  4. CAMB.AI, Kompact AI by Ziroh Labs to Optimise Voice Synthesis LLMs for CPUs
  5. LLM Watermarking Can Alter AI Agent Tool Calls and Behaviour: Study
About the author

Journalist

Mohit writes about AI in simple, explainable, and often funny words. He's especially passionate about chatting with those building AI for Bharat, with the occasional detour into AGI.

All stories
Belamy · Daily

The day’s AI news, before your first meeting.