ΑΙhub.org
 

Improving the understanding of metal-organic frameworks


by
15 March 2023



share this:

Scanning electron microscope image of MOF crystalsScanning electron microscope image of MOF crystals. Image credit: CSIRO. Reproduced under a CC BY 3.0 licence.

By Nik Papageorgiou

How does an iPhone predict the next word you’re going to type in your messages? The technology behind this, and also at the core of many AI applications, is called a transformer; a deep-learning model that handles sequences of data in parallel, and can be fine-tuned for specific tasks.

Now, researchers at EPFL and KAIST have created a transformer for Metal-Organic Frameworks (MOFs), a class of porous crystalline materials whose potential applications include energy storage and gas separation. MOFs are composed of thousands of tunable molecular building blocks (metal nodes and organic linkers), and, considering all possible configurations, a vast number of MOFs could potentially be synthesised. Given this vast space, it is a challenge to find the material that has the characteristics you are looking for. One option is to use machine learning techniques to search the property-structure space.

The “MOFtransformer” developed by the researchers is based on the transformer architecture that forms the core of popular language models such as GPT-3, the predecessor to ChatGPT. The central idea behind these models is that they are pre-trained on a large amount of text, so when we start typing on an iPhone, for example, models like this autocomplete the most likely next word.

“We wanted to explore this idea for MOFs, but instead of giving a word suggestion, we wanted to have it suggest a property,” says Professor Berend Smit, who led the EPFL side of the project. “We pre-trained the MOFTransformer with a million hypothetical MOFs to learn their essential characteristics, which we represented as a sentence. The model was then trained to complete these sentences to give the MOF’s correct characteristics.”

The researchers then fine-tuned the MOFTransformer for tasks related to hydrogen storage, such as the storage capacity of hydrogen, its diffusion coefficient, and the band gap of the MOF (an “energy barrier” that determines how electrons can move through a material).

The approach showed that the MOFTransformer could get results using far less data compared to conventional machine-learning methods, which require much more data. “Because of the pre-training, the MOFTtransformer knows already many of the general properties of MOFs; and because of this knowledge, we need less data to train for another property,” says Smit. Moreover, the same model could be used for all properties, while in conventional machine learning, a separate model must be developed for each application.

The researchers hope that the MOFTransformer will pave the way for the development of new MOFs with improved properties for hydrogen storage and other applications.


The MOFTransformer library is available here.

Read the article: A Multi-modal Pre-training Transformer for Universal Transfer Learning in Metal-Organic Frameworks.




EPFL

            AUAI is supported by:



Subscribe to AIhub newsletter on substack



Related posts :

Controllable AI and the power of local knowledge: an interview with Carmen Amo Alonso

  17 Nov 2026
How can we build AI systems that do what we want them to do? Control theory can help.

Data-driven re-discovery of 2D materials

  16 Nov 2026
With the help of AI, researchers have found previously overlooked occurrences of the 2D materials MXenes in older databases.

Tech-savvy STEM students prone to letting AI do their thinking for them

  13 Nov 2026
How can students break their dependence on AI tools?

An invisible word of the day: watermarking assignment prompts to detect copy-pasted chatbot answers

  12 Nov 2026
SteganoPrompt lets educators embed an invisible but openly announced instruction in an assignment prompt.

AI100 longitudinal study examines how AI has entered the mainstream

  10 Nov 2026
Published every five years, the report is compiled by experts in the field.
AI pioneers

Thinking big – from constraint programming to the Holy Grail: an interview with Gene Freuder

  10 Nov 2026
In our latest instalment of AI Pioneers, we speak to Gene Freuder on the field of constraint programming, neurosymbolic and generative AI approaches in AI, and the bigger picture of computer science.

How attackers persuade AI agents to break the rules

  09 Nov 2026
As AI assistants evolve into AI agents, a study has found that the biggest safety risks in their use may not come from single malicious prompts, but from carefully orchestrated conversations.

Interview with Minji Park: humans in the loop to keep language models up to date

  06 Nov 2026
Human-AI co-inference through a shared editable state.


↑


AUAI is supported by:







Subscribe to AIhub newsletter on substack




 















©2026.05 - Association for the Understanding of Artificial Intelligence