Norilsk Nickel was the first company in the world to create a specialized large language model for the metallurgy and mining industry. Open source MetalGPT-1 understands complex professional language and helps improve the quality of manufacturing solutions.
Norilsk Nickel made a breakthrough by introducing the world’s first domain language model, MetalGPT-1, created specifically for metallurgy. Unlike usual AIwho are poorly versed in highly specialized terms, this model speaks the language of engineers and technologists. This reduces errors and improves the reliability of AI recommendations in real-world production problems.
The key advantage of the new model is unique training data. MetalGPT-1 learned from millions of internal documents: process protocols, design documents, patents and reports that were never published publicly. All this data has been carefully cleaned and anonymized to maintain trade secrets. As a result, the model gained deep industry knowledge.
The model includes 32 billion parameters and is trained on a huge array of specialized texts. Hundreds of thousands of examples of real production questions and answers were also created for her training. It helps artificial intelligence better understand cause-and-effect relationships in complex technological chains.
“MetalGPT-1 is a game changer. This is the first specialized model of this scale, which is optimized specifically for the language of metallurgy. It shows the highest level of understanding with resources available for real use at enterprises,” said Danil Ivashechkin, head of AI development at Norilsk Nickel.
Development took about a year. It took six months to collect and prepare unique data, and several months to train and fine-tune the model. To prove its effectiveness, company specialists created a special industrial benchmark for testing. On these professional tasks, MetalGPT-1 consistently outperforms conventional general-purpose language models.
Norilsk Nickel has already made the MetalGPT-1 model and industrial benchmark publicly available on the Hugging Face platform. This enables other companies in the industry to use advanced tools to create their own AI assistants. The introduction of such technologies opens a new era of digitalization of heavy industry, where accurate and reliable artificial intelligence solutions become part of everyday work.
Source: nornickel.ru
Image: @metalsesgtrends
