Novo Nordisk participated in the AI, machine learning and computer vision gathering held by Voxel51 in New York on April 3, 2025. At this gathering, Novo Nordisk discussed the challenges and solutions of implementing safe and compliant LLOps pipelines in regulated industries.
What is LLOps?
Large Language Model Operations (LLOps for short) is an emerging engineering practice that aims to deploy large language models (LLM) reliably and securely to real businesses, similar to DevOps for software delivery in the past.
So what are the challenges Novo Nordisk faces in using LLOps?
1. Compliance of data privacy
For international giants like Novo Nordisk, when training and calling AI models, patients' personal health data cannot be exposed, and operations such as desensitization and anonymization are required, but too much context cannot be lost. This is a rather contradictory thing in itself, which requires both maximizing the use of usage and protecting the privacy of patients' data.
2. Model bias and security
Data models may output harmful content or recommend wrong treatment plans. For the medical industry, once the wrong medical plan is referred to or used, the negative consequences will be very large.
3. Approval of CI/CD process
Each model update needs to go through a strict approval process. In addition to the approval process, it takes time to deploy the model, generally from a few weeks to a few months. Such an approval process may not reflect efficiency.
Despite the many challenges, LLOps will also bring great benefits.
1. Improvement of diagnostic efficiency
When medical institutions can also use large models, diagnostic efficiency will be greatly improved. With the further improvement of the accuracy of the model, the work efficiency and economic efficiency brought about by this are also very optimistic.
2. Promote the development and maturity of LLOps technology
For the medical industry, global giants like Novo Nordisk joining AI medical care is definitely a very good attempt and opportunity, which is very conducive to accelerating standardization and tooling in the medical industry.
Coincidentally, on the evening of April 3, 2025, the Nasdaq fell by more than 5%, many AI stocks fell by more than 5%, and Novo Nordisk fell by less than 2%.
For more good articles about AI, please follow: https://iaiseek.com/news