Next generation infrastructure

By collaborating broadly within AI Sweden, experiences from building large-scale language models are combined with capabilities from other research areas within AI. The Natural Language Understanding (NLU) team, which developed Sweden's first large-scale language model, GPT-SW3, is among the contributors, together with AI Sweden's experts in edge learning infrastructure. Industrial partners will provide specialized hardware and software expertise.

The new infrastructure will focus on a decentralized architecture to overcome the limitations of centralized systems, utilizing data centers from partner organizations managed by a central orchestrator based at AI Sweden. By leveraging existing expertise and resources, the project aims to develop a future-proof prototype with significant performance improvements.

Expected benefits include better model performance, enhanced collaboration, increased privacy and security, cost efficiency, and hardware-agnostic solutions, which are anticipated to promote accessibility for academia, the public sector, and industry. 

The high commercialization potential includes offerings such as infrastructure as a service, data solutions, and technology licensing. 

Overall, the project is expected to have a positive impact on the global foundation model ecosystem, driving innovation and productivity across multiple sectors.

For more information, contact