Swedish NLP webinars - The Transformer Architecture
By practitioners, for practitioners
The main focus of the webinars is NLP development in Sweden and for the Swedish language, but international breakthroughs may also be discussed.
Each webinar features an initial 45-minute presentation that covers recent work that in some sense is relevant for Swedish NLP, followed by 45 minutes of discussion.
Time: Thursdays even weeks 14:00-15:30
20 January: What is a Transformer and what is the difference between the current models?
- National Library of Sweden and RISE NLU Group
This seminar provides an overview over the Transformer architecture for language models, and discusses the differences between the currently most popular models (e.g. BERT, GPT, RoBERTa, ALBERT, XLNet, Electra, etc.). We also present the current Swedish language models, and introduce the latest, and to date biggest, Swedish language model based on the Electra architecture.
3 February: How do we use language models in practice?
- Peltarion and RISE NLU Group
This seminar presents a best practice for using language models to solve real tasks.
17 February: Climate change and large-scale language models
- RISE NLU Group
Link for registration to this particular webinar and more information on the topic to come.