Swedish NLP webinars - The Transformer Architecture

By practitioners, for practitioners

The main focus of the webinars is NLP development in Sweden and for the Swedish language, but international breakthroughs may also be discussed. 

Each webinar features an initial 45-minute presentation that covers recent work that in some sense is relevant for Swedish NLP, followed by 45 minutes of discussion.

Time: Thursdays even weeks 14:00-15:30

Register here

Upcoming webinars: 

20 January: What is a Transformer and what is the difference between the current models? 
- National Library of Sweden and RISE NLU Group 

This seminar provides an overview over the Transformer architecture for language models, and discusses the differences between the currently most popular models (e.g. BERT, GPT, RoBERTa, ALBERT, XLNet, Electra, etc.). We also present the current Swedish language models, and introduce the latest, and to date biggest, Swedish language model based on the Electra architecture.

3 February: How do we use language models in practice?
- Peltarion and RISE NLU Group

This seminar presents a best practice for using language models to solve real tasks.

17 February: Climate change and large-scale language models
- RISE NLU Group
Link for registration to this particular webinar and more information on the topic to come.