Creating a scalable (...) with Elixir, Python & Tensorflow | Arjan Scherpenisse | ElixirConf EU 2021

Creating a scalable intent classifier with Elixir, Python and Tensorflow | Arjan Scherpenisse - Founder at Botsquad

ABSTRACT
Modern NLP (Natural Language Processing) tasks often build upon large, pre-trained language models like BERT. Neural networks that use these tend to take up a lot of memory, which makes it difficult and costly to scale.

In this talk I present the QnA ninja, a classifier service that recognizes text for for example answering FAQs. Elixir is used to coordinate the classification and training of multiple intent classifiers concurrently. It is capable of scaling by using BERT as a feature extractor combined with distributed Elixir to coordinate pools of Python worker processes.

• See & download slides:

• Follow us on social:

• Looking for a unique learning experience?
Attend the next Code Sync conference near you!

• SUBSCRIBE TO OUR CHANNEL