Graph Neural Networks (GNN) for Information Extraction with PyTorch

In this Deep Learning tutorial, we'll learn about Graph Neural Networks (GNN) for Information Extraction with PyTorch
PyTorch Tutorial for Beginners
Applied Deep Learning with PyTorch - Full Course
Cheat Sheets for AI, Neural Networks, Machine Learning, Deep Learning & Big Data

In this talk, I will provide a primer on a class of deep learning models known as graph neural networks (GNNs). These models generalize the well-known convolutional neural networks (CNNs) ubiquitous in computer vision, and the approach of the talk will emphasize that analogy. Specifically, after a quick general recap on graphs, we will see how to think of an image as a graph where nodes represent pixels and edges represent the relationship of being a neighbor. After expressing the formulas for a CNN in terms of this graph, it is not hard to imagine ways to pass from the graph of an image to arbitrary graphs. This way, one naturally arrives at a basic GNN architecture. Other recent advances, for instance graph attention networks, can also be surveyed, time permitting.

We will then survey the existing Python implementations and supporting libraries, with a focus on the PyTorch framework and on the PyTorch Geometric library in particular.

Next, I will turn to applications in the field of NLP, and in particular information extraction. I will focus on the problem of understanding documents in tabular format. Unlike regular paragraphs of text, these documents contain more information than just an ordered sequence of words. We will see how graphs can be used to encode the spatial disposition of words, capturing enough information to allow training deep learning models with good accuracy and generalization capabilities.

#PyTorch #DeepLearning #Morioh

PUBLICATION PERMISSIONS:
Original video was published with the Creative Commons Attribution license (reuse allowed).
------------------------------------------------------------------------------------