filmov
tv
BERTology meets Biology | Solving biological problems with Transformers
Показать описание
Transformers are meanwhile famous in natural language processing. New research applies the BERT Transformer architecture on amino-acid sequences and discovers biological properties of proteins! 🧬 Because why not? 😊
"BERTology Meets Biology" paper explained!
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Outline:
* 00:00 Solving biology with the Transformer
* 01:08 Language BERT recap
* 02:37 Biology Bootcamp
* 05:43 BERT on biology
Scientific advisor for this video: Nils Trost
Hungry for more? 📚
🔗 Links:
#AICoffeeBreak #MsCoffeeBean #BERT #attention #Biology #MachineLearning #AI #research #Bioinformatics
"BERTology Meets Biology" paper explained!
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
🔥 Optionally, pay us a coffee to boost our Coffee Bean production! ☕
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Outline:
* 00:00 Solving biology with the Transformer
* 01:08 Language BERT recap
* 02:37 Biology Bootcamp
* 05:43 BERT on biology
Scientific advisor for this video: Nils Trost
Hungry for more? 📚
🔗 Links:
#AICoffeeBreak #MsCoffeeBean #BERT #attention #Biology #MachineLearning #AI #research #Bioinformatics
BERTology meets Biology | Solving biological problems with Transformers
BERTology Meets Biology: Interpreting Attention in Protein Language Models | AISC
BERTology Meets Biology: Interpreting Attention in Protein Language Models (Paper Explained)
PR-259: BERTology meets Biology: Interpreting attention in protein language modeling
A Primer in BERTology: What We Know About How BERT Works | L3-AI 2021
Understanding BERT: BERTology and Making BERT Smaller
CS886 BERTology by MojtabaValipour
Alphafold2 for biology n00bs
Performance of a fine-tuned ProtBERT model on classification of imbalanced... - Sima Ataei - LA 2022
Solving Biological Problems
FOXP2 gene
Efficient Evolution of Human Antibodies From General Protein Language Models and Sequence Info Alone
AlphaFold2, OpenFold, Protein Language Models and Beyond | Nazim Bouatta
Colloquium: Predictive and generative artificial intelligence for biology
Transformer-based Protein Function Annotation with... - Yue Cao - Function - Talk - ISMB/ECCB 2021
Structure-Aware Protein Self-Supervised Learning | Can (Sam) Chen
Protein Sequence Classification using BERT, Transformers, and Natural Language Processing
Protein Representation Learning by Geometric Structure Pretraining | Zuobai Zhang
11January2020
NASSMA 2022 AI4Science: Learning to align protein sequences with language models (Felipe Llinares)
Transformer based models for protein structure generation
John Mitchell 'Kaggle Competition Review: Novozymes Enzyme Stability Prediction'
A Deep Unsupervised Language Model for Protein Design
Mohammed AlQuraishi - OpenFold: Lessons and insights from rebuilding and retraining AlphaFold2
Комментарии