Question Answering using Transformers Hugging Face Library || BERT QA Python Demo

Heard of "ChatGPT"?? Perhaps tried it too...

The foundation behind ChatGPT is the transformer architecture. In this video we shall build a question answering model using the transformers library of hugging face

We shall learn to select a pre-trained model depending on our task and build a pipeline to get the desired output

Find the references here:

If you would like me to prepare a separate video explaining how transformers work and why are they so powerful, comment "interested" below

--------------------------------------------------------------------------------------------------------
Why learn #datascience ??

"Data Science is the sexiest job of 21st century"

If you are a #btech student, #diploma in #computerscience, #graduate looking to #career #transition into #datascience , #machinelearning, #dataanalysis, this is a place for you

Everyone of us use social media platforms such as instagram, facebook, or binge watch on OTT platforms such as #youtube , netflix, prime, hotstar or window shop on e-commerce sites such as amazon, flipkart, myntra

It certainly amazes us to see the products of our choice and interest being #recommended to us, our favorite shows being filtered among millions of others

However, not many get to understand how it works. Not to worry, we shall help you understand the concepts in a #simplified and #concise fashion, helping in career transition into machine learning or data science

--------------------------------------------------------------------------------------------------------------------------------------

Why learn from datahat??

"Datahat is a bridge"
learners --- professionals by simplified data science

It provides a platform to learn, create and collaborate helping in the #career #transition to data science, machine learning and data analysis

Understand the broad domain of data science and its related subdomains in machine learning, data analysis, data engineering in a self paced, #structured and #guided learning

--------------------------------------------------------------------------------------------------------------------------------------
Additionally, here are few more useful resources for beginners and curious data enthusiasts

Remember, "the greatest investment ever made is investment in self growth and learning"

[kpodjiemmanuel]

Great video. Create a video on how to train the BERT Model

[boasorte]

Hello, if I wanted to create something like ChatPDF where I can request summaries and ask questions about the document, which model is better? I have seen people using models like RoBERTa, but I also see they use Mistral or Llama 2. Even 'Chart with RTX' from Nvidia uses the Mistral model to chat with their documents locally. What do you think about it?

[fahadasif]

love from pakistan. you teach very perfectthanks for taeching very well!

[Anilkumar-forp]

Thank you for detailed explanation. Is there a video or references to integrate QA transformers with UI (BotUI or ChatUI)?

[MrCdofitas]

i like this video, i hope that thier will be an image sample using llm

[putrikamaluddin]

Hi, can we change any parameters in the function? such in encode_plus() function.

[achukisaini]

Hii, I am Fine tune the question answer using the Roberta model.. i don' t have context only answer question in my file and Roberta model max_length is 512 but answer length is more than 1500 ... what should i do can you suggest me?

[satishkumar-irwy]

i have pdf files with me and i want to extract answers from those files. i looked for cdqa but it is obsoleted.
can you suggest me any transformer model for my use case, or how can i convert the pdf's into questions and context pair so that i can run your solution on top of it.

[loginemagdi]

what if I want to add drop out and batch normalization, can I do it with this model?

[hardiksharma]

Hi, i want to develop chatbot with my docs with sql database, no use of openapi only local libraries, please guide...

[vetonrushiti]

Thank you for the tutorial. I wanted to ask you a quick question. Does this model run locally because I want to know if the data are going to be only on my machine or they are going to be public if we use a pdf file which should not go public?

[vaibhavgirase]

Hello I am using pipeline for question answering and it gives coorect answers but their speed is very slow to extract answer. How to make it fast

[rajatavaghosh]

I am doing an AI project but wanted to know how can i make this run in any system that doesn't have the model downloaded in the system meaning how can someone test the code in their system if they dont have the llm?

[swingbreakoutstocks]

How can we train the model with the new input data?

[EM-nrhj]

I have json dataset, how can i convert this to question answering dataset.

[StreamerBaBa]

please mention how to get top 3 ans if we want

[NaveenKatta-ks]

Is this question answer model works fine, what if we change the way of asking the same question in different ways🤔

Please answer this question. 9:53

[NaveenKatta-ks]

Is this question answer model works fine, what if we change the way of asking the same question in different ways🤔

Please answer this question

[syedbabarali]

Is it totaly free ? how many data can I put in dataset for my question and answer AI chatbot ? What are the limitations ?

[shawcking]

Bro the purpose of this model is so useless. If user has to provide the context along with the question and the context contains the answer then what's the point of asking the question.
Its like I am asking
"Q: What is my name?"
"Cont: My name is ABC"

Why would one need help of QA model is they already know the answer 😂

A user goes to QA chatbot when he requires answer to a question which he doesn't know then how he gonna provide context of it 😂
This QA model seems complete nonsense to me.