Custom Training Question Answer Model Using Transformer BERT

Simpletransformer library is based on the Transformers library by HuggingFace. Simple Transformers lets you quickly train and evaluate Transformer models. Only 3 lines of code are needed to initialize a model, train the model, and evaluate a model.
Subscribe my vlogging channel
Please donate if you want to support the channel through GPay UPID,

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more

Connect with me here:

[asieharati]

You're so passionate about teaching and it shows through all your tutorials. Thanks for the effort you put into this and helping others. The best ML channel I know so far on youtube.

[in_experience]

Thank you Krish for covering this Topic, you are a saviour as always.

[krunaltanna]

There are annotation tools like Haystack Annotation where you can annotate the training and test data set manually. Its a great tool for someone who is looking out to train a huge corpus of data. Btw Fantastic video Krish!! Thankyou :)

[a.s.]

Thank you Krish. We really appreciate your effort to create the video lectures. Your tutorials are really informative. Thanks for covering the Question Answer Generation BERT model topic.

[ayushsaxena]

Thanks for all the effort you've put on this Krishnaik. It's super well-made and helpful!

[nawazsheikh]

Thank you Krish. This was really helpful. Keep up the good work :)

[vikasrathod]

Krish sir, your videos are more informative than others. Would you please share how you created the dataset for QA model training.

[pabloempire]

Sir I am not able to find more videos from this playlist. This is amazing playlist. I want to learn more about transformers.

[jayasandeepreddy]

Thank you Krish.

Could you please make a video for "Text Summarization with Custom Data"

[Praveenkumar-pefh]

@3:52, it's a wrong explanation of the is_impossible flag. It essentially means that if it is set to false, the answer can be obtained directly from the context and if it is true, it means the answer can not be directly answered from the context.

[mansoorbaig]

Great topic Krish, please add videos on other NLP tasks also.

[MrCdofitas]

thank you so much krish! how can you get the list of training accuracy and evaluation accuracy?

[ysjang]

Thank you for your video. It was so helpful. One question. In real implementation, how do you use metric (e.g. f1 score) for evaluate the model?

[avartarstar]

@kirsh naik Hi, when creating a custom dataset, is it best to limit the context as short / as long as possible? Additionally, can a context have multiple question, and each quesiton might have multiple variation of answer?

[_it_nikhilpoojari]

Thank you so much, it was a great tutorial it helped alot

[ankitkumarverma]

Please create a video on how to train squad dataset for question generation. And thanks for this video.

[shushantpudasaini]

Thank you, your videos are of great help. Can you please guide me on how you created your custom data? Like if there are any labelling tools for question answering tasks.

[mamunurrahman]

Change train_batch_size to lower value like 6 or 2 . It will give you correct result. Bcs number of training data is very small.

[TheAmitsun]

Context, can answer, index at which answer is available. Feeding this kind of details to a ML model which is already trained on NL is not too much spoon feeding ? Think the amount of effort it will take to create a Q&A dataset with diverse topic. At the end model is doing a lookup or search? Where is intelligence ?

[carmelo]

Hi! I have a question... How use SimpleTransformers for generate answers more smartest?