GPT-neo-1.3B + longer Text Generation w/ GRADIO on COLAB: Data Science App for AI text

preview_player
Показать описание
Language Models (LM) Text Generation with optimized GPT-neo: watch App Dev (right side of screen) in real-time with Gradio+COLAB in Python and download HuggingFace model for NLP text generation: GPT-neo-1.3B and optimize for more output sentences, longer output paragraphs! Almost crashes the 12.7GB RAM in free COLAB. Smile.

LLM version:
GPT-neo-1.3B version updated on Dec 31, 2021.

How to generate text:
using different decoding methods for language generation with Transformers!

Great COLAB NB by HuggingFace for more insight:

Almost crashes the 12.7GB RAM from COLAB.

Watch in real-time how to build your APP from scratch within minutes, load your HuggingFace model and generate an UI in pure Python.

#appdevelopment
#machinelearningwithpython
#pytorch
#nlproc
#nlp
#gpt3
#languagemodel
#Gradio
#colab

Link to (credits to this creator):

Remark:
GPT-neo-1.3B has been downloaded 400000 times from HuggingFace models, at the time this video is uploaded.

00:00 Download HuggingFace Model to my COLAB NB
04:20 Define Model parameter like length of output from LLM
05:40 Link to new App
07:36 Longer LLM output

{gpt-neo,
author = {Black, Sid and
Leo, Gao and
Wang, Phil and
Leahy, Connor and
Biderman, Stella},
title = {{GPT-Neo: Large Scale Autoregressive Language
Modeling with Mesh-Tensorflow}},
month = mar,
year = 2021,
note = {{If you use this software, please cite it using
these metadata.}},
publisher = {Zenodo},
version = {1.0},
doi = {10.5281/zenodo.5297715},
}
Рекомендации по теме
Комментарии
Автор

I've installed gpt neo 1.3 (2.7 is so heavy for rtx 3060 mobile and r7 6800h, i get an error) on my PC, but it give me answer like: "hello, what's your what is a dingo?, there are some dingoes here" wtf!? I downloading wiki dataset and something else for upgrade the communication level.. i hope it don't write to me about few more dingoes

SonGoku_
Автор

Hi, Thanks for the work. Loved your video lectures. It will be more helpful if you share your Google Colab file with us. Any repo of the code in the video, please?

AsifAhmadOfficial