Web scraping with Large Language Models (LLM)-AnthropicAI + LangChainAI

-----------------

🔥🐍 Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) Covering 350+ Python 🐍 Core concepts

---------------------

🚀This is incredible - web scraping with LLM🚀

👉 @AnthropicAI + @LangChainAI

💡1) Ask Langchain Agent to scrape data

💡2) Get back data in a list

And the magical thing is with 100k context window of @AnthropicAI, you dont need to use vectordb as well here.

------------

➡️ PlayWright Browser Toolkit

This toolkit is used to interact with the browser. While other tools (like the Requests tools) are fine for static sites, Browser toolkits let your agent navigate the web and interact with dynamically rendered sites.

-----------------

----------------

You can find me here:

**********************************************

**********************************************

Other Playlist you might like 👇

#opensource #largelanguagemodel #LLM #vectorstore #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #langchain

[kenchang]

Yes, very interesting, thank you. Given that you limited the max tokens to ~2K, is there any performance advantage to using Anthropic Claude1 or 2? Will any other LLM model do, e.g. Mistral or Llama2?

[ahassan]

Thank you so much for sharing this valuable information. it is absolutely helpful.👏👏

[kaluri]

Thanks, this very helpful. What if I want to extract some information from each of the extracted link? Can you please provide some inputs?

[kshitizkhandelwal]

Hey Rohan! Thanks for the video, loved it. Do you plan on making some Generative AI projects?

[helptest-fc]

hey Rohan, thanks for this informative video.Where can I find the source code

[sarojbono]

Very interesting! Thank you. I'm going to try to run this on my cpu.

[jack-wvjq]

Can you please tell me how to use this in javascript

[nikhildahriya]

Hi can you make a video using gemini pro or some other open source model from HF

[lovepreetSingh-rxvz]

Hello brother i need your suggestions on the use of Open source models for my work. I am creating the data for our project where what we do scrape the data from google and store the data in csv file or json. After that i am using google sheets to organise the data with the help of Openai api. Like i have appscript for openai api which works on all csv files, i can access the openai api in google sheets by just prompt for example i have to get the output from 2-3 column i can combine the output like =mygptmodel(“please create a summary of “&a2&” and now provide me the topic name from “&b2&” .”) i want to know that can o do this type of work with open source models because openai cost alot and i have to make 100’s of requests