Learn Advanced C# Concepts, Blazor, and Web Scraping - Let's Build a Next Level App

Показать описание

In this video we build an application, step by step, that automates web scraping functionality that firstly scrapes the TIOBE index for data pertaining to the Top 20 most popular programming languages. Our application's web scraping functionality then subsequently scrapes Amazon for text book data pertaining to each of the programming languages scraped from the TIOBE index. The scraped data is captured in a SQL Server database. Once the data is captured in our application's database, we then create a Blazor application where the scraped data is displayed in an aesthetically pleasing and functional way to the user through the user's web browser. The objective is to create a well designed, extensible application using C# that accumulates educational resources for the top 20 most popular programming languages in the world. So our application provides a library of educational resources pertaining to each of the programming languages ranked in the TIOBE index to our users.

Our web scraping solution is made possible through excellent services provided by Bright Data. Using Bright Data's services provides developers with a huge advantage over using other web scraping solutions. Bright Data provides an excellent proxy infrastructure where over 72 million IP's can be leveraged, providing the ability to target any country, ZIP code, carrier and ASN.

Please check out Bright Data's YouTube channel - @BrightData

Use the link below to get credits for using Bright Data's services
-------------------------------------------------------------------------------------------------------

🕐 Time Index

00:00:00 - Introduction
00:09:22 - Links to Code on GitHub
00:09:46 - Key Technologies Used in this Course
00:10:57 - Scraping the TIOBE Index
00:12:53 - Overview of BrightData’s Platform and Online IDE
00:25:03 - Develop the Code for Scraping the TIOBE Index
00:32:52 - Test TIOBE Scraper Manually through the BrightData Platform
00:38:52 - Overview of Data Delivery to our Code from BrightData
00:42:52 - Setting up our Local Testing Environment using ngrok - Overview
00:44:38 - Creating our WebHook Code (.NET Web API Project)
00:56:42 - Install and Configure ngrok
01:00:26 - Configure Data Delivery Preference for TIOBE Index Scraper
01:03:09 - Test Data Delivery Preference Configuration on BrightData
01:04:57 - Create .NET Console App to Test Invoking TIOBE Scraper Externally
01:11:58 - Create a BrightData Security Token
01:15:28 - Test .Net Console App to Invoke TIOBE Scraper Externally
01:18:39 - Developing the Logic for our WebHook
01:27:24 - Create a Background Service within Web API project (WebHook code)
01:49:37 - Test Scraping TIOBE Index, Capturing Data through our WebHook and Outputting Scraped Data
01:53:24 - Develop Code for Capturing the TIOBE Scraped Data within our SQL Server Database
02:20:31 - Test Capturing the TIOBE Index Scraped data within our SQL Server Database
02:21:47 - Create Blazor Application for Outputting Scraped TIOBE Data to Web Browser
02:36:28 - Test Blazor Application for Outputting TIOBE data
02:37:29 - Create Scraping Code using BrightData IDE for Scraping Amazon for Textbook Data
03:05:32 - Configure Data Delivery Preference Settings for Amazon Scraper
03:02:31 - Create Code in .NET Console App for Invoking Amazon Scraper Externally
03:11:00 - Create Code for Capturing Scraped Amazon Data in our SQL Server Database
03:16:00 - Implement Inheritance Hierarchy for DataHandling Functionality
03:58:36 - Test Capturing Scraped Amazon Data within our SQL Server Database
04:02:15 - Create Blazor Code for Outputting Amazon Data to a Web Browser
04:17:35 - Create Code for Multi-item Carousel for Displaying Amazon Textbooks
04:40:00 - Create Modal Dialog for Displaying Amazon Textbook Details
04:50:01 - Test and Watch Data being Captured in Realtime
04:53:33 - Outro

Code on GitHub
--------------------------
Web Scraping Code

Webhook - .NET Web API Project

Blazor

.NET Console App used for testing Web Scrapers externally

Free Technologies used to Create our Applications Functionality
-------------------------------------------------------------------------------------------------------
Visual Studio

SQL Server

Support the Channel 👍
------------------------------------
Buy me a Coffee ☕️

PayPal