udemy-web-scraping-in-nodejs-javascript-2021-8

1.Required Software\ 00:00:00 Software to web scrap 00:01:56 (optional) Note about 2.What you should ALWAYS check 00:07:17 This could save you A 3.Intro to CSS selectors and t 00:13:44 Intro to section 00:14:22 Using Chrome Develope 00:17:34 Selecting our element 00:21:23 Building our first sc 00:29:56 Selecting multiple el 00:34:48 Selecting using CSS I 00:37:35 Selecting using CSS c 00:40:45 Selecting using HTML 4.Scraping HTML tables with Re 00:43:09 Intro to section 00:44:10 Structure of a HTML t 00:46:17 Data Structure in Jav 00:47:16 Creating selector in 00:50:55 Scraping all table ce 00:55:11 Scraping data in Node 01:01:36 Scraping Company Name 01:08:37 Scraping all table co 01:12:29 BONUS - dynamic table 5.Scraping software jobs on Cr 01:19:36 Intro to project 01:20:52 Why are we using Pupp 01:22:21 Initialising project 01:23:32 Opening a URL with Pu 01:27:04 What data are we scra 01:28:56 Data Structure 01:32:21 Job Title Css Selecto 01:37:10 Scraping job title us 01:40:49 Scraping description 01:47:32 Creating array of scr 01:53:19 Scraping job post dat 01:59:04 Scraping Neighborhood 02:03:06 Scraping List of Page 02:09:58 Limiting Scraping Req 02:13:36 Scraping job descript 02:17:12 Scraping compensation 02:21:44 Setting up MongoDB da 02:25:32 Connecting to MongoDB 02:29:25 Creating Listing mong 02:32:24 Saving listing data t 6.Web Scraping Craigslist Jobs 02:36:47 Introduction 02:37:33 Project Setup 02:39:05 Getting Html from web 02:42:30 Creating sample of da 02:46:36 TitleURL From Jobs 02:52:56 Scraping Time Job Was 02:55:07 Job Neighborhood 02:56:06 Scraping Job Descript 03:02:54 Finish Description an 03:09:15 Outtro 7.What to do if you're blocked 03:10:01 Help! I'm blocked! 03:10:34 What can you do if yo 03:12:35 Using a proxy in Requ 8.Building a web scraper the T 03:14:47 Initializing project 03:16:23 Creating tests folder 03:17:26 Writing our first sim 03:21:04 Making our first simp 03:21:49 Getting HTML from the 03:26:23 Reading HTML file for 03:28:52 Writing out our tests 03:37:16 Getting title test to 03:40:55 Making URL test pass! 03:42:06 Making hood test pass 03:44:30 Making the final test 03:47:46 End notes + refactori 9.Exporting web scraping resul 03:51:47 Exporting web scrapin 10.Handling Network Problems\ 03:59:34 Handling Network Prob 11.Robots.txt parsing\ 04:04:59 What is robots.txt 04:09:25 Initialising project 04:11:13 Example of usage robo 04:18:06 Parsing robots.txt fr 12.Scraping Sites with Paginat 04:28:41 Simple Pagination Scr 13.Scraping Sites with Authent 04:40:52 Intro to authenticati 04:42:25 Looking at Login requ 04:46:05 Recreating login in P 04:57:48 Creating our login re 05:14:29 Using Puppeteer inste 14.Scraping a website with Coo 05:28:27 Intro to project 05:30:03 Replicating login req 05:33:06 Building out our requ 05:37:58 Getting CSRF token fr 15.Scraping Nordstrom.com - ho 05:48:15 Intro To Nordstrom.co 05:50:20 Finding the secret AP 05:57:38 Making a API request 06:04:28 Creating a REST API i 06:16:24 Passing Query Paramet 06:20:19 06_CreateReactApp 06:23:32 Starting React projec 06:26:46 Making a API Request 06:32:15 Something 06:45:26 Adding a form to Reac 06:53:47 Adding search query t 16.Scraping Imdb using Nightma 06:58:22 Intro to Project 06:59:27 Project Setup 07:00:50 So What Are We Scrapi 07:03:55 Scraping Top 100 Movi 07:09:45 Let's Get Some Good R 07:14:34 Easy Peasy Rank and D 07:16:53 Css Selector For The 07:18:18 Scraping The Poster U 07:25:37 Why Request Can't Scr 07:27:15 Importing NightmareJs 07:30:06 Scraping the Poster I 07:35:35 Saving the Poster Ima 17.Scraping AirBnb using Puppe 07:39:36 Intro to Project 07:40:34 Project Setup 07:41:48 What are we scraping 07:44:54 Sample Object + Index 07:47:57 Looking at the HTML o 07:52:08 Opening Page with Pup 07:54:40 Getting the URLS of t 08:00:46 Getting ready to scra 08:03:32 Opening Homes in a se 08:08:33 Scraping Price Per Ni 08:16:53 Why we are using Regu 08:18:56 Scraping number of gu 08:26:23 Scraping the beds, be 18.Architecture for web scrape 08:37:26 Intro to this section 08:39:42 Timed scraping vs on- 19.Saving scraping data to Mon 08:49:51 Build a super simple 08:55:14 Connecting to MongoDB 08:59:29 Connecting to MongoDB 09:02:39 Creating a MongoDB mo 20.Deploying a periodic scrape 09:07:55 Intro 09:10:00 Intro to code 09:15:20 Deploying to Heroku 09:20:26 Deploying to Google C 21.Deploying Puppeteer web scr 09:24:18 Deploying Puppeteer w 22.BONUS GraphQL Introduction\ 09:30:23 Introduction to Graph 23.Scraping a infinite scrolli 09:55:15 Intro to scraping inf 09:59:29 Project setup 10:01:07 Extracting items func 10:09:20 Scrolling and Scrapin 24.SECRET BACKDOOR to Scraping 10:20:23 How to get access to 10:27:18 How to use Postman to 10:33:25 Project Setup for Fac 10:34:21 Creating our POST req 10:41:04 Faking our User-Agent 10:45:17 Getting our Facebook 25.Student Q&A\ 10:51:01 Request HTML is diffe